| Pages: [1] 2 :: one page |
| Author |
Thread Statistics | Show CCP posts - 0 post(s) |
infused
   |
Posted - 2005.07.20 03:29:00 -
[1]
I mean comon...
select * from forum where message = 'blah'
I know it's not that simple, but you get the point.
Can we PLEASE, PLEASE get a forum search feature. I don't want to hear this google stuff. We should not have to use google. Most of the time google will link you to ingameboard.asp anyway, so it's useless.
I just spent 40 minutes finding a thread for a friend...
I say we pention this as a forum bug 
Please post your support.
[World Domination]
[Patch 3366-3538: Mirror Here] |
Deja Thoris
|
Posted - 2005.07.20 03:33:00 -
[2]
Signed I want a pention.
|
Leno
|
Posted - 2005.07.20 03:48:00 -
[3]
keiron said it aint ever gonna happen, afaik it would slow boards down too much or something. Use eve-search.com it works most the time
---------------
RIP - Smoske, My Friend
Coasterbrian > babies are good, especially raw
Coasterbrian > soft and crunchy at |
Blind Fear
|
Posted - 2005.07.20 04:03:00 -
[4]
Its dishonest to call this a forum if it doesnt have a search feature.
I would like CCP to add a search feature to the current player comment pages which would make it function like a forum instead of like a mediocre livejournal comment tab.
However, even though every other forum in existance has a search feature, apparently it is technically impossible to do so here. I suspect CCP simply doesnt want people to be able to look through the history contained here.
Christ, can you imagine if people could easily find the old promises in Dev posts? There would be pitchforks and torches.
|
Chucky
|
Posted - 2005.07.20 04:09:00 -
[5]
 Originally by: Blind Fear
Its dishonest to call this a forum if it doesnt have a search feature.
I would like CCP to add a search feature to the current player comment pages which would make it function like a forum instead of like a mediocre livejournal comment tab.
However, even though every other forum in existance has a search feature, apparently it is technically impossible to do so here. I suspect CCP simply doesnt want people to be able to look through the history contained here.
Christ, can you imagine if people could easily find the old promises in Dev posts? There would be pitchforks and torches.
Its dishonest to call this a forum anyway
... you will see more and more marketing which in turn will bring you more players to torture. |
Tekka
|
Posted - 2005.07.20 04:11:00 -
[6]
Edited by: Tekka on 20/07/2005 04:12:09
ADD A SEARCH FEATURE, NOW!
That is all...
|
infused
|
Posted - 2005.07.20 04:14:00 -
[7]
Originally by: Leno
keiron said it aint ever gonna happen, afaik it would slow boards down too much or something. Use eve-search.com it works most the time
Oh, that's aload of rubbish. So WoW forums that have 500,000 people posting a day are slowed down by searching?
I don't think so.
[World Domination]
[Patch 3366-3538: Mirror Here] |
Mister Locke
|
Posted - 2005.07.20 05:52:00 -
[8]
Originally by: infused
Originally by: Leno
keiron said it aint ever gonna happen, afaik it would slow boards down too much or something. Use eve-search.com it works most the time
Oh, that's aload of rubbish. So WoW forums that have 500,000 people posting a day are slowed down by searching?
I don't think so.
And id agree with you...
It seems though that the forums may be running 'near' the game cluster - i dont know, just that the forums are unavailable on patch days. While im sure the forums arent run on the game servers, as in the system instance servers, maybe they use certain aspects of the game services - oh i dunno.
Maybe the game AND the forums are all run off an old Pentium 90 with the arithmetic bug, and thats why forum searching would slow things down too much. Search forums for 'ore thieving how-to' = sudden unexpected game lag and CTD in Yulai...
---
--Missile balance whiners make baby Jesus cry-- |
|
Chribba
|
Posted - 2005.07.20 07:22:00 -
[9]
Searching a large DB can be slow, I know that for a fact from EVE-Search - now I do not know why it is slow - because of bad coding or lack of resources.
But a search function will make the forum slower, so my suggestion is that CCP would do like EVE-Search has done, a mirror of the forum where all searches are made. Thus there should be no impact on the main forum at all (or allow me to import directly from the forum db to my db hehe).
Quote:
select * from forum where message = 'blah'
This query indeed would take just a few seconds to complete, however you more or less will be needing to use queries like this:
select * from forum where messake like '%blah%'
That will most likely time out when scrolling through about 2,000,000+ rows with forum posts. At least it does that on EVE-Search.
But of course until CCP finally decides do make a search function (which I hope they do even tho I run EVE-Search) anyone thinking they have a solution to a faster db or general tips, you are more than welcome to talk to me.
Until any change EVE-Search and google will try to aid you all in the best we can.
Signed.
/c
EVE-Files | EVE-Search | Get Email if thread updates |
|
Xelios
|
Posted - 2005.07.20 07:39:00 -
[10]
How do you misspell petition to pention? And more than once?
|
Discorporation
|
Posted - 2005.07.20 07:41:00 -
[11]
This forum runs on a webserver thats liked to the game Db. In order to get a search function working, it'll slow that game db, which'd be bad.
Uncoupling myeve from the game db'd make a search function possible, but then we wouldn't have leet things like the char overview :)
[Come to Daddy]
|
Mister Locke
|
Posted - 2005.07.20 11:15:00 -
[12]
Originally by: Discorporation
This forum runs on a webserver thats liked to the game Db. In order to get a search function working, it'll slow that game db, which'd be bad.
Uncoupling myeve from the game db'd make a search function possible, but then we wouldn't have leet things like the char overview :)
replication of objects necessary for forums to out-of-game db during downtime ?
---
--Missile balance whiners make baby Jesus cry-- |
babyblue
|
Posted - 2005.07.20 12:26:00 -
[13]
Originally by: Chribba
Searching a large DB can be slow, I know that for a fact from EVE-Search - now I do not know why it is slow - because of bad coding or lack of resources.
But a search function will make the forum slower, so my suggestion is that CCP would do like EVE-Search has done, a mirror of the forum where all searches are made. Thus there should be no impact on the main forum at all (or allow me to import directly from the forum db to my db hehe).
Quote:
select * from forum where message = 'blah'
This query indeed would take just a few seconds to complete, however you more or less will be needing to use queries like this:
select * from forum where messake like '%blah%'
That will most likely time out when scrolling through about 2,000,000+ rows with forum posts. At least it does that on EVE-Search.
But of course until CCP finally decides do make a search function (which I hope they do even tho I run EVE-Search) anyone thinking they have a solution to a faster db or general tips, you are more than welcome to talk to me.
Until any change EVE-Search and google will try to aid you all in the best we can.
Signed.
/c
It can be super quick, if you parse the text and index the words. SELECT * FROM MyGiganticTable is the naive way of doing it.
|
Dionysus Davinci
|
Posted - 2005.07.20 12:27:00 -
[14]
If there was a search feature, the OP would have known that there has been many of these threads :s
|
Verone
|
Posted - 2005.07.20 12:27:00 -
[15]
By the time we get a forum search feature i'll be able to claim my "pention"
I beleive chribba, who runs eve-files.com also has www.eve-search.com which can be used to search the eve-o forums 
MY NAME IS VERONE OF SNIGG, AND I AM GOING TO KILL YOU TILL YOU DIE FROM IT. |
Muad 'dib
|
Posted - 2005.07.20 12:35:00 -
[16]
an inbuilt search would be lovely, i also think its the lack of a search funtion that leads to the same question being asked time and time again.
I used google with "myeve.eve-online" before my search criteira, but now i will use eve-search, cheers Verone!
|
Zenst
|
Posted - 2005.07.20 12:35:00 -
[17]
I have often pondered this myself and tried to think of the best solution, one that will not ramp up bandwith and server usage and for my best effeort I propose this easy solution:
Allow users to access the forums via a usenet client, of course signing on as they woudl forums.
This allows those that which wto batch mode read better access, reduces bandwith even afactoring in the extra topics/subjects that people will download as is text and not web bloated'd. ANd they can search till there hearts content with there usenet client without impacting the CCP services in any way. I believe this would at the end of the day offer the users a more flexable soulution to forums without impacting the current offerings and probably reducing the bandwith usege by some way due to only ever needing to download a poast once. Edits woud be deatl with as deletion/new posting so the controls are there to handle things neatly. Even be able to still have your logo's/sigs if you so chose to utilise a HTML based usenet reader.
My other longterm thought has been a variation of the slashdot code (used to run www.slashdot.org). One feature that this offers is the ability to allow all users to self moderate and also offer you the ability to block at user level or any level you chose. ALthough the option to do all this via usenet would be more localised and more benificial without any possibel abuse unless you call abusing yoruself with filters abuse.
As for a search feature upon the current forums I feel that the CPU load/general extra load it would induce would be of major impact and hard to initialy guage. People doing keyword search's would be hammering it alot and unless search's were restricted to say past month then we are looking at some large voumes of data to meta search and pre-index to facilitate such search's.
Maybe a datawarehoused daily of the last weeks post's and alloow that to be searched or past month might be the way to ease into this approach without exposing the existing services to any form of unknown overload in volume of traffic and CPU load from all the index search's.
It is also worth being mindful that such a search facility and indeed google dejanews were used by spammers and trolls alot so perhaps the valid uses of such an option might outway the positive aspects. Personaly whilst nice functionality I have lived without it for a while now as have others to the extent that, it would be nice I would rather CCP focused on a more rounded presentation as they are and go with reginal variations and localisation and organicly evolve from there. That offers the community more direct benifit and in a measurable fashion.
|
|
Chribba
|
Posted - 2005.07.21 06:55:00 -
[18]
Originally by: babyblue
It can be super quick, if you parse the text and index the words. SELECT * FROM MyGiganticTable is the naive way of doing it.
Parse the text in what way?
Index the words... the average wordcount of a post is like 50, so thus indexing all words would make a 50*~2,000,000 long index, maybe not the best option.
The tables are today indexed by post date since index it by "message" is not an option since it index by the first character, and it's not likely to show any clue to what the post itself contains.
Just simple select statements is fast the slow queries come up when trying to find word(s) in the message text.
My queries look similar to this:
SELECT TOP 20 WEBDATA_POSTS.THREADID AS ID, WEBDATA_POSTS.AUTHOR, WEBDATA_POSTS.MESSAGE, WEBDATA_POSTS.POSTED, WEBDATA_POSTS.PAGE, WEBDATA_TOPICS.TOPIC, WEBDATA_FORUMS.FORUM AS SUBFORUM, WEBDATA_FORUMS.ID AS SUBFORUMID FROM WEBDATA_FORUMS INNER JOIN WEBDATA_TOPICS ON WEBDATA_FORUMS.ID = WEBDATA_TOPICS.FORUMID INNER JOIN WEBDATA_POSTS ON WEBDATA_TOPICS.ID = WEBDATA_POSTS.THREADID WHERE (WEBDATA_POSTS.MESSAGE LIKE '%nightmare%' escape 'Á') ORDER BY WEBDATA_POSTS.POSTED DESC
Such a query takes about 20 seconds to complete, now that is on a db with only ~300,000 rows, running through the whole db would take way longer - thus the problem.
Adding another search word like adds extra time as well, so it's a problem not yet solved. Gimme a google cluster and it should be faster hehe ;)
But of course if you think that the query itself is the problem, feel free to modify it to make it faster :)
EVE-Files | EVE-Search | Get Email if thread updates |
|
elFarto
|
Posted - 2005.07.21 11:04:00 -
[19]
Chribba, out of interest, which database server are you using? MySQL? PostgreSQL?
Regards
elFarto
|
|
Chribba
|
Posted - 2005.07.21 11:20:00 -
[20]
MSSQL 
EVE-Files | EVE-Search | Get Email if thread updates |
|
elFarto
|
Posted - 2005.07.21 11:25:00 -
[21]
Edited by: elFarto on 21/07/2005 11:26:40
Originally by: Chribba
MSSQL
I think I may have found the problem of why it's slow
Anyway, a couple of searches on google brought up this SQL statement:
SELECT title, notes
FROM titles
WHERE CONTAINS (notes, ' "quick easy" ')
Which I belive require full text search to be install. Link
I don't know if that'll give you any speed up as I don't know much about MSSQL, I'm more a PostgreSQL person .
Regards
elFarto
|
infused
|
Posted - 2005.07.21 11:33:00 -
[22]
If your going to get on the mysql/port argument, have a look at some benches... mysql as pretty damm fast now on a good system with the right statements. :D
[World Domination]
[Patch 3366-3538: Mirror Here] |
|
Chribba
|
Posted - 2005.07.21 11:48:00 -
[23]
I have tried full-text search before but it did not work like it was supposed to, however I will give it another try when I get time.
I do know it takes a LOT of time to build the search index as the db itself is over 2gb. So I need to make sure it won't disturb the other services when I begin.
EVE-Files | EVE-Search | Get Email if thread updates |
|
Vernichtungsengel
|
Posted - 2005.07.21 12:02:00 -
[24]
i DEMAND my 100mil per week pension
Vernichtungsengel - 'Angel Of Death'
|
Malvolio
|
Posted - 2005.07.22 03:18:00 -
[25]
Edited by: Malvolio on 22/07/2005 03:19:59
For a couple grand they can pick up a Google Mini search appliance that is capable of crawling and searching 100k pages. That should be more than enough to cover the number of forum threads that currently exist. (And its customisable in what it crawls, so they can probably even do some filtering in it if it gets to large, or just get more than one, etc etc.) Simple to use, fairly cheap, and should do what they need, assuming they got room for a 1U server in thier data center.
http://www.google.com/enterprise/mini/
-- Malvolio
|
Maurauder
|
Posted - 2005.07.22 03:28:00 -
[26]
It goes up and down (for various reasons) but there is a search website at http://www.eve-search.com/
|
j0sephine
|
Posted - 2005.07.22 03:31:00 -
[27]
Maybe if someone declared they'll eat their Deimos if the forum ever get the search feature...
But without this kind of incentive i just don't see it happening :s
|
Neslo
|
Posted - 2005.07.22 03:46:00 -
[28]
Pention? How about petition and a forum spell check?
From Ashes to Ashes... From Dust to Dust....
|
Plekto
|
Posted - 2005.07.22 04:05:00 -
[29]
Running the game and the forums on the same server is inane.
Seriously. Get a single P4 and run the forums on it all by itself. 90% of this stuff is static anyways and they already do this for the FTP servers(patches and downloads and such) and the marketing/store server.
More important, though - the market in the game is utter junk. Escrow is the real backbone of the economy. We need categories or at least a search feature there. Implimenting 6-8 categories wold be the siplest way - you choose which one to place it under when you create it. That way if I want blueprints, I can scroll through a secoection of only those as a few seconds.
As it is, it's horribly cumbersome and bogs down the economy. Given that getting anywhere in the game takes half an hour, even with instas, we need to have better access to market data.
|
Marlz
|
Posted - 2005.07.22 06:17:00 -
[30]
signed
|
| |
|
| Pages: [1] 2 :: one page |
| First page | Previous page | Next page | Last page |