| Author |
Thread Statistics | Show CCP posts - 0 post(s) |

Kaladr
|
Posted - 2006.01.21 01:40:00 -
[1]
EVE-Central Cross Region Market Browser and Trade Finder
Since this is a topic which is more suited to the Market forum, I'm going to move my update thread here (from the spaminess that is General).
Updated 1/20/2006 - Cargo sizes work properly - The tradefinder is useable in the IGB. Rejoice. - No more large QuickLook pages crashing your EVE client. The IGB view has been limited to 25 orders for Buy and Sell each.
EVE-Central.com has a cross-region market browser fed with many user submissions. We aggregate all of the market data from users running the simple, open-source MarketUploader client on their systems to present a global view of how the market is doing. In addition to the simple viewing tools (and the soon to come historical statistics - statistics are fun :)), we now have a trade route finder which works across regions. It now knows about cargo sizes (new feature), data freshness, profit, and even works in the In Game Browser (many new enhancements have been made to support that rather rickety platform just today). It doesn't understand Jumps yet, but I have the dataset to import which I'll get around to this weekend.
Check it out today, and contribute to this great data source!
I'm thinking about making historical market data dumps available for download on a regular basis as well if there is any interest. I'm sure some people here would like to run their own analysis on the aggregated data.
- Kaladr ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies, Part of the Obsidian Union Alliance
|

Kaladr
|
Posted - 2006.01.21 07:47:00 -
[2]
When you see a URL in the IGB, and it ends in a / (such as /home/market/), replace the / with .html (so /home/market.html)
The IGB loves adding the /. I'll look for where this issue occurs... (its annoying) ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies, Part of the Obsidian Union Alliance
|

Kaladr
|
Posted - 2006.01.24 08:44:00 -
[3]
I've fixed yet another IGB issue which arose during certain navigation paths through the site.
I've also made the filter values 'sticky' per browser session (so don't have to refilter for size, etc). And by popular request, the number of entries per page is selectable now as well.
---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies, Part of the Obsidian Union Alliance
|

Kaladr
|
Posted - 2006.01.25 07:59:00 -
[4]
Edited by: Kaladr on 25/01/2006 08:01:38 What problems? 
Fixed. I was using the item name in the past to do the upload, but since the RMR data has been released, I'm no longer depending on the upload name. And yes the parser was messed up. ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies, Part of the Obsidian Union Alliance
|

Kaladr
|
Posted - 2006.01.28 00:36:00 -
[5]
I now have a full table of distances between systems, which I will be adding this weekend. I'm also adding system to region searches. ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies, Part of the Obsidian Union Alliance
|

Kaladr
|
Posted - 2006.02.05 11:28:00 -
[6]
Edited by: Kaladr on 05/02/2006 11:27:57 Site was hiccuped, but not the fault of the eve-central servlet. Subversion seems to be having issues, which was killing Apache, and hence no site.
Maybe I shouldn't have made the early move to Apache 2.2 But the large file support is so worth it  ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies - Manufacturing and Logistics |

Kaladr
|
Posted - 2006.02.12 09:07:00 -
[7]
Yup, you got it, the long overdue distance calculations :) ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies - Manufacturing and Logistics |

Kaladr
|
Posted - 2006.02.13 11:30:00 -
[8]
In case anyone is wondering what the "Register and Login" link is on every screen, here are my plans (and what I've been busy working on):
- Corporation Web Hosting - Already somewhat in place, it lets you make pages and type in HTML. The current interface is teh suck right now, but you gotta start somewhere. - Blueprint and Production Manager - Interface to manage and track what you are building, what blueprints you have, how many minerals you have to build an item, and more - Storefronts - Run your own Nagamazon. I'm still working on all the details here, but its designed to run 'build on demand' type products, but also allows you to maintain an active inventory (for faction/loot/cheap stuff). Multiple shopkeepers, realtime tracking of order queues, automatic order queue bumping for corp/alliance orders, auto notifcation by e-mail, and the whole lot. This will tie into the production manager to let you streamline the whole affair.
- Kal ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies - Manufacturing and Logistics |

Kaladr
|
Posted - 2006.02.14 00:59:00 -
[9]
Originally by: Nakbar I have been using your web site for a few weeks and its fantastic! One minor item to consider: Having a filter for security status of the system. [e.g. only show 0.5 or higher] While there are some islands of safe space, this would help me tremendously in planning my logistics
I'm a carebear at heart and running the pirate gauntlet for 200k isogen is not how I use your site.
Beyond that, awesome!
I'm going to build a second map model weighted for security status. Its not a big deal really, or so I think  ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies - Manufacturing and Logistics |

Kaladr
|
Posted - 2006.02.19 07:02:00 -
[10]
Apache bit the dust somewhere down the road, and I was out, so no quick restarts. Site is back up.
I'm moving sometime soon from this hunk-a-junk server to a newer machine with a hopefuly saner software install. I'll let you know when that happens. ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies - Manufacturing and Logistics |

Kaladr
|
Posted - 2006.02.22 19:25:00 -
[11]
Market reports/graphs are in! ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies - Manufacturing and Logistics |

Kaladr
|
Posted - 2006.02.24 11:59:00 -
[12]
I've moved EVE-Central.com to a brand new much faster dual processor dedicated server, and took the oppurtunity to upgrade a bunch of misc. software.
The site should be much more reliable and faster now. Enjoy! ---- EVE-Central.com | Obsidian Technologies - Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.03.01 04:39:00 -
[13]
If you're having any problems with the uploader not uploading files, make sure your EVE folder does not have any other files ending in .txt. Apparently my nonexistant "other file" detector is broken, so this can easily break the uploader. I'll release a new version sometime soon which allows upload by user statistics.
Thanks! ---- EVE-Central.com | Obsidian Technologies - Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.03.01 11:09:00 -
[14]
Edited by: Kaladr on 01/03/2006 11:14:18 I've released version 1.1.1 of the uploader which actually puts in a semi-intelligent check for the "random .txt file laying around" problem.
I'll be adding the source code shortly.
Remember: The uploader engine is open source, and you are free to modify, bugfix, and otherwise improve upon it. I welcome all bug reports and will try to solve them to the best of my ability. If you application has generated an error ".log" file, please e-mail it to me. ---- EVE-Central.com | Obsidian Technologies - Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.03.13 08:06:00 -
[15]
Since a bunch of people requested this, here we go:
- Leaderboard of most uploads, and an update MarketUploader to correctly submit this data. Old versions of the MarketUploader will of course still work.
You will need to register for an EVE-Central.com account with the In Game Browser. From there, feed that login information into the new Uploader by hitting the options menu.
In case you don't like having your name plastered out there, there is of course a (default) Anonymous option :-)
Update to version 1.2 today. ---- EVE-Central.com | Obsidian Technologies - Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.03.27 07:19:00 -
[16]
Originally by: Shinhan ...
My suggestion would be finding some corps that would like to advertise with EVE-Central. So, when somebody wants to buy an item that a said corp is selling, user will see at the top of his search results those prices. Of course corps that want to advertise would have to pay for the privilege 
All in all, great idea!
Not a bad idea there  ---- EVE-Central.com | Obsidian Technologies - Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.03.30 23:40:00 -
[17]
Originally by: Milodon I'm having problems with the uploader software. I try to run it and all I get is "The network appears to be down.... check your firewall settings."
I've turned my firewall off, set it to allow the program, I still can't get past that error message. 
When doing that check, the software tries fetching 3 files from EVE-central.com:
http://eve-central.com/protocol_version.txt http://eve-central.com/client_version.txt http://eve-central.com/motd.txt
Make sure you can get those files in your web browser. Are you using a proxy server for web access? ---- EVE-Central.com | Obsidian Technologies - Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.04.02 07:59:00 -
[18]
Originally by: Milodon
Yes, I'm coming from behind a proxy and that may be a problem. I'm using campus internet with a reroutable IP. However, the PCs at the computer lab had no problem with it, so I'm wondering if it's just the security setting on my wireless network at home.
However, I can access all of those *.txt files you listed in my browser, what does that mean?
Thanks in advance for the help 
In theory, the Python urllib is transparent fetching the proxy information from your client. Does Internet Explorer work correctly? If so, try setting the environment variable "http_proxy" to your "proxy host:portname" combo (EVE mail or email me if you need info how). Its more of a weird proxy issue it looks like. ---- EVE-Central.com | Obsidian Technologies - Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.04.02 08:00:00 -
[19]
Originally by: NiKunni Clerk Hi Kaldar, i recive the following error from your tool: Exception in thread Thread-52: Traceback (most recent call last): File "threading.pyo", line 442, in __bootstrap File "upload.pyo", line 47, in run File "upload.pyo", line 81, in upload_data UnboundLocalError: local variable 'upcount' referenced before assignment Found in the evec_upload.exe.log
Minor bug in 1.2 which leads to this, but the root of the problem is that your path to your EVE folder is not set correctly as default. Try pointing the client to the correct EVE path. ---- EVE-Central.com | Obsidian Technologies - Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.04.07 06:27:00 -
[20]
Originally by: Eternal Fury Is there some way that you could post the regions of space, and how recently they've been updated.
I'm thinking that if it's possible to "rate" each item in a given regions time since it was updated, that we could log on each day, see that ohh.. Quafe in Lonetrek hasn't been updated in 2 days, and update that..
hell, even have an option to put in what region we're in, and have it spit out the top 5 most out of date items, so we can update them?
Dunno if it's even possible ;)
Yes, quite possible ;) ---- EVE-Central.com | Obsidian Technologies - 0.0 Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.04.15 08:00:00 -
[21]
Done and done.
PS: Shops and advertising are coming soon(tm). Once I stop getting distracted shooting people   ---- EVE-Central.com | Obsidian Technologies - 0.0 Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.04.16 08:47:00 -
[22]
Originally by: Valeo Galaem For the Market Uploader app, a humble request...
Please add an option to minimize to the task bar notification area. As it is, I find myself frequently closing the app by mistake when running/closing programs, and it just takes up valuable real estate in the task bar.
Don't know if this has already been recommended.
Double click the icon in the taskbar. Or right click and select hide. That feature already exists. ---- EVE-Central.com | Obsidian Technologies - 0.0 Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.05.15 19:59:00 -
[23]
Originally by: PotatoHead
The only thing I'd like to see is the ability to make the program minimize to the program tray instead of the taskbar. I never need to maximize it, so it just takes up a space.
I'll get minimize -> system tray icon working some day (soon?)
In the mean time, double click the system tray icon. Poof, window is gone. ---- EVE-Central.com | Obsidian Technologies - 0.0 Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.05.22 06:11:00 -
[24]
Those errors are a random fluke in how the IGB works. It somehow forget to submit form data. And I have no clue why.
I'm going to go test this again once the new Blood patch comes out on Monday and see what happens. ---- EVE-Central.com | Obsidian Technologies - 0.0 Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.05.27 01:10:00 -
[25]
Good news everyone. Corp pages fixed. ---- EVE-Central.com | Obsidian Technologies - 0.0 Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.05.28 23:07:00 -
[26]
Originally by: Mr Ratty never mind, not tried in game but out of game it does remember :)
Sytem security status on the market browser would be a godsend tho!
I can do both actually. I wanted to have favorites per user not per session. Note that sessions get nuked in the IGB when you close the IGB window. Kinda annoying. ---- EVE-Central.com | Obsidian Technologies - 0.0 Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.05.29 08:58:00 -
[27]
Have you hit Export to File? The uploader does not magicaly grab data out of the EVE client. You must intiate the action. ---- EVE-Central.com | Obsidian Technologies - 0.0 Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
|
Posted - 2006.06.20 03:54:00 -
[28]
Not sure on that error ^^. There was a small outage caused by a server reboot (server facility upgraded power backup systems) and bad init scripts (database server didn't start ). Those are now fixed. If its still borking out for you, try deleting stuff in \Documents and Settings\yourusername\Local Settings\Application Data\EVE-Central MarketUploader\ (note that Local Settings and Application Data are normaly hidden folders). ---- EVE-Central.com | Obsidian Technologies - 0.0 Manufacturing, Defense and Logistics. We're hiring! Mail me |

Kaladr
Amarr
|
Posted - 2006.07.28 06:24:00 -
[29]
Congratulations, you've hit an annoying transient IGB bug  
Do me a favor and right click, show source, and eve/email me the contents of that window.
I'll figure out whats causing it one day. Lots of people can register fine, and the occasional few can't. Quite annoying. ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr
|
Posted - 2006.07.29 07:09:00 -
[30]
I've made the new alternate row color scheme in the IGB less... blinding  . Sunglasses now optional.
IGB is still slow when loading big tables :( Does anyone view the market browser in the IGB anyway? :) ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr
|
Posted - 2006.07.30 01:43:00 -
[31]
Originally by: Frustin Jetswell
If there was one thing i could change with the whole thing, it would be automatic "export to file". pressing that button everytime is a bit of an arse.
Apart from that, thanks for the work Kaladr, you're doing grand!
I'd change that too But I can't  ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr
|
Posted - 2006.07.30 05:19:00 -
[32]
Good news. You're supposed to get redirected from www. to without the www., but the IGB really doesn't like 302 redirect status codes. IGB 4tl :(
/me hacks on ajax eve-central.com ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr No Quarter. Axiom Empire
|
Posted - 2006.08.23 14:56:00 -
[33]
Dragon Information
The default output directory has changed to C:\Program Files\CCP\EVE\Capture\marketlogs
Make sure you point the uploader to this location. ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr No Quarter. Axiom Empire
|
Posted - 2006.09.05 05:42:00 -
[34]
I'm back from vacation and will check on the "missing systems" problems soon.
Missing systems would be bad. But there were no added systems? Added stations don't cause a problem. ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr No Quarter. Axiom Empire
|
Posted - 2006.10.03 22:28:00 -
[35]
If anyone has the names of the missing systems and stations, it would be much appreciated! ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr No Quarter. Axiom Empire
|
Posted - 2006.10.22 09:03:00 -
[36]
Added a new XML datafeed service. Enjoy :) ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr No Quarter. Axiom Empire
|
Posted - 2006.10.22 10:02:00 -
[37]
Note, I'm more than willing to add more information to the datafeed than what is available. Just toss me a message in game or an email and I'll do it.
- Kal. ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr No Quarter.
|
Posted - 2006.11.24 09:23:00 -
[38]
I've cleaned up the corp homepage service - which some of the corps actually use . No more ugly EVEC headers and weird page layouts. You're now simply inside a <body> tag with a <h1> on top - the rest is up to you.
And just a reminder on the corp pages. You can password your corp, and set pages on your EVEC website to "director view only". This means only your directors which you have given the password to can "join" the corp on EVE-Central.com and read your site. Also, when they leave the corp and visit EVEC again, the user is automagically removed from the corp. The password step is optional, but recommended as its possible to forge credentials (but not totally trivial).
Now a quick question. I'm looking to improve the site some in the next week or two, and curious what people are looking for...
What improvements to the market browser, uploader, or corp system would you like to see? E-mail, EVE-mail, or post to this thread.
Also, I'm stalking the forums looking for the Kali database dump so I can update systems, the tradefinder graph, and most importantly, types (new ships, mods, rigs, etc). If you see it posted on the forums, poke me and send me the link.
Thanks - Kaladr
(PS: I have some half implemented features still, like the corp ads, so some features are easier to implement ;)).
---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr No Quarter. C0VEN
|
Posted - 2007.01.13 07:48:00 -
[39]
Originally by: Indra Maire Thanks for the great site Kaladr.
I've noticed a minor bug you may not be aware of. When trying to price any sort of Datacore, it's difficult to determine exactly which Datacore's prices you are looking at. If you search for Datacore, you'll see multiple item types, but all with the same name.
It looks like you are parsing the market log filename correctly, since you have multiple entries, but I suspect some of the data display parsing is incorrect. This is probably due to not anticipating that an item name might include a dash. A sample name would be "Datacore - Plasma Physics" and "Datacore - Laser Physics".
Fixed by bringing in the latest Kali data. Enjoy
 ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr No Quarter. C0VEN
|
Posted - 2007.01.19 06:17:00 -
[40]
Originally by: Kimp Eater Is it just me or is the info on the site almost always incorrect?
Its as correct as there are uploads to correct it. Check the time, which is clearly shown on every entry, and if its old its probably out of date :)
As for donations, ISK wise send them to Kaladr. Real money wise, send me an email for details. ---- EVE-Central.com - Cross-region market view and trade finder |

Kaladr
Amarr No Quarter. C0VEN
|
Posted - 2007.01.22 06:38:00 -
[41]
Password resets are now automated! yay!
Expect some shiny new features to roll out by the end of next week. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. C0VEN
|
Posted - 2007.01.30 21:09:00 -
[42]
Rig components changed to 0.01 m3 from 1.0m3. Let me know if anything else seems broken with Revelations 1.3 content. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. C0VEN
|
Posted - 2007.02.13 04:21:00 -
[43]
Improved implants are coming as soon as I can drudge them out of the old market dumps.
I'll check into multispectral probes, probably suffer a similar fate as the implants.
---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. C0VEN
|
Posted - 2007.02.19 22:29:00 -
[44]
Now in: - Buy order ranges - Minimum quantity display - Upload suggestions (displays at random to reduce system load for now, and only if you have a region filter set).
Coming soon: - Notification of buy/sell orders hitting a pre-defined value with e-mail alerts. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.05.05 02:29:00 -
[45]
Edited by: Kaladr on 05/05/2007 02:25:45 Yes, leaderboard went bork a while ago. I'm working on resurrecting it. It really needs a redesign since the old version had super sucky performance.
Daily archive data dumps are available! From 2006! Yay! ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.05.28 07:22:00 -
[46]
We've installed a new piece of hardware over at EVE-Central.com in order to handle our growing server load. The trade finder has become markedly faster as a result (in addition to other back-end improvements, such as a new pathfinder engine).
Check us out :) ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.05.29 06:34:00 -
[47]
Originally by: Syath this stuff is a waste of time, if your not gonna put all the profitable trade routes in there then why even have this crap, its no help and it just clutters the forums with waste
I'm confused... or you're confused... The tradefinder will happily find you NPC trade routes (or player ones, though these are arguably rarer to just show up - requires more use of brain :)) with the provided data, which you can augment via the uploader utility. As you probably know, trade routes are hardly static, so I can't just "put all the profitable trade routes in there".
And the cross region market browser is probably the most used feature on the site. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.05.29 17:09:00 -
[48]
As I can calculate both low and non-low sec based routes, I'm currently not using a lookup tables of distances (4000*4000*12bytes) is a fair chunk of data in memory (yes, I know since the EVE graph is undirected so I can store less) . Its something I always consider, but haven't done yet.
I'm using a Dijkstra based approach, which finds the shortest path from a node to all other nodes in the graph, which is run on the set of starting systems. Since the EVE map is a sparse graph, adjacency lists and a (in v2.1) radix heap are used (currently using binary heap). The pathfinder can consume up to 4-6 seconds on a 100-200 starting system set (~3000+ actual routes). This version is written in C++ (and wrapped to the python code via SWIG), but previous versions were in Python using psyco as a JIT compiler (which sadly does not run in 64bit mode on AMD64).
---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.06.17 09:00:00 -
[49]
Originally by: Veidtre Kaladr,
One question that you might be able to help me with: I'm seeing some unusual stationid values on some datadumps. For example, "61000101" - I can't find a matching stationid in the latest databases from CCP or Chuker. There are 10 or 12 other unrecognized stationids?
V
I don't have more recent maps, but I do have player owned stations (61xxx) which are added dynamically. I'll make a dump of these available, though many do not have interesting names yet :) ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.07.04 05:26:00 -
[50]
I've pushed out 1.3 of the uploader which should (and I say should) not nuke your wallet export files.
Also has a "-hide" startup flag to go to your systray only by default. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.07.08 19:38:00 -
[51]
Originally by: Tradin Jack The trade route finder is currently not looking at the starting sector's security rating. Sahda keeps popping up it's ugly head as a source of nice trades in Domain. I suppose they might be if Sahda weren't .4 security rating :)
Probably a case of bad rounding from true-sec to normalized-sec (the 0.4193828 security status to 0.4 :)) ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.08.21 16:56:00 -
[52]
Originally by: Ludi Cross Hi, I love your site, it's a much-needed resource.
I noticed and verified today that the security filter is not working for the Trade Finder. Both checked and unchecked, it would repeatedly send me to destinations ending in low-sec space.
I realize it doesn't guarantee avoiding low-sec mid-route, but it previously avoided low-sec destinations as expected when this feature was activated.
Thanks for all your hard work!
Some systems are flagged wrong in the system (wrong rounded security status). I'm going to look at re-rounding them appropiately. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.10.27 22:27:00 -
[53]
Originally by: Tonto Auri Working now... Guess it want some ISK to grease their harddisks :)
If only I could feed XFS some ISK... ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.11.20 06:50:00 -
[54]
Now you can receive every market log uploaded to EVE-Central.com via e-mail, more or less the instant it happens. From there, you can filter it to a script on your e-mail server, or pull it from a POP/IMAP server at your end to process messages. This is probably the most advanced system we offer. It will chew through a lot of bandwidth and storage space, generating potentially hundreds of e-mails per hour.
Check out our developers page ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.11.20 21:32:00 -
[55]
Edited by: Kaladr on 20/11/2007 21:34:11
Originally by: LaVista Vista
RSS > Email.
RSS is pull. E-mail is push. I opted for push, as its the most real-time.
One lacking feature we have is the current market orders isn't available via the API. This is where an RSS-like feed would be the most appropriate, to complement the region/item statistics XML request.
DB master/slave replication is far too platform specific. Binary formats would conserve bandwidth at the expense of ease of use. Bandwidth isn't too much of a problem for now, so ease of use won. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.11.20 21:36:00 -
[56]
Originally by: Doug Gallespie Now if there were separate email lists for regions/items, that would be really cool.
I'd also like to see a nightly dump that included all the 'current' orders in the database, rather than just the new stuff received during the day. Otherwise I need all the historical data back for a year in order to establish what the current market situation is.
Both good ideas. I'll see what I can do. I still have some annoying DB related issues such as incorrect rounded sec-statuses for many systems that I have to work through as well. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.11.21 00:44:00 -
[57]
Originally by: Coconut Joe Surely the end result will just be programs querying their email servers repeatedly instead of yours? Do you think this will result in you using less bandwidth as a result? How do you intend to minimize waste, i.e. people not using the service any more, but still being subscribed.
And last question, (sorry, couldn't determine from the dev page), do you plan to do something funky with the email, like using it with SOAP, or will it just be the csv files?
Its really designed for people with their own mail server, though POP pulling is possible as well. In the case of POP pulling, it is offloaded from my system, so not really my concern in terms of bandwidth. For people with their own server, you simply setup a mail alias which pipes all mail to your interested script. Quick, good performance, easy to setup, and it works. SMTP also has very well understood delivery mechanics - when messages start failing (no route, server dead, account gone, mailbox full, etc), the list manager can quickly figure it out and stop delivery to that address.
Using RSS increases my bandwidth use, as people will have to constantly sc*****the RSS feed to discover new data, and then pull new data from there.
The output of the mails is in the EVE produced CSV format. Its a well understood format in regards to EVE market logs, and a good lowest common denominator. Using XML adds unneeded bulk in this case. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2007.11.21 00:47:00 -
[58]
Apparently s c r a p e is banned. :-/ ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2008.02.28 06:50:00 -
[59]
- New look and feel phase 1 launched - new nav bar and logo
- Some bugs relating to XML launched (such as the above one related to not passing in a user-agent) ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
|
Posted - 2008.03.21 01:17:00 -
[60]
Edited by: Kaladr on 21/03/2008 01:18:56 Hi all,
EVE-Central.com's primary co-location bandwidth provider is [drumroll] Cogent. Telia and Cogent are slinging mud right now, and not peering. There should be a backup route through another provider (L3 and XO), but it doesn't seem to be working. I'll have some words with the hosting provider about that. You can see from the traceroute above that the data actually seems to enter the data center its in, but then takes a suprise trip south to San Jose .
I can't offer a "quick fix" for this issue.
---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
No Quarter. Vae Victis.
|
Posted - 2008.04.03 23:46:00 -
[61]
A new blog entry about our recent mostly smooth upgrade and plans for new tools has been posted. Feel free to comment 
---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
No Quarter. Vae Victis.
|
Posted - 2008.04.03 23:47:00 -
[62]
Originally by: Ratcattle Hi Kaladr,
I uploaded a lot of mineral market files (e.g. megacyte from sinq and essence) but even 10 minutes later the orders don't show up in the market browser. I tried it a few times. Thanks for your great work so far!
Regards
Ratcattle
The in game browser will limit the size of the page to about 25 each. Don't view it in-game in general, so you can see more than 25 orders. The IGB sucks 
There were some issues with our upgrade where uploads were not being entered into the system correctly. This (should) be rectified. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
|
Posted - 2008.04.04 23:56:00 -
[63]
Originally by: Vega Vuf Hmm is it supposed to only show 25 entries on the page now or will it be fixed?
This issue has been fixed  ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
|
Posted - 2008.04.05 00:01:00 -
[64]
I've updated the XML API to a new version (but don't worry, the old version is still running along). Cleaner, better documented, more features, and even a bit faster. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2008.04.11 02:56:00 -
[65]
Originally by: sun seller Edited by: sun seller on 10/04/2008 23:38:55 hm, the download file seems to be broken; only 980kb then it stops. so maybe someone could contact someone ? 
http://www.eve-central.com/dl/evec_setup_1_3_1.exe
Try using Firefox. Some people have reported IE will just hack the file apart. Cause is under investigation. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2008.04.11 19:01:00 -
[66]
Edited by: Kaladr on 11/04/2008 19:04:17
Originally by: Jaarlax Edited by: Jaarlax on 11/04/2008 11:15:48 is the v2 data calculated differently? looking at trit in tash, i'm getting different max buy prices 3.4 v1 3.75 v2. i'm not using a minq or hours limit on the v2 results
it'd dt so i cant upload a fresh dump to see if they update, but if i run both they should both be looking at the latest dump and match anyway?
Edit i was using a query that checked t1 mins and tash and some other stiff in jita, but if i remove the jita part the results match. EG http://eve-central.com/api/marketstat?typeid=34®ionlimit=10000020 matches the v1 results (trit in tash) http://eve-central.com/api/marketstat?typeid=34®ionlimit=10000020&typeid=11399®ionlimit=10000002 no longer matches (trit in tash and morph in jita) or do i need to run seperate queries per region?
I'll look into it. Something is looking fishy.
Edit: It looks to be a case of minimum quantity - its being applied to sell & buy, but not all. Oops. I'll fix it in the next site push. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2008.04.12 20:59:00 -
[67]
Originally by: Jaarlax i didnt set a minq, i thought maybe it was ignoring the first region limit or averaging both selected regions as it only errors when multi regions are selected
cool you spotted the problem tho :)
Thanks
marketstat for minerals still has an (undocumented) minimum quantity filter to screen out the usual riffraff of orders. I'll update the documentation with the next upgrade (sometime next week). ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2008.04.29 20:28:00 -
[68]
Originally by: Dal Rath
Quote: IĈm also mulling over a possible Premium subscription to EVE-Central.
Hi Kaladr
Interesting idea. I'd like to hear more about your thinking here. In particular, I've been considering two aspects: how to provide incentives to users to upload data and how a charging model would interact with other sites using your various data feeds.
Providing some form of improved service to users who upload market data, perhaps in the form of subsidized subscriptions or 'uploader only' features would perhaps increase the data available, but would require some safe guards to prevent people uploading junk data just to qualify for the benefits. Do you have any plans for something like this?
Charging for services whilst leaving the data feeds free runs the risk of simply driving traffic to other sites that offer the same service using the free data but don't charge, or charge less, to end users. Of course taking load off your server may be a good thing, but reducing your subscription revenue probably is not. Do you plan to introduce any kind of restrictions on the ability of 3rd party services using your data to charge for it? For that matter, do you plan on starting to charge for the feeds?
The subscription-for-upload part is something I have been planning. The base tools will remain free, as well as the APIs and feeds. The advanced tools will be inexpensive or free with certain pre-requisites. I know others have created tools and other sites based on the datasets - my goal is to provide non-developers with similar tools for a little ISK on the side which are available with little hassle or setup.
I know others will probably freely make available tools similar to the ones I have up - once that happens I may reconsider portions of the premium access model. I've mulled about making "premium" uploads which would be time delayed for non-subscribers and API access, but have large reservation for implementing that idea.
My goal is still to provide open access to the markets  ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2008.05.02 06:19:00 -
[69]
Originally by: Jaarlax anyone having trouble connexting at the mo?
Something happened. I've undone the happening and other good stuff is happening now. |

Kaladr
Amarr No Quarter. Vae Victis.
|
Posted - 2008.05.02 06:21:00 -
[70]
Originally by: Dal Rath Thanks for the update. I'm working on some trade finding tools built on top of the eve-central data. I've opted for a more thorough but more computationally intensive algorithm than you use. Before I release it I'd like to solve two problems: how to provide priority service to people who provide eve-central with uploads and how to rate limit the rest.
Is there any way to query eve-central for the uploader information? e.g. an API that I can send a character name or CCP API limited key to and get back a reputation indicator of some sort? Some meta-data in the mail feed that would show the user id of the person uploading would also work, but I'd need some way of relating eve-central user accounts to CCP accounts/characters I guess. An openid like system would be really nice, or reusing CCPs API key mechanism in some way perhaps.
As for limiting usage, one option is simply to cap the number of queries a user can perform per unit time. However, I'd prefer to charge isk and give some of that back to eve-central. Any objection to a business model of that sort?
Just out of idle curiosity, how many hits do you get on the site? I know what the upload volume is via the mail feed, but it would be really interesting to see a breakdown of e.g. search volume by item or region. Some interesting market meta data to be had there perhaps.
I'll work on adding some uploader API information.
I haven't broken down object searched, etc yet, though could. Not counting API and IGB access, I get about 1 million pageviews a month. I easily get 5x more API traffic than pageviews though. |

Kaladr
Amarr No Quarter. Imperial Republic Of the North
|
Posted - 2008.07.25 07:11:00 -
[71]
Originally by: Sysion I was curious how movement was calculated as well... one issued I think there could be is that when an order sells out, how do you know? If someone is selling 1 million units of Tritanium and someone buys the whole order, how is that accounted for in the market logs? Seems like the order would drop off from it, but nothing showing the sale.
At this point, movement will not see whole orders which disappear. I am working on a version which does show visibility into this though. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Imperial Republic Of the North
|
Posted - 2008.07.31 08:21:00 -
[72]
Originally by: HerbTarlek So when are you going to add Detorid?
Added. Random oversight, which no one really caught.
I'm also working on black rise. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Imperial Republic Of the North
|
Posted - 2008.07.31 08:22:00 -
[73]
Originally by: Paula Quartz Where's the Eve-Central API documentation? Downloading the XML works fine, just don't know how they're constructed.
Documentation on what each field in the XML file pertains to? That doesn't exist, but I hope it is mostly self-documenting. If you have a specific question, feel free to ask. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Imperial Republic Of the North
|
Posted - 2008.08.03 21:35:00 -
[74]
Working on it 
I guess I can't leave during the weekends ;)
---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Imperial Republic Of the North
|
Posted - 2008.08.04 19:41:00 -
[75]
Originally by: Jaarlax it's backup looks like \o/
also, can you ad numbers to the leaderboard? its a pain to keep counting what place i'm at (21st at the mo )
Done and done :) ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Imperial Republic Of the North
|
Posted - 2008.09.30 07:18:00 -
[76]
Originally by: Key Nas Very nice site and the exports are really useful to many developed tools!
One question though as I have started playing with an idea for an app as well. Is there a limit at the number of typeids you can have at the url per each request? If not is there a best practice for me to do a request for all the items in your database? I have cleaned the items that are market objects through the database export, but still sending a request with 5000+ items at its url doesn't feel right. Am I missing something here?
Thanks in advance and keep up the good work!
There is no official upper limit, though limiting it to 100 type IDs per request would be reasonable. |

Kaladr
Amarr No Quarter. Imperial Republic Of the North
|
Posted - 2008.12.15 20:25:00 -
[77]
Edited by: Kaladr on 15/12/2008 20:25:56 Edited by: Kaladr on 15/12/2008 20:25:38 Sorry about that, had a rocky week and not enough EC babysitting time.
The 20 item limit is a temporary measure until I can work out a few performance issues relating to the use of 100s of type IDs in a single request (which is what borked the single backend server this week, oops).
---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Imperial Republic Of the North
|
Posted - 2008.12.18 05:12:00 -
[78]
And up :-/
Blah. I'll figure it out soon enough. Stupid new backend features :) ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr No Quarter. Imperial Republic Of the North
|
Posted - 2008.12.20 23:34:00 -
[79]
Originally by: Ambo I hope the requests from EMMA are not causing this, I noticed that eve-central's problems started not long after I released 1.0 . They are marked with a custom user-agent header as you recommend so if you're getting unreasonable numbers of them then let me know and I'll look into ways of reducing the load.
Currently requests are always for a single item and are made as data is required. results are retained and another request will only be made after 24 hours.
Don't believe so. The 20 item was a red herring however, not the underlying cause. Yay for concurrency bugs in native code. I've put in workarounds in deployment which should prevent it from croaking at inconvenient times.
---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr Viziam
|
Posted - 2009.03.09 01:51:00 -
[80]
Originally by: Marcus D'Eriellius I notice the EON awards are out and for some unfathomable reason EVE-Central.com does not appear in the best application/service category which makes the awards a laughing stock.
Don't worry Kaladr, we appreciate what you do.
Never got contacted about those 
Guess we'll have to set things straight at some point. |

Kaladr
Amarr Viziam
|
Posted - 2009.06.29 22:36:00 -
[81]
Just as an update, we are actively pulling market transaction logs, for the absolute best in pricing data.
More updates and a better interface soon(tm). ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr Viziam
|
Posted - 2009.07.24 06:09:00 -
[82]
Little known fact: EVE-Central was reading EVE-Metrics market data, back in EveMetrics 1.0.
Since the site update went on a feature reduction across the board, we no longer do it, but will resume soon(tm). |

Kaladr
Amarr
|
Posted - 2009.08.08 00:49:00 -
[83]
FYI, we're working on our own cache reading library.
See this thread for more details. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr
|
Posted - 2009.08.09 22:15:00 -
[84]
You're very welcome I hope our ongoing improvements will make your life even easier. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr
|
Posted - 2009.09.08 01:31:00 -
[85]
Rig data should be there. I will have to triple check on why you can't browse it (hmm).
We're working hard on Contribtastic! (the EVE-Central uploader version 2) which uses libevecache (our open source cache reader library). We're also in the middle of making the entire site codebase available under the AGPL. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr
|
Posted - 2009.09.19 23:09:00 -
[86]
Unborked. Please resume your normal fun activities :-) ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |

Kaladr
Amarr
|
Posted - 2009.09.20 04:36:00 -
[87]
Originally by: RAW23 I had alot of success at the start of my career using eve central (many thanks!). However, I was recently told that the data dumps could be manually edited to, for example, remove a nice trade by changing the figures, thus avoiding competition for the first person to find that route. Is this the case? If so, doesn't that make the whole site potentially useless? I say potentially because there are obviously not enough people currently doing this to completely break it (otherwise I wouldn't have had any success) but I would really like to know if this is genuinely possible before relying on the site again.
Sure is. The only defence against it would be the client signing each export, but that's basically not going to happen. Even the cache reading method is vulnerable to this "problem".
The best solution we have is volume. The more people that use it, the better the overall reliability is. ---- EVE-Central.com - Your EVE economic and corporate site, featuring the inter-region market browser |
| |
|