Author |
Thread Statistics | Show CCP posts - 0 post(s) |

Hexxx
Minmatar
|
Posted - 2009.02.23 08:11:00 -
[1]
http://www.eve-metrics.com/
This is a website similar in function to EVE Central, with one important difference; it includes a tool that automatically uploads any market data you view while playing EVE. It does this by "scraping" the cache files that EVE uses when you view the market details for anything. No fuss, no muss, just automatic feeds of data.
There is also security that prevents false market data from entering the database and some extremely useful reporting and statistic tools. In the future, they plan on having an API for developers to use.
Check out the website, check out the reports, check out how awesome this is!
All this from Ix Forres, the guy who created IskSense. 
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.23 09:17:00 -
[2]
Originally by: MK Dom Auto loading the market info is wftbbqpwng!
In a word; yes.
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.23 09:25:00 -
[3]
Originally by: Kazuo Ishiguro So, to clarify, there's no need to spam 'export data' for every item? Sounds good. Has Ix checked that using cache files in this way is EULA-safe?
I'm sceptical about the security features - if you can read cache files, someone else can probably write to them if they really want to try to poison the database. Also, it lacks some of the flexibility of the eve-central API - the option to restrict API queries to a single station or solarsystem seems to be missing.
Having said all that, it certainly looks promising.
He uses some kind of checksum to verify authenticity of the cache file. I'm not clear on the details but I believe it to be effective.
In terms of restricting the queries on stations or solar systems...markets operate best when they're efficient. Transparency breeds efficiency. So this program seems to operate in the best interests of a transparent/efficient market. 
The most useful function isn't the solarsystem specific sell/buy orders but instead the indexes created from all these orders. I noticed that some of them are down right now, but the promise of nearly automatically created indexes is....well....incredibly promising.
Indexes like those could be used as the foundation for futures contracts on minerals for example. This is just one of many possible uses.
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.23 09:28:00 -
[4]
Originally by: Daphne Eveningstar Edited by: Daphne Eveningstar on 23/02/2009 09:25:33 Edit: Assuming this is automated and no "export to file" spamming is needed,
There was a guy about this time last year making a tool that used these same files to do some automated price analysis. It was deemed a EULA violation.
tbh I'm concerned that CCP hasn't locked down those data streams to prevent this. Either make it legal and official (and automatic) or do something to disable the functionality (ala Bacon).
From what I understand he's not messing with the client (the executable, DLLs, etc) but instead clear-text files. This is probably how he's getting around the EULA.
He's not editing anything, just reading some clear-text files.
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.23 10:58:00 -
[5]
Originally by: Marcus D'Eriellius You mention there will be developer APIs in the future but the documentation already mentions them.
However, querying via API produces invalid XML:
<?xml version='1.0' encoding='utf-8' ?> <evemetrics api_version='1.1'> <?xml version="1.0" encoding="UTF-8"?> <evemetrics api_version="1.0"> <region name="The Forge"> <type name="Tritanium" id="34">4.14710945273632</type> <type name="Pyerite" id="35">3.90247984496124</type> <type name="Mexallon" id="36">24.9396716981132</type>
</region> </evemetrics> </evemetrics>
Secondly, would it be possible to have some method to ignore the outliers in the data, either copy the minQ parameter from Eve-Central or, better yet, have a way of getting the 95% price as the Jitaindex used to calculate?
Great work, look forward to implementing it :)
I think you need a Developer Key to use the API for it.
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.23 10:59:00 -
[6]
Originally by: Daphne Eveningstar Edited by: Daphne Eveningstar on 23/02/2009 09:50:44
Quote: Browsing market order pages will upload order info, and browsing the history graph/table page will upload history info.
That's from the page for their uploader utility 
All I can say is wow. I guess Bacon required the debugger to be running didn't it?
If this is stated by CCP to be a legal use of the client cache than let me be the first to offer up a bounty of 2 billion for a local exe version of the same functionality. I want every market lookup I make (across multiple accounts and hosts/clients) stored in a local MSSQL database for quick analysis of both the current picture and the historic data.
Why would you want local? Just grab the uploader, upload tons of stuff, and view the information along with all the other updates from all the other people!! 
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.23 11:01:00 -
[7]
Originally by: ZeusOnRoids this is a great tool, but its usability depends completely on the number of poeple running the uploader. so, come on trader, let it run
Yes, the number of people increases the value of the utility. Sounds like Network Effects to me! Bottom line, this thing becomes EXPONENTIALLY more valuable the more people download and install the uploader utility.
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.23 14:05:00 -
[8]
Originally by: Verite Rendition Edited by: Verite Rendition on 23/02/2009 13:38:52 How is it I've never heard of this before? It looks like a great tool.
The website needs a bit of work however. It's not pruning old data (I'm seeing things from 2008) and the inability to select what region you want to check without logging in is a PITA. All the data in the world won't help if your website sucks.
I'll shoot a note to Ix Forres about the old data issue. The requirement to login may be a bit PITA, but the cost is pretty low considering all the data you get.
And to a previous point; the utility of EVE Metrics increases exponentially the more users are on it. Hopefully we can drive increased adoption of the uploader utility to really give this tool a boost.
I'm running the uploader in the background everytime I start up my computer.
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.23 14:16:00 -
[9]
Originally by: Muscaat
Originally by: Hexxx The most useful function isn't the solarsystem specific sell/buy orders but instead the indexes created from all these orders. I noticed that some of them are down right now, but the promise of nearly automatically created indexes is....well....incredibly promising.
Indexes like those could be used as the foundation for futures contracts on minerals for example. This is just one of many possible uses.
I'm keeping an eye on it as a second data source for EVE Markets - I've not yet found the time to have a play (nor a headscratch on how to integrate it). 
EVE Markets = EVE Central.
They get their data from the EVE Central API so it suffers from the same problems EVE Central has; that is a lack of data due to manual uploads and data integrity (false export records).
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.23 23:24:00 -
[10]
Originally by: Kazuo Ishiguro
Originally by: Hel O'Ween As it reads, the limit is per developer key, per hour. This means that if *one* user does 20 lookups, *all* other users are out of business for the next one hour.
This for sure can't be the intended outcome.
This is clearly a matter for Ambo to look into - one solution would be for him to add the option to enter your own key into EMMA.
I think this would probably be the solution, I'll keep trying to get Ix Forres to get in here and post a little.
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.02.24 23:04:00 -
[11]
Originally by: Ix Forres
Originally by: Akita T
Originally by: Ix Forres view the graph page and it uploads that same data. It's not used on the site anywhere except the indexes section yet, though.
Yeah, that... it was just a mistaken assumption on my part when the server hicked-up (see edits above)... I suppose you're just swamped by the deluge of people putting orders up and checking your site at the moment thanks to this thread 
On that note... is the server down for upgrade/maintenance reasons, or is it really just overloaded ? How much CPU usage do you get, how do you think will it scale later on, etc ?
Really overloaded right now; the server's only a little on and it keeps running out of RAM. I'm working on a solution right now. Expect it to be alive again tomorrow at latest.
Tell us what your needs are and we'll make it happen. 
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.03.03 12:38:00 -
[12]
Originally by: Ahro Thariori
2) Had you considered teaming up with eve-central? Before you got this far ofc. It seems your most important contribution is the cache reading. Building your own site is probably just an exercise for you. Is it? Is it a case of "not-invented-here" ;)? Or do you have some long-term interest in exercising control over the whole process ? Eve-Central seems to have stable servers and a stable API, unlike yourself. If you care to elaborate: what is your strategic goal in superseeding eve-central?
They should feel free to develop independently, that's the nature of competition.
My feelings on Banks are similar; competition, new and different services, etc is good for the markets.
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.03.03 15:26:00 -
[13]
Edited by: Hexxx on 03/03/2009 15:33:31
Originally by: Capt Nightmare Apparantly some moderator thought it would be funny to delete my post which outed my opinion about this "service" or whatever you would like to call it.
Tools like these will in my opinion destroy the eve market, every fool wont have to put any effort into trading if this "service" starts working as intended. When will the day come where I can click a button and it will instantly tell me what to buy where and where to sell it for the most highest of margins?
I am surprised to see so many support this instead of rejecting this idea. The only people I see appreciating this "service" are people who don't know how to trade themselves. Profit should be for the working people and I mean the traders who put effort into what they are doing, not for the people who go to some website who tells them what to do.
This service provides market data.
People get rich by turning data into information, and information into knowledge. Data itself is nice, but data alone does not a profit make.
I was initially going to say "Adapt or Die" but I think the commentary on data vs. information vs. knowledge is more constructive.
EBANK - Chairman of the Board | www.eve-bank.net
|

Hexxx
Minmatar
|
Posted - 2009.03.03 22:59:00 -
[14]
Originally by: Capt Nightmare
It is funny that you say this :) I never claimed anything like this. You should re-read what has been posted. Either way it matters not, it's not against the rules so what is there to do about it.
Good luck! :)
Ok, now is the part where I say "Adapt or Die". 
EBANK - Chairman of the Board | www.eve-bank.net
|
|
|