Pages: [1] :: one page |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Redshirt I
|
Posted - 2010.02.06 08:13:00 -
[1]
Is this possible?
I see the export function for buyers/sellers but not one for the price history.
Thanks Red
|
Cyaxares II
|
Posted - 2010.02.06 08:51:00 -
[2]
price history can only be read from cache files
|
Redshirt I
|
Posted - 2010.02.06 11:17:00 -
[3]
hmmm looks like I need to train some language skills cause I dont understand your gobbly**** :)
I will search the great oracle....google.
Thanks Red
|
Cyaxares II
|
Posted - 2010.02.06 11:36:00 -
[4]
Originally by: Redshirt I hmmm looks like I need to train some language skills
yeah... but not in the way you think
Python to lvl I and C++ to lvl III should be enough
nice explanation:
There is no easy way to export this data from the EVE client itself.
However, the client stores (caches) this data in some obscure format whenever you click the history tab. This helps to reduce server stress (if you switch back and forth between orders and history the client does not have to ask the server for the same data over and over but can use its own local cache). After some time the cache gets invalidated to make sure the data you look at is reasonably up-to-date.
These cache files reside in <your home directory>\AppData\Local\CCP\EVE\<path_to_eve>\cache\MachoNet\87.237.38.200\<some_number>\CachedMethodCalls
The format of these data files has been largely reverse-engineered and there is a library (libevecache) that allows other programs to read the data in an easy fashion (using libevecache is ok'ed by CCP).
This works well for the latest (top) entry of the Market History, but it fails for all the older entries - either because the whole market history for one item is more data than the authors of libevecache did ever expect to see or because there are some not-yet-understood codes in the data causing libevecache to misinterpret it.
Either way, it is certain that the market history data can be read but that libevecache would need to be fixed in order to do this; if this fix would be easy or hard to do is difficult to determine without being more familiar with the code behind libevecache.
Once the necessary modifications to libevecache are in place, it's a matter of minutes to write an application that reads the market history data and exports it to Excel, CSV, ...
|
Femaref
Armageddon Day
|
Posted - 2010.02.06 17:08:00 -
[5]
Edited by: Femaref on 06/02/2010 17:08:41 use entitys python lib: http://github.com/ntt/reverence, it can read any bulkdata or cache file.
|
Ix Forres
Caldari Vanguard Frontiers Antaeus Combine
|
Posted - 2010.02.07 21:51:00 -
[6]
If you're a bit lazier, you can grab the dumps from EVE Metrics. They're generated daily with the latest info and contain everything the cache does, so long as we've had someone throw them at us.
http://eve-metrics.com/api/historic_csv -- Ix Forres EVE Application Developer EVE Metrics | accVIEW | I Tweet |
Khatred
ReallyPissedOff Guinea Pigs
|
Posted - 2010.02.07 23:11:00 -
[7]
Or you can grab them from Bemmo.net We update the price history daily
________________________________________________ Bemmo.net - Eve Market Browser and much more ________________________________________________ |
skurv
|
Posted - 2010.02.08 11:53:00 -
[8]
Edited by: skurv on 08/02/2010 11:53:58
Originally by: Redshirt I Is this possible?
I see the export function for buyers/sellers but not one for the price history.
Thanks Red
It seems that while this is entirely possible, nobody has created a downloadable tool to do it just yet (that i've been able to find). there's a few libraries / websites available that can do it, but that's it and the websites are dependant on people providing them with the data in order to be up to date... so they only really work well if you're looking at a highly populated system where it's likely that someone's updated them recently (ie works well for the forge, but not not most 0.0 regions).
Anyways, it seems like this would be a good tool to add into some of the various market programs that are posted around here (ie EMMA), but i wouldn't hold my breath while waiting for it to be added as a feature =). --skurv
|
Cyaxares II
|
Posted - 2010.02.11 22:59:00 -
[9]
Reverence ftw
|
Femaref
Armageddon Day
|
Posted - 2010.02.11 23:16:00 -
[10]
Edited by: Femaref on 11/02/2010 23:17:18 Edited by: Femaref on 11/02/2010 23:16:48
Originally by: Cyaxares II Reverence ftw
1. Install Python 2.6 (http://python.org/ftp/python/2.6.4/python-2.6.4.msi) 2. Install reverence (http://cloud.github.com/downloads/ntt/reverence/reverence-1.0.1.win32-py2.6.exe) 3. Download the script to the python root folder (in my case, that would be Q:\Python26) 4. Change the values specified (root to your eve folder, output path to your output folder (this has to be existant beforehand), be aware to use / instead of \ for directory delimiters) 5. start the command line (start -> execute -> "cmd" -> enter) 6. navigate to your python location (cd /D "path") 7. type "python pythonfile.py" into the command line (without "") 8. your output folder will now fill with files if you did everything right 9. import those files into excel or open office and use the data as you like
|
|
Takashi Kitano
|
Posted - 2010.03.07 22:55:00 -
[11]
Originally by: Cyaxares II Edited by: Cyaxares II on 11/02/2010 23:23:15
Reverence ftw
(3) Save this script as historydump.py somewhere on your computer (4) Launch IDLE (All Programs -> Python 2.6 -> IDLE (Python GUI)) (5) Open historydump.py, a second window opens
Everything is fine, except that the cvs file are missing the current day. They report all data started from yesterday but no data for today. Is that normal ?
thank you
|
Cyaxares II
Gallente Blue Republic
|
Posted - 2010.03.08 06:15:00 -
[12]
Originally by: Takashi Kitano
Everything is fine, except that the cvs file are missing the current day. They report all data started from yesterday but no data for today. Is that normal ?
thank you
Yes (but it could be easily fixed).
GetOldPriceHistory only gives old data, the data for the current day has to be requested by GetNewPriceHistory.
|
Takashi Kitano
|
Posted - 2010.03.08 22:36:00 -
[13]
Originally by: Cyaxares II
Originally by: Takashi Kitano
Everything is fine, except that the cvs file are missing the current day. They report all data started from yesterday but no data for today. Is that normal ?
thank you
Yes (but it could be easily fixed).
GetOldPriceHistory only gives old data, the data for the current day has to be requested by GetNewPriceHistory.
Thank you for your reply. Let me ask another question.
Is possible have a fix that do not overwrite the files when the routine is launched again ?
thank you
|
Cyaxares II
Gallente Blue Republic
|
Posted - 2010.03.09 06:37:00 -
[14]
Originally by: Takashi Kitano
Thank you for your reply. Let me ask another question.
Is possible have a fix that do not overwrite the files when the routine is launched again ?
remove this part from the python script:
Quote: print "Deleting old records... \n" for root, dirs, files in os.walk(OUTPATH, topdown=False): for name in files: os.remove(os.path.join(root, name))
|
|
|
|
Pages: [1] :: one page |
First page | Previous page | Next page | Last page |