| Pages: [1] 2 3 :: one page |
|
|
| Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Krans Hopeson
   |
Posted - 2005.07.14 08:13:00 -
[1]
Hi folks,
I completed writing my market history web interface last weekend, but unfortunately I haven't been able to organize the necessary hosting to put it online.
I'm therefore going to make it available to interested parties to use, under the GNU Public License. Convo or evemail me if you're interested.
Features:
- Supports multiple markets and commodities.
- Browse by market or commodity.
- View data averaged over any period of time.
- Uses standard EVE price history table data.
- Web interface (protected by username/password) for adding data to the tables.
- Functions for downloading data for off-line use.
Requirements:
- PHP
- PEAR (MDB & Image::Graph packages required)
- MySQL database
- Lots of CPU time (graphing is CPU intensive)
Known bugs:
- Doesn't work correctly with IGB (problem with IGB, not with my code
 )
- Adding markets or commodities is sometimes broken if you don't select the date to add data before entering the name of the new market/commodity
To do:
- Support categories of commodities
- Caching for images to reduce server load
- Tools for adding/removing users and finer permissions
Bugfixes will be free. Other support services will be subject to negotiation. Please contact me for more information.
KH
--
"The only stupid question is the one you don't ask." |
Feta Solamnia
|
Posted - 2005.07.14 09:40:00 -
[2]
hurray, for "free as in beer" 
Nice work man, now if only someone could make the game spit out data from the market...
 Originally by: Oveur
I have access to all market data. Believe me, we have not reached anything close to deflation yet.
|
Krans Hopeson
|
Posted - 2005.07.14 11:37:00 -
[3]
Originally by: Feta Solamnia
hurray, for "free as in beer"
Who said anything about it being free as in beer? 
KH
--
"The only stupid question is the one you don't ask." |
rig0r
|
Posted - 2005.07.14 11:47:00 -
[4]
Would be nice if you could post some screenshots :)
|
Cristobal
|
Posted - 2005.07.14 15:04:00 -
[5]
Fantastic news. This is something that will be very helpful to the trading industry.
How do you accumulate the data that will be used in the package, specifically availability and pricing levels through out the EVE galaxy?
-- C r i s t o b a l --
|
Krans Hopeson
|
Posted - 2005.07.15 08:03:00 -
[6]
At the moment, it just uses data from the Price History table. Problem is, I don't know what data would be most useful or how to collect it, so as and when someone makes useful suggestions and asks me to implement them, I'll change the codebase to support it.
Screenshot: http://peter-b.co.uk/eve/markets.GIF
As I said, at the moment it works well, but it's unlikely to be exactly what anyone needs -- it's more of a fully-functional technology demo. However, adaptation to your specific requirements will be at very reasonable rates, and as the code is under the GPL you can make the changes yourself if you don't want to pay me ISK. :D
I'll post a link to the source code on Sunday (when I've had time to package it up, document it etc).
KH
--
"The only stupid question is the one you don't ask." |
FireFoxx80
|
Posted - 2005.07.15 08:42:00 -
[7]
Krans.
How well will this port to IIS/PHP/SQL Server?
I am happy to host it on my home machine.
ex P-TMC
If you think you can do a better job, go find yourself a datacentre to host a box, get a copy of Visual Studio, and STFU.
|
Krans Hopeson
|
Posted - 2005.07.15 12:06:00 -
[8]
Originally by: FireFoxx80
Krans.
How well will this port to IIS/PHP/SQL Server?
I am happy to host it on my home machine.
Hmm. Dunno. I actually developed it on a Windows/Apache/PHP/MySQL stack -- which is more efficient than IIS/SQL server anyway, in my experience.
As I said, I'll post code on Sunday and you can try it out. 
I mentioned before that the graph drawing code is pretty heavy ATM. I've got an Athlon 64 3200+ with a gig of RAM and graphs were taking ~1 s to render. Needs fixing.
KH
--
"The only stupid question is the one you don't ask." |
Dr Slaughter
|
Posted - 2005.07.15 14:55:00 -
[9]
This looks fantastic. I do, however, have a suggestion...
Being that we can't dynamically receive market data from eve (oh if only we could get XML over RSS for each regions market data (/me dreams some more) why don't you use your code as part of an 'external market' system.
All (well it's a fair bit) it needs is a way for players to post what they want to sell (much like escrow in the game) and then have a settlement engine they can use when the in-game trade completes. Add a ebay style rating system to the exchanges users profiles and we would know who's good to deal with and who's likely to bailout of sales/purchases.
If it worked as a trusted site within the IGB like Naga's loot shop that would be pretty cool too. Caching the graphics is a great plan to reduce load on eve's servers.
This would enable corporations or indeed individual players, to easily set-up their own markets for trading and provide a way to track prices.
I'm blathering on now so I will stop. :)
|
Dr Sirocco
|
Posted - 2005.07.15 18:03:00 -
[10]
Does the program extract this data automatically somehow or do we have to transcribe the data from the ingame screens to the web system by hand?
|
|
|
Krans Hopeson
|
Posted - 2005.07.17 16:39:00 -
[11]
Originally by: Dr Sirocco
Does the program extract this data automatically somehow or do we have to transcribe the data from the ingame screens to the web system by hand?
Hand transcribing ATM, I fear. 
KH
--
"The only stupid question is the one you don't ask." |
Krans Hopeson
|
Posted - 2005.07.17 16:44:00 -
[12]
Update: Source code now available.
KH
--
"The only stupid question is the one you don't ask." |
Dr Slaughter
|
Posted - 2005.08.02 18:05:00 -
[13]
If someone could write their own chart dll and register it in place of the one in the BIN directory you could semi-automate the data collection. The chart dll is third-party so CCP might not beat you up with any large sticks they have around with EULA written on them... best check first though. 8P
|
Krans Hopeson
|
Posted - 2005.08.04 11:48:00 -
[14]
Hmm. I'll have to look into it.
Shame I don't know anything about Windows programmin,g really. 
KH
--
"The only stupid question is the one you don't ask." |
Street
|
Posted - 2005.08.25 01:57:00 -
[15]
I once tried to retrieve market data from EVE by taking a screenshot and running an OCR on it. Alas, I could not make the off-the-rack OCR packages work on the screenshot, but one of you programming genuises might be able to turn it into a good data source. Just run it in the background and OCR any screenshots on the clipboard, looking for market data.....
Street
|
FireFoxx80
|
Posted - 2005.08.30 11:45:00 -
[16]
There are ways of getting data out of Eve, but they involve programming.
Possibly one of the 23 # ex: P-TMC | USAC |
Sun Ra
|
Posted - 2005.09.21 15:28:00 -
[17]
Edited by: Sun Ra on 21/09/2005 15:28:36
nm 
We're coming for you |
Taketa De
|
Posted - 2005.09.22 23:44:00 -
[18]
Originally by: FireFoxx80
There are ways of getting data out of Eve, but they involve programming.
Care to go into a little more detail?
Are you talking about reading the clients memory (which would only be valid for data already loaded into the client) or is there some other method?
|
FireFoxx80
|
Posted - 2005.09.23 07:16:00 -
[19]
Originally by: Taketa De
Originally by: FireFoxx80
There are ways of getting data out of Eve, but they involve programming.
Care to go into a little more detail?
Are you talking about reading the clients memory (which would only be valid for data already loaded into the client) or is there some other method?
You're pretty much onto it. The logserver used for debugging Eve produces logs which can be parsed. I'm not clever enough to do it myself but I believe people over at Eve-I did it to get data out between each version.
23? # Missile Tool # ex: P-TMC : USAC |
Taketa De
|
Posted - 2005.09.23 17:29:00 -
[20]
Originally by: FireFoxx80
You're pretty much onto it. The logserver used for debugging Eve produces logs which can be parsed. I'm not clever enough to do it myself but I believe people over at Eve-I did it to get data out between each version.
Ohhh, parsing logs? That's a lot simpler then reading directly from a clients active memory.
Parsing a linear, static list of data (if it is that) or one based on keywords is rather simple. If I have some spare time I wouldn't rather be playing I might look into it.
|
|
|
Artepoer
|
Posted - 2005.09.26 15:25:00 -
[21]
Where are the logs which contain the Market data?
|
Taketa De
|
Posted - 2005.09.26 16:36:00 -
[22]
I'm assuming the logs meant are those generated by the logserver.exe.
Haven't played with that myself, but it's the only thing that comes to mind.
|
Artepoer
|
Posted - 2005.09.26 19:16:00 -
[23]
Ive looked a bit at the output of logserver, chat seems to be logged as plain text but market data doesnt appear there. Most data seem to be stored in the cache folder as serialized classes so no easy way to read those values.
Only way is to do reverse engineering and im not sure if ccp will be gladly about it.
|
Taketa De
|
Posted - 2005.09.26 19:24:00 -
[24]
Reverse engineering is a bit iffy. Haven't checked the EULA for it, but most have a clause against that.
I haven't done it myself, but I know one can read a programs memory space. If one could locate the market data there (no idea how it's formatted) then maybe that would give the possibility of an output.
Isn't technically reverse engineering, so it should be less of a problem.
|
Artepoer
|
Posted - 2005.09.27 06:37:00 -
[25]
The format of data which is stored in memory is like a serialized class too. So its easier to take the cache files and find out the values ;)
But its still a thin ice.
|
FireFoxx80
|
Posted - 2005.09.27 08:27:00 -
[26]
There used to be a program called BlackIce(?) which could search memory for particular values and then halt a program when it was found. Though I am not sure how well that would behave with Eve.
Which leaves either digging around the cache files, or parsing the logserver.exe output. I think both rely on some understanding of MachoNET.
23? # Missile Tool # ex: P-TMC : USAC |
Artepoer
|
Posted - 2005.09.27 08:38:00 -
[27]
Originally by: FireFoxx80
.. or parsing the logserver.exe output.
it doesnt output the data, its only logs that data was recieved. There is nothing to parse this way.
|
FireFoxx80
|
Posted - 2005.09.27 09:19:00 -
[28]
My mistake then.
23? # Missile Tool # ex: P-TMC : USAC |
Taketa De
|
Posted - 2005.09.27 11:38:00 -
[29]
Originally by: FireFoxx80
There used to be a program called BlackIce(?) which could search memory for particular values and then halt a program when it was found.
Search for GameWiz32 or Artmoney or any other cheat program that does the exact same thing.
GameWiz32 even had a Trainer Kit where you could make your own in Delphi (good) or VB (bad) on their site (only for a short time).
This is all rather more work then I myself would be willing to invest into something like this.
Maybe put up a thread in the ideas forum requesting the market data to show up in the logs so we can parse it. For CCP the work would be minmal compared to what it would take somebody to do it from the outside.
|
Dr Slaughter
|
Posted - 2005.09.29 09:04:00 -
[30]
Edited by: Dr Slaughter on 29/09/2005 09:05:30
Originally by: Taketa De
Isn't technically reverse engineering, so it should be less of a problem.
Well if someone was clever enough to wrap that third-party charting dll I mentioned above (and I'm not clever enough sadly) or used dll injection it *really* should be possible to have it dump the data back out as the eve client definately has to pass it the data for it to plot the dam things.
Then all we would need to do is manually generate the year range graphs for each thing we're interested in and keep the data upto day by doing daily ones there after.
Dll injection from Google gives me: one tutorial/howto and A tool to actually do it
The charting dll is from: these guys and it's either the MFC C+ one or the Python version of the library.
Krans, Nice one for GPLing your tool too! I hope it periodically pop's up a reminder to send you ISK. :) :)
DRS
|
|
|
|
|
| |
|
| Pages: [1] 2 3 :: one page |
| First page | Previous page | Next page | Last page |