Originally by: Kallahar

---

Ah good find, search bug fixed. Thanks!

On the html-on-one-line, I code everything in PHP, so all outputted HTML is inside a print() statement, so there are no newlines. The back-end php code is very well organized, formatted, and commented :)

Kallahar

---

Originally by: Serene Python

---

Originally by: Kallahar

---

Ah good find, search bug fixed. Thanks!

On the html-on-one-line, I code everything in PHP, so all outputted HTML is inside a print() statement, so there are no newlines. The back-end php code is very well organized, formatted, and commented :)

Kallahar

---

Ahh yes PHP coding... I've often had people bug me about my HTML code looking very horrid. You working on having some form of movement being implemented?

---

Originally by: Kallahar

---

I use eve-metrics nearly every day to check prices in other regions. I couldn't stand to see it die, so I've created a similar site.

http://eve-marketdata.com

It's clearly an homage to eve-metrics. Right now it's got the uploader client (please upload!), a market browser, and it shows all the sellers for each item. I can add in the market trend analysis if needed, but I think most people use eve-metrics for finding out the "correct" price for an item.

It also provides a "live" feed (not AMQP, but HTTP post), and (soon) will have nightly data dumps. My goal is to let people transition easily from eve-metrics to eve-marketdata.

The buggiest part currently is the uploader, if anyone would like to write a better one, please do. The current code is under "developers".

- Kallahar

---

Originally by: Johnathan Roark

---

Originally by: Serene Python

---

Originally by: Kallahar

---

Ah good find, search bug fixed. Thanks!

On the html-on-one-line, I code everything in PHP, so all outputted HTML is inside a print() statement, so there are no newlines. The back-end php code is very well organized, formatted, and commented :)

Kallahar

---

Ahh yes PHP coding... I've often had people bug me about my HTML code looking very horrid. You working on having some form of movement being implemented?

---

I use dwoo, makes the php and html clean, plus it makes it easier to fix the display stuff

---

Originally by: Serene Python

---

Originally by: Johnathan Roark

---

Originally by: Serene Python

---

Originally by: Kallahar

---

Ah good find, search bug fixed. Thanks!

On the html-on-one-line, I code everything in PHP, so all outputted HTML is inside a print() statement, so there are no newlines. The back-end php code is very well organized, formatted, and commented :)

Kallahar

---

Ahh yes PHP coding... I've often had people bug me about my HTML code looking very horrid. You working on having some form of movement being implemented?

---

I use dwoo, makes the php and html clean, plus it makes it easier to fix the display stuff

---

Never heard of dwoo... I just use notepad++, my PHP code itself it typically good looking just if I got HTML it's very horrid looking typically. I prefer just typing everything rather than letting some program handle everything... Biggest pet peeve in school when we learned HTML... Final project had probably almost 1MB in useless crap being loaded/added to the code.

---

Originally by: Kallahar

---

I haven't really played the markets, is having historical data needed? Is it different than going in-game and looking at the market "price history" or is it just wanting that data from a different region?
Kallahar

---

Originally by: Kallahar

---

I got api/item.xml and api/item.json working, but I'm not sure how to calculate the following:

- median
- kurtosis
- skew
- variance
- standard_deviation
- simulated


If anyone knows how to calculate these in mysql/php, please let me know and I'll add them in.

Kallahar

---

$query = mysql_query("SELECT * FROM eve_item_prices WHERE regionID = $_GET[regionID]")
$rows = mysql_num_rows($query)
$median = $rows/2

Originally by: Kallahar

---

I got api/item.xml and api/item.json working, but I'm not sure how to calculate the following:

- median
- kurtosis
- skew
- variance
- standard_deviation
- simulated

If anyone knows how to calculate these in mysql/php, please let me know and I'll add them in.

Kallahar

---

sort($values); 
$n = count($values);
$h = intval($n / 2);
if($n % 2 == 0)
$median = round(($values[$h] + $values[$h-1]) / 2); 
else
$median = $values[$h]; 

Originally by: Kallahar

---

I got api/item.xml and api/item.json working, but I'm not sure how to calculate the following:

- median
- kurtosis
- skew
- variance
- standard_deviation
- simulated

---

Originally by: Kallahar

---

Okay, got median and standard deviation added to the item api, I'll have to figure out how to add the pecl stats extensions to php to get kurtosis and the others working.

For the HTTP callback api, I added documentation for it, just click of "developers".

I'll be adding a simple "what's the "correct" price for an item soon, it will be the best-guess price you could buy/sell an item for in Jita, that should be the price everyone uses as "the price".

Kallahar

---

Originally by: Kallahar

---

I got api/item.xml and api/item.json working [...]

---

<?xml version='1.0' encoding='utf-8' ?>
<evemetrics api_version='2.0'>
<!--
EVE MarketData Item API
Documentation is available at the same URI with a .html extension.
-->
<type id='24702'>
<name></name>
<global>
<last_upload>2010-12-26 13:51:46</last_upload>
<buy>
<minimum>2800</minimum>
<maximum>24110122.01</maximum>
<median>20170003</median>
<average>14267671.157727</average>

<standard_deviation>6673819.0621229</standard_deviation>
</buy>
<sell>
<minimum>22000000</minimum>
<maximum>19000000000</maximum>
<median>26250000</median>
<average>45719842.5672625</average>
<standard_deviation>1229254309.9302</standard_deviation>
</sell>
</global>
</type>

</evemetrics>

Originally by: Hel O'Ween

---

Originally by: Kallahar

---

I got api/item.xml and api/item.json working [...]

---

Sort of, it seems. For me, the closing </xml> tag is missing.

---

Originally by: Kallahar

---

I got api/item.xml and api/item.json working, but I'm not sure how to calculate the following:

- median
- kurtosis
- skew
- variance
- standard_deviation
- simulated

If anyone knows how to calculate these in mysql/php, please let me know and I'll add them in.

Kallahar

---

Originally by: Shingyoku

---

Any chance you might make an API out of this like eve central has and eve metrics had?

---

Originally by: Shingyoku

---

Edit, oh and please add some sort of system to compete like eve central has when you can login and eve metrics has no matter what. I'd love to see what my accounts are churning out compared to everyone else :D

---

Originally by: Wyke Mossari

---

Originally by: Kallahar

---

I got api/item.xml and api/item.json working, but I'm not sure how to calculate the following:

- median
- kurtosis
- skew
- variance
- standard_deviation
- simulated

If anyone knows how to calculate these in mysql/php, please let me know and I'll add them in.

Kallahar

---

---

Originally by: HighlanderUK

---

Originally by: Shingyoku

---

Edit, oh and please add some sort of system to compete like eve central has when you can login and eve metrics has no matter what. I'd love to see what my accounts are churning out compared to everyone else :D

---

yep forgot about this, EM had this spot on, even if i didn't know what my credits were for :) - don't have it like EC now, and lock the leader-board.

---

def calculate_credits(statistics, res, now)
 last_upload = Time.parse(res['created_at'])
 factor = (statistics[:inserted_orders] + statistics[:updated_orders] + statistics[:expired_orders]+ statistics[:sold_out_orders])/statistics[:active_orders].to_f
 [(100*Math::E**(5.0*factor - 5) + (now-last_upload)/6048.0).ceil, 100].min
end

Originally by: Kallahar

---

What's the most important API calls people want completed first?

---

Originally by: Kallahar

---

What's the most important API calls people want completed first?

---

Originally by: Kallahar

---

Content-type's: fixed, now return as application/xml and application/json. Regarding formatting, the goal is to have it the exact same as eve-metrics for easy porting for people.

---

Originally by: Kallahar

---

... I think that 99% of the people using it are only getting the average price, so that they can update their killboard, etc.

---

Originally by: Droxlyn

---

I'm mostly looking for the 5% market volume buy effective buy price and the 5% market volume sell price, ideally for a specific system. (IE Jita or Amarr)

That way I can look up my costs for input materials and the profit for the easy sell. I sometimes average the two together to get the middle buy/sell price that should go fast but make me or cost me just a little.

Averages and Medians are not as interesting to me. (Nor are the extremes.)

Drox

---

Originally by: otto M8

---

First, a tip of the hat and a thanks for taking on this project.

---

Originally by: Dharken Rhaal

---

I was using buy/maximum and sell/mininum limited by region (The Forge obviously) from EM. Either I dumb or there is no such possibility with eve-marketdata. "best guess" probably is good for guessing price at killboards, but when you need to decide what to produce/buy/sell - you need more. (tritanium - 3.95?.. definitely need something more precise)
Probably I could take it from historic feeds, but that's a lot of data instead of two simple values.
Can we have simple maxBuy and minSell taken from most recent upload with region as parameter, please? :)

---

Originally by: Kallahar

---

**** HISTORY ADDED ****
Much requested, I finally got history added. Here's the quirk, people running the uploader have to have it on the price history tab in order for it to upload, so I've got all of The Forge done, but other regions will take a while to get data.

see http://eve-marketdata.com/developers/item_history.php for info, note that it's *not* eve-marketdata compatible because I forgot to save their formatting before they closed... heh.

Kallahar

---

Originally by: Kallahar

---

...snip...

I've also decided to discontinue the item.xml/json api. I think that 99% of the people using it are only getting the average price, so that they can update their killboard, etc. However it provides far more info, which is CPU intensive. Therefore, I'm going to kill off that program, and people will have to update their code to use one of these new API's:
- http://eve-marketdata.com/developers/item.php for one item lookup
- http://eve-marketdata.com/developers/items.php for multiple

I do plan on adding statistical data back, but it will be with a new URL. This way, people who only need the price won't be wasting CPU or bandwidth getting a bunch of extra data they don't need.

Kallahar

---

Originally by: Kallahar

---

I've also decided to discontinue the item.xml/json api. I think that 99% of the people using it are only getting the average price, so that they can update their killboard, etc. However it provides far more info, which is CPU intensive. Therefore, I'm going to kill off that program, and people will have to update their code to use one of these new API's:
- http://eve-marketdata.com/developers/item.php for one item lookup
- http://eve-marketdata.com/developers/items.php for multiple

---

Originally by: Hel O'Ween

---

1) Two different URLs for the same purpose? This way you have to keep two scripts up tp date. Besides, you're already doing the parameter parsing with the second one (multiple items). The single item (single value) is just a special case of multiple items.

---

select 
 min(b.price) as buy_min, max(b.price) as buy_max, avg(b.price) as buy_avg,
 min(s.price) as sell_min, max(s.price) as sell_max, avg(s.price) as sell_avg
from eve_inv_types t
 left join items_buying b 
 on b.type_id = t.type_id and b.region_id = ? and b.date_expires > current_timestamp
 left join items_selling s 
 on s.type_id = t.type_id and s.region_id = ? and s.date_expires > current_timestamp
where 
 t.type_id = ?

Originally by: Azazel Mordred

---

This would be helpful if the DB can manage it... Perhaps it would be useful to archive expired orders in the buying/selling tables after a week or two, to keep things a bit faster.

select 
 t.type_id,
 min(b.price) as buy_min, max(b.price) as buy_max, avg(b.price) as buy_avg,
 min(s.price) as sell_min, max(s.price) as sell_max, avg(s.price) as sell_avg
from eve_inv_types t
 left join items_buying b 
 on b.type_id = t.type_id and b.region_id = ? and b.date_expires > current_timestamp
 left join items_selling s 
 on s.type_id = t.type_id and s.region_id = ? and s.date_expires > current_timestamp
where 
 t.type_id in (?)

---

Originally by: randomToon987

---

On a somewhat related note - I'm sure that designing your own api gives you more freedom, and that's ok, but you should analyse eve-metrics api, and try to learn something from the way it was designed. For example - you're not using api version number, which may result in a lot of applications relaying on your site breaking without warning when you decide to change something, using api version number is an easy way to make sure that the data you provide and the application that processes it will work together just fine, and if the version numbers differ it's easy to shut down gracefully.

---

Originally by: Kallahar

---

4) XML/JSON formats: if you find any specific errors, let me know. Personally I don't use them. Keep in mind that I can no longer access the eve-metrics API, so I'm not sure exactly how they did it.

---

\ntype_id\tbuy\tmin\tmax\tmedian\taverage\tstd_dev\[...] 
34
buy0.013.42.41.8621828514751542462764.62665
sell0.013.421.862182851475150.45284745607815

Originally by: Colgir

---

Edited by: Colgir on 15/01/2011 10:27:31
Is it normal that the upload requires about 30 seconds, to upload ONE product?!
At the moment it is impossible for me to use the automatic uploader because the queue of the uploader is quite fast 'overflowing' and the tool reports an error and stops working.

Edit: A few error-messages i get:
OnNewFile: ...\8833.cache
skipping unknown key ('config', 'GetMap', 30003438)
No data parsed
OnNewFile: ...\e58a.cache
skipping unknown key ('marketProxy', 'GetCharOrders', 14...09)
No data parsed
FileChanged: 3 91aa.cache


After that it is queueing but doesn't upload anything.

---

<p>
 <font color="#ff3333">
 <b>Error:</b> SQLGetSet
 <br>1054:Unknown column '5pct_sell_price' in 'field list'
 <br><i>select 5pct_sell_price as val from eve_inv_types where type_id = '34'</i>
 </font>
</p>

Originally by: blankienewbie

---

I'm getting the same error

---

Originally by: Fovo

---

Live EVE Pricing Example
Fovo

---

Quote:

---

<p><font color="#ff3333"><b>Error:</b> SQLGetSet<br>1054:Unknown column 'id' in 'where clause'<br><i>select region_id, type_id, updated from region_type_updates where id > '12517304' limit 10000</i></font></p>

---

Originally by: "Error"

---

<p><font color="#ff3333"><b>Error:</b> SQLGetSet<br>1054:Unknown column 'created' in 'where clause'<br><i>select region_id, type_id, updated from region_type_updates where created > '2011-02-01 01:15:12' limit 10000</i></font></p>

---

Originally by: EveMarketData

---

69: on the price page click on "buy orders"

The API now works with google docs spreadsheets!

Kallahar

---

Quote:

---

Authentication for your Full API Key failed. To use the market features you will need to re-enter your full API key.

---

Originally by: EveMarketData

---

Okay, by popular demand you can now get prices just for Jita.

instead of using, say, /api/item_price.xml?type_id=43, use /api/item_price_jita.xml?type_id=43.

Also works for item_prices_jita.

The price is updated once per day at downtime.

Kallahar

---

Originally by: EveMarketData

---

Okay, by popular demand you can now get prices just for Jita.

instead of using, say, /api/item_price.xml?type_id=43, use /api/item_price_jita.xml?type_id=43.

Also works for item_prices_jita.

The price is updated once per day at downtime.

Kallahar

---

Originally by: neoe77

---

what is "Market Scanner"? why it can automatically scan the market? and why the page tell to trust it?

---

Originally by: Raiku Onni

---

What I would love is the ability to ask for the mean cost of the cheapest 4.4 million units of trit (this will involve aggregating many sell orders together until you reach the threshold value)

---

Originally by: Joost Caldari

---

First of all, great effort!

But I've started the use the "Sell my Hangar" functionality, but the suggested price seems double the market price. Anybody else have that problem. SOmehow the suggested price doesn't seem right.

---

Originally by: Louis Vitton

---

Issue with google documents and making the xml link funcation correctly.
Currently i get an error stating it can not return data Error message "error: The xPath query did not return any data" i was hoping some of you might be able to take a look at my spreed sheet to check it for me it is only a test sheet and i plan to build a better one once i get the test to work.

Test Spreed Sheet

Cheers Louis Vitton.

Thank you also in advance for you help - i am new to all of this and would like to learn also so any advice would be great.

---

Originally by: Liquidus Lamnia

---

or let the user create profiles of market region groups (customizing)?

Thanks!

---

Quote:

---

FileChanged: 3 bef8.cache
(0) Queueing file (5, u'C:\\Users\\<username>\\AppData\\Local\\CCP\\EVE\\c_games_eve_tranquility\\cache\\MachoNet\\87.237.38.200\\259\\CachedMethodCalls\\bef8.cache')
OnNewFile: C:\Users\<username>\AppData\Local\CCP\EVE\c_games_eve_tranquility\cache\MachoNet\87.237.38.200\259\CachedMethodCalls\bef8.cache
Call GetOrders, regionID 10000002, typeID 9832
data_type = GetOrders; upload_type = orders;
uploading to http://eve-marketdata.com/api/upload.php
response=1
Uploaded orders for Coolant in The Forge
Removing cache file C:\Users\<username>\AppData\Local\CCP\EVE\c_games_eve_tranquility\cache\MachoNet\87.237.38.200\259\CachedMethodCalls\bef8.cache
Processor Exception
Error uploading file, skipping

---

Originally by: Shrouded Figure

---

The uploader doesn't really work for me anymore - it says "Processor Exception - Error uploading file, skipping" on the majority of market items, and based on the unusually low update numbers on the upload stats page, I assume this is the same for everyone. Does anyone have a fix/workaround/ETA on this?

---

Originally by: VIXIT CORP

---

Hi,

I would like to use the uploader but it can't find my eve folders
I use the following command to strart eve, so no logging and caching
is done in the c:\documents and settings\user\etc... folder

M:\games\EVE_CLIENT1\bin\ExeFile.exe /end /LUA:OFF

With the client of eve-metrics I could tell the client where to look
How can I manage to do the same with this client?

Hope this can be solved soon (tm) so I can contribute here also.

Kind regards
VIXIT CORP

---

FileChanged: 3 29e1.cache
(0) Queueing file (5, u'C:\\Users\\Myname\\AppData\\Local\\CCP\\EVE\\e_spiele_eve_tranquility\\cache\\MachoNet\\87.237.38.200\\259\\CachedMethodCalls\\29e1.cache')
OnNewFile: C:\Users\Myname\AppData\Local\CCP\EVE\e_spiele_eve_tranquility\cache\MachoNet\87.237.38.200\259\CachedMethodCalls\29e1.cache
skipping unknown key ('config', 'GetMapObjects', 30004127, 0, 0, 0, 1, 0)
No data parsed

Originally by: Insufferable

---

I am running eve in a virtual box and cannot get the data uploader to work. I get an error saying that the uploader is not configured correctly, try to reinstall. Doing so results in teh same error message. There is no error during installation.

Is it not possible to run the scanner/uploader within a virtual box?

---

Originally by: Joost Caldari

---

First of all, great effort!

But I've started the use the "Sell my Hangar" functionality, but the suggested price seems double the market price. Anybody else have that problem. SOmehow the suggested price doesn't seem right.

---

Originally by: Joost Caldari

---

Lately, this feature hasn't been working for me anymore either. Is anybody working on resolving this? Because it's a crucial tool for my trading alt. I loved it when it worked. But now it fails with an 500 error all the time. Previously it worked maybe once every 10 attempts.

Originally by: Joost Caldari

---

First of all, great effort!

But I've started the use the "Sell my Hangar" functionality, but the suggested price seems double the market price. Anybody else have that problem. SOmehow the suggested price doesn't seem right.

---

---

Originally by: Joost Caldari

---

As a matter a fact, any request from the database is not working. I cannot use the in-game "sell hangar", but even out-game simple requests of an item doesn't respond with a price. Uploading is still working though!

---

Originally by: Kallahar

---

3) uploader skipping files: not all cache files are market cache items, so even if the queue is 50 files, sometimes only a few of those are market, so skipping them is normal.

---

Originally by: Idle Bow

---

it could be very useful to see more information about update status of current region. Currently we see i.e. "83% of Domain has been updated in the last 48 hours". It could be really good to see similar percentage for 24hrs, maybe 12hrs... I usually sit in region while get 100% there, but 48hrs old data isn't as good as 24, 12 or even more fresh.

---

Originally by: anotherpricecheckpls

---

You've got last hour, 24hrs, 7 days and 30 days here: http://eve-marketdata.com/reports.php?step=UploadPriceStats

---

Originally by: Idle Bow

---

Yeah I know that. But it is usability issue. To access those numbers we need to switch to that report and in some cases it can be problematic. It could be much more useful if those numbers were in place where they are needed.

---

Originally by: UnidentifiedTango

---

Oh - you mean on the IGB while uploading? Trouble is that needs to be kept fairly low overhead as the amount of page updates when you're running a browse upload of 3k items or so would put too much stress on the server, for little gain for the average Joe (who's normally uploading afk anyway).

---

SELECT b . *
FROM items_buying AS b, (
 SELECT a.order_id
 FROM (
 SELECT count( order_id ) AS o, order_id
 FROM items_buying
 GROUP BY order_id
 ) AS a
 WHERE a.o >1
) AS a
WHERE b.order_id = a.order_id
ORDER BY b.order_id;

SELECT b . *
FROM items_selling AS b, (
 SELECT a.order_id
 FROM (
 SELECT count( order_id ) AS o, order_id
 FROM items_selling
 GROUP BY order_id
 ) AS a
 WHERE a.o >1
) AS a
WHERE b.order_id = a.order_id
ORDER BY b.order_id;

Originally by: Kallahar

---

I *finally* got the new version of the uploader finished. It's a complete rewrite and fixes the biggest bug! You can now run multiple clients, and have eve installed anywhere you want! The configuration is also now in a .ini file to make things easy.

---

Originally by: Xenco

---

After updating from 1.2 to 2.1 I am getting the below error unless I run the uploader as administrator on windows 7.

The logfile 'path\uploader.exe.log' could not be opened:
[Errno 13] Permission denied: 'path\uploader.exe.log'

---

Originally by: Kallahar

---

On the "permission denied" problems, turns out py2exe has a bug that tries to write the stderr log to the install directory, which windows 7 denies (I hate microsoft in so many ways).

---

Originally by: Ralf Smith

---

Im curious as to how this in game browser market scanner works. what functions does it make use of? Can you explain how it is done?

---

Originally by: Crimson Firebird

---

Basically, the thing doesn't work, and what do I mean by doesn't work? I mean, it installs without error, and when it runs, on my task-bar, I just get this icon:

There is no window to input my token key, or anything of the sort. I've reinstalled python, but that hasn't changed anything. I attempt to run as administrator, again, nothing different.

---

• uninstall the uploader


• delete the config file C:\Users\Username\AppData\Roaming\config.ini


• reinstall the uploader

Originally by: Ibesa

---

Originally by: Crimson Firebird

---

Basically, the thing doesn't work, and what do I mean by doesn't work? I mean, it installs without error, and when it runs, on my task-bar, I just get this icon:

There is no window to input my token key, or anything of the sort. I've reinstalled python, but that hasn't changed anything. I attempt to run as administrator, again, nothing different.

---

I had the same problem, the following fixed it:

• uninstall the uploader


• delete the config file C:\Users\Username\AppData\Roaming\config.ini


• reinstall the uploader

maybe deleting the config file and restarting the uploader also works without completely reinstalling it.

---

Originally by: Kallahar

---

New version of the uploader released! This fixes a few problems, if you closed the program when it was minimized (could only happened during shut down) then it would reload at -32000,-32000, now it checks that the number is good before saving it to the config file. I also moved the config file to its own evemarketdata folder so it's less likely to be overwritten. Unfortunately you'll have to re-enter your upload id, sorry!

For corporate orders, I'll start experimenting with that! RAGE lost its war with the DRF/PL/etc so I've got some free time now :)

There's also a new chart under Reports for how many uploads/day there are. And if you look at the Station report, you can now get a list of every item for sale in that station, which is handy when researching which station to start selling in.

Kallahar

---

Originally by: Max Kolonko

---

eve-marketdata is down??

---