Pages: 1 2 3 4 5 :: [one page] |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.18 17:41:00 -
[1] - Quote
I thought is was about time to create an 'official' EvE Addicts topic, so I can respond to questions etc.
New features: Item lists - You can create a list of items that you can then use to run the item scanner on. You can also get price info of all the items in the list through the API, Just specify your upload key and list number (see the API page for details).
Snarf Aldes
-- If you enjoy sites such as evemarketeer, eve-central, eve.addicts, etc. please consider uploading price date to those sites. They are only useful as long as there is enough fresh data...
Creator of [url]http://eve.addicts.nl/[/url] |

Desmont McCallock
141
|
Posted - 2012.03.18 19:45:00 -
[2] - Quote
I like the UI.
Expect EVEMon to feed you on its next release. Get prepared for some heavy data managing. |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.19 06:59:00 -
[3] - Quote
Cool.
When you say 'feed you on its next release', i assume you mean pull price data from the API, or is there some hidden upload feature in EVEMon that i don't know about? Creator of EvE Addicts |

Desmont McCallock
142
|
Posted - 2012.03.19 07:00:00 -
[4] - Quote
Patients my friend and you'll see. |

Desmont McCallock
142
|
Posted - 2012.03.19 15:26:00 -
[5] - Quote
Just another note: Upon resizing the browser the right hand side panel gets dislocated. It's probable a table design issue. |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.20 06:47:00 -
[6] - Quote
Desmont McCallock wrote:Just another note: Upon resizing the browser the right hand side panel gets dislocated. It's probable a table design issue. I know, it's a side effect of the way i position the div blocks. I assume a minimal browser width of 1280 pixels, on smaller screen it messes up the positioning. I'll have a look at it. Creator of EvE Addicts |

Scrapyard Bob
EVE University Ivy League
763
|
Posted - 2012.03.20 13:26:00 -
[7] - Quote
Snarf Aldes wrote:Desmont McCallock wrote:Just another note: Upon resizing the browser the right hand side panel gets dislocated. It's probable a table design issue. I know, it's a side effect of the way i position the div blocks. I assume a minimal browser width of 1280 pixels, on smaller screen it messes up the positioning. I'll have a look at it.
1280 is too big of an assumption. The safer number is still around 1000px wide (so it works on 1024x768 screens or on people who keep their browser non-maximized).
|

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.20 21:48:00 -
[8] - Quote
Is there some trick to minimize the market window while the scanning is running? Also is there anything i can do to make it as fast as possible? Some general "noob" proof tutorial would be nice, for the setup, upload and actual scanning tasks. |

Axari
2
|
Posted - 2012.03.21 01:53:00 -
[9] - Quote
Do you offer a table (csv, mysql, xml, etc) download, of items in Jita 4-4, with an average/median sell price per item? I know you have an API, but for 4-5k items, I imagine a download would be less overhead for both of us?
If you don't, but would consider making something like that available, then you might also consider including the average/median buy price as well.
I really like the site design btw, and the 'new' feel. |

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.21 10:15:00 -
[10] - Quote
Btw is there a way to see how old the shown data is? |
|

Scrapyard Bob
EVE University Ivy League
764
|
Posted - 2012.03.21 15:26:00 -
[11] - Quote
Andy DelGardo wrote:Is there some trick to minimize the market window while the scanning is running? Also is there anything i can do to make it as fast as possible? Some general "noob" proof tutorial would be nice, for the setup, upload and actual scanning tasks.
a) No you cannot minimize the market window as EVE will just re-open it each time the IGB makes the Javascript call to look up an item.
b) You cannot make it "as fast as possible" any faster then about 1 lookup every 3.0-3.5 seconds. If you attempt to call the EVE Javascript functions too fast, the client will just block your request and stop looking up items at all. (3.5 seconds seems to be the "safe" number, the closer you try to get to 3.0 seconds the more likely that you'll get bit.)
|

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.21 15:44:00 -
[12] - Quote
Thx Master of uploads Bob :p
Btw are u running on a server, with multiple accounts for scanning? How do i "correctly" setup 2 accounts on the same machine, i noticed i get 2 different keys? Atm i just added 2x uploads in the 0.6 tool api, but i guess i may send redundant data?
Some more questions pls:
Do u also handle daily shutdown manually or u have a tool to relogin and start the scan process again? Is there some "organized" group, on who scans which parts of new eden or is everyone just sitting in jita? How is your setup running atm? Multiple trail accounts or simply a scanner char on one account 24/7? |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.21 16:04:00 -
[13] - Quote
Axari wrote:Do you offer a table (csv, mysql, xml, etc) download, of items in Jita 4-4, with an average/median sell price per item? I know you have an API, but for 4-5k items, I imagine a download would be less overhead for both of us?
If you don't, but would consider making something like that available, then you might also consider including the average/median buy price as well.
I really like the site design btw, and the 'new' feel. Not at the moment.
I am currently focusing on making the server as stable as possible. Any extra processing (like calculating median price) etc. will have to wait until i'm satisfied with the overall performance.
I will have a look what i can do about the Jita 4-4 items.
Snarf Creator of EvE Addicts |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.21 16:07:00 -
[14] - Quote
Andy DelGardo wrote:Btw is there a way to see how old the shown data is? On the main page the 'Issued at' column gives the time since the item was modified.
On the API page that data is missing because i want to keep everything as light weight as possible. Extra info means extra processing and extra bytes to transfer. Creator of EvE Addicts |

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.21 16:19:00 -
[15] - Quote
Snarf Aldes wrote:Andy DelGardo wrote:Btw is there a way to see how old the shown data is? On the main page the 'Issued at' column gives the time since the item was modified. On the API page that data is missing because i want to keep everything as light weight as possible. Extra info means extra processing and extra bytes to transfer.
I meant more like how old is this data, i mean isn't "issued at" just the point where the offer was created/modified? Something like "how old is the data i'm looking at". Evemarketeer has this little red/green light which notes how old the data is.
Like a field, icon which states how old the upload data is. |

Scrapyard Bob
EVE University Ivy League
764
|
Posted - 2012.03.21 16:48:00 -
[16] - Quote
Andy DelGardo wrote: Btw are u running on a server, with multiple accounts for scanning? How do i "correctly" setup 2 accounts on the same machine, i noticed i get 2 different keys? Atm i just added 2x uploads in the 0.6 tool api, but i guess i may send redundant data?
Quad Core system with 16GB of RAM (I need to upgrade to a 6-core or 8-core unit next year).
As for running multiple accounts.
1) Install EVE 2) Fire up EVE shortcut, login on 1st account 3) Fire up EVE shortcut, login on 2nd account
You only need 1 upload key.
If you want the two different EVE instances to have different graphical settings, then you need to setup "junction" points and run the first EVE from directory A and the second EVE from directory B.
http://wiki.eveonline.com/en/wiki/Multiple_clients#Method_1_-_Junctions |

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.21 16:51:00 -
[17] - Quote
oki, with this rig u could run like 14 clients :)
my 4GB media PC seems to handle 2 clients pretty well for scanning, so that was my idea. Since i don't think i can run eve on my windows VPN server since no d3d gpu. ( i demand a headless eve server)
For the 2 keys, i tried to use the same key for the 2 clients and noticed that only one client got updated on the Api statistic info site, so i assumed this wont work? |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.21 16:53:00 -
[18] - Quote
Andy DelGardo wrote:
I meant more like how old is this data, i mean isn't "issued at" just the point where the offer was created/modified? Something like "how old is the data i'm looking at". Evemarketeer has this little red/green light which notes how old the data is.
Like a field, icon which states how old the upload data is.
I guess i can put 'last update xx minutes ago' somewhere. Creator of [url]http://eve.addicts.nl/[/url] |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.21 16:57:00 -
[19] - Quote
Andy DelGardo wrote:oki, with this rig u could run like 14 clients :)
my 4GB media PC seems to handle 2 clients pretty well for scanning, so that was my idea. Since i don't think i can run eve on my windows VPN server since no d3d gpu. ( i demand a headless eve server)
For the 2 keys, i tried to use the same key for the 2 clients and noticed that only one client got updated on the Api statistic info site, so i assumed this wont work?
The upload count from both clients will be added to the char name of the key you are using. Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.22 23:23:00 -
[20] - Quote
I would also like the feature to display more regions at once. |
|

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.23 18:55:00 -
[21] - Quote
Andy DelGardo wrote:I would also like the feature to display more regions at once. I'll have a look at that.
You can select 'any region' and get all available prices. Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.23 19:13:00 -
[22] - Quote
Snarf Aldes wrote:Andy DelGardo wrote:I would also like the feature to display more regions at once. I'll have a look at that. You can select 'any region' and get all available prices.
Ah nice thx, also noticed the update timer. |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.23 21:35:00 -
[23] - Quote
Andy DelGardo wrote:Ah nice thx, also noticed the update timer
Now there is a small problem using both of those functions, since the timer is only valid per region. So if i check for a item to buy in all regions, i have no indicator how old the shown data is. I would like some separate table field per shown region or some color coded price, since basically all the "good" offers are likely 30+ days old.
What also could help is a settable filter to only show data if it is 5min, 30min, hour, day old .... so we can filter ourself? For now i have added a column called 'Updated' when 'any region' is selected. I like the idea of a filter, will try to put that in. Could take a while though, I don't have a lot of time the comming weeks... Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.23 21:48:00 -
[24] - Quote
Ah this would be great, i also think a filter will work best.
Now the only thing i basically always miss on any eve market site is the ability to filter out all those "bad/garbage" sell/buy offers. I mean all entries that are way to high or to low. I wish i could set a ignore filter on those sites like if any entry strives 200% away from the median or avg price. |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.24 16:07:00 -
[25] - Quote
I'm working on some underlying database tables atm, so weird stuff might (read as will) happen.
Things will probably break, but i hope to have everything back to normal asap. Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.26 19:33:00 -
[26] - Quote
I would like to suggest a other great feature :p
I like the clean and fast way the personal scan lists work, so here are my 2 improvement suggestions:
1) Make the list nameable, so if we have multiple lists we know which has what items in it. 2) Allow to use the categories names from the browser tree to create scan lists, as examples: Drones, Materials, Frigates.
I know the second feature is more complex since u need to pull the ids from your api, but my guess is they are used in the market tree view anyway.
thx and keep up the good work |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.03.27 06:48:00 -
[27] - Quote
Andy DelGardo wrote:I would like to suggest a other great feature :p
I like the clean and fast way the personal scan lists work, so here are my 2 improvement suggestions:
1) Make the list nameable, so if we have multiple lists we know which has what items in it. 2) Allow to use the categories names from the browser tree to create scan lists, as examples: Drones, Materials, Frigates. 3) Maybe add some production grouped default scanning lists like Marketeer (T2+mats, T3, T1) 4) The ability to run a given list only once or only once in a given time period, aka once per hour/day..? Maybe even scan enable multiple list and cycle through them in a set way. So that we can have high frequency list scans and low frequency list scans, but be able to hit one button and keep all lists updated.
I know the second feature is more complex since u need to pull the ids from your api, but my guess is they are used in the market tree view anyway.
thx and keep up the good work I ran into the list naming thing myself as well :) I will look at the other stuff as well, can't promise when though... Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
0
|
Posted - 2012.03.28 19:29:00 -
[28] - Quote
Hi again and again more ideas!
1) Pls can u add more "logical" regions for the region filter? I would like a "Empire" and "TradeHubs" region filter option, similar to the "any region"? Similar to what u can select in the IskPerHour tool.
2) The ability to use the region filter, with the production calculation tab? This comes in handy to filter out all those null, low sec regions. The price button is then just for sell/buy/median price switch. Often jita has much higher prices and it is tedious to update all prices manually, so i normally would prefer a "tradehubs" or "empire" calculation over a jita one.
3) The option to select a minimum "sell" amount to consider production prices. Since i don't care about this one special component priced 200% under the "median" price, but i do care about the sell offer with 200 normal priced items for my production calculation. Atm i always have to double/triple check every single component, adding this option would grantee a valid and more realistic production calculation.
thx Andy |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.04.09 12:59:00 -
[29] - Quote
Added empire and trade hubs to the region selector.
I updated some stuff in the market scanner as well, see top post for info. Creator of Eve Addicts |

Desmont McCallock
158
|
Posted - 2012.04.09 13:05:00 -
[30] - Quote
Nice work. Prioritize on making a dark theme. People always complain (for EVEMon too) that so much white burns the eyes after spending hours in space. And they are right, you know. |
|

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.04.11 05:56:00 -
[31] - Quote
Desmont McCallock wrote:Nice work. Prioritize on making a dark theme. People always complain (for EVEMon too) that so much white burns the eyes after spending hours in space. And they are right, you know. I have been working on that, but it doesn't look right yet. Shouldn't take too long to finish though. Creator of Eve Addicts |

Alex Sosco
Best Path Inc. Ethereal Dawn
0
|
Posted - 2012.04.11 10:28:00 -
[32] - Quote
Nice UI, quick info search...ergo very usefull. Thank you for the work :) |

Snarf Aldes
University of Caille Gallente Federation
1
|
Posted - 2012.04.12 18:28:00 -
[33] - Quote
Desmont McCallock wrote:Nice work. Prioritize on making a dark theme. People always complain (for EVEMon too) that so much white burns the eyes after spending hours in space. And they are right, you know. I've added a dark theme, you can switch themes by clicking 'style' at the top right corner. Creator of Eve Addicts |

Desmont McCallock
160
|
Posted - 2012.04.12 18:54:00 -
[34] - Quote
Thumbs up, well done. |

LifeHatesMe
SKULLDOGS RED.OverLord
4
|
Posted - 2012.04.14 07:40:00 -
[35] - Quote
Bizzare, the import api seems to have a URI limit of 2,158 characters. Curious because the default is more around 8,177. Although this could be because I'm using a payload method that does not stream the content.
More info here :D |

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.14 09:04:00 -
[36] - Quote
LifeHatesMe wrote:Bizzare, the import api seems to have a URI limit of 2,158 characters. Curious because the default is more around 8,177. Although this could be because I'm using a payload method that does not stream the content. More info here :D I also replied in the other thread, but just so we are talking about the same thing, you are talking about retrieving price info via the API right? Like: http://eve.addicts.nl/api/prices.php?typeID=34,35,2875,631 but with a longer typeID string.
Or are you trying to do something else? Creator of Eve Addicts |

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.14 17:36:00 -
[37] - Quote
I've made it possible to get the prices for all items on the market via the API. Just add 'getAll=true' to the url and you will get the complete list. Creator of Eve Addicts |

LifeHatesMe
SKULLDOGS RED.OverLord
4
|
Posted - 2012.04.14 19:20:00 -
[38] - Quote
Snarf Aldes wrote:LifeHatesMe wrote:Bizzare, the import api seems to have a URI limit of 2,158 characters. Curious because the default is more around 8,177. Although this could be because I'm using a payload method that does not stream the content. More info here :D I also replied in the other thread, but just so we are talking about the same thing, you are talking about retrieving price info via the API right? Like: http://eve.addicts.nl/api/prices.php?typeID=34,35,2875,631but with a longer typeID string. Or are you trying to do something else? I found this in the logs: request failed: URI too long (longer than 8190) i guess that's the default for apache. Interesting, yeah, I guess I need to learn more about how to write proper HTTP headers. I was trying to create a snapshot of your price sheet cause the program I am writing will likely involve alot of profit calculations that to not necessarily work with just one market group.
Snarf Aldes wrote:I've made it possible to get the prices for all items on the market via the API. Just add 'getAll=true' to the url and you will get the complete list. Derp, that resolves the issue completely. Thanks! |

Desmont McCallock
163
|
Posted - 2012.04.15 08:45:00 -
[39] - Quote
Is it possible to have better precision on prices (two decimals)? I mean, the round up to one decimal may seem fine but it doesn't help on distinguishing orders. |

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.15 08:55:00 -
[40] - Quote
I assume you are talking about the website, not the API?
Low valued items do have 2 decimals, look at tritanium for example.
prices smaller than 100 have 2 decimals prices between 100 and 1000 have 1 decimal bigger than 1000 have no decimals
I did this for readability.
The API should have 2 decimals always. Creator of Eve Addicts |
|

Desmont McCallock
163
|
Posted - 2012.04.15 09:15:00 -
[41] - Quote
Yes, I'm talking about the site. Your thought about readability may be noble but trying to figure out the exact price of an item in category 2 (100-1000) to distinguish an order (in my case mine) I have to check with the volume too (cause prices vary on second decimal). I know what I request may be trivial but I'll have to set up an API way to get what I want. And I'm quite busy atm on another project. I leave it up to you.
|

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.15 09:27:00 -
[42] - Quote
Desmont McCallock wrote:Yes, I'm talking about the site. Your thought about readability may be noble but trying to figure out the exact price of an item in category 2 (100-1000) to distinguish an order (in my case mine) I have to check with the volume too (cause prices vary on second decimal). I know what I request may be trivial but I'll have to set up an API way to get what I want. And I'm quite busy atm on another project. I leave it up to you.
up to what price would you like to see 2 decimals ? Creator of Eve Addicts |

Desmont McCallock
163
|
Posted - 2012.04.15 09:50:00 -
[43] - Quote
You know that Jita 4-4 is a 0.01 station. So you can't limit to a price range. :)
Edit: I see you changed it already. Much appreciate it. |

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.15 10:00:00 -
[44] - Quote
Scrapyard Bob wrote:Andy DelGardo wrote:Is there some trick to minimize the market window while the scanning is running? Also is there anything i can do to make it as fast as possible? Some general "noob" proof tutorial would be nice, for the setup, upload and actual scanning tasks. a) No you cannot minimize the market window as EVE will just re-open it each time the IGB makes the Javascript call to look up an item. b) You cannot make it "as fast as possible" any faster then about 1 lookup every 3.0-3.5 seconds. If you attempt to call the EVE Javascript functions too fast, the client will just block your request and stop looking up items at all. (3.5 seconds seems to be the "safe" number, the closer you try to get to 3.0 seconds the more likely that you'll get bit.) I found a way to upload twice as much as normal :)
Now for this to work, you have to be sure that the market scanner you are using will hand out unique blocks of items to each client that is uploading in the same region. This is important, because otherwise you will just be uploading the same items in short succession. I don't know how others have programmed their market scanners, but mine will work the way it should.
First you start the scanner as usual, then open another tab and also start the scanner in the second tab. That's it, no voodoo required :)
You might have to time the start of the second scanner a bit, starting it just after an item from the first scanner opened worked for me. If you get the message 'Notify IGB function throttle limit reached. Only 1 IGB javascript function allowed per second.', you have to restart the second scanner and time it a bit differently. I usually get it working in one or two tries.
Once you have it running, it keeps running. Creator of Eve Addicts |

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.15 10:01:00 -
[45] - Quote
Desmont McCallock wrote:You know that Jita 4-4 is a 0.01 station. So you can't limit to a price range. :)
Edit: I see you changed it already. Much appreciate it. i upped the ranges with a factor of 10 Creator of Eve Addicts |

Desmont McCallock
163
|
Posted - 2012.04.15 10:05:00 -
[46] - Quote
Snarf Aldes wrote:Desmont McCallock wrote:You know that Jita 4-4 is a 0.01 station. So you can't limit to a price range. :)
Edit: I see you changed it already. Much appreciate it. i upped the ranges with a factor of 10
Till someone else complains about it (ain't we users some shi**y whiners?). :) |

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.15 11:17:00 -
[47] - Quote
Desmont McCallock wrote:Snarf Aldes wrote:Desmont McCallock wrote:You know that Jita 4-4 is a 0.01 station. So you can't limit to a price range. :)
Edit: I see you changed it already. Much appreciate it. i upped the ranges with a factor of 10 Till someone else complains about it (ain't we users some shi**y whiners?). :) you're all sons of b*tches!  Creator of Eve Addicts |

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.15 13:48:00 -
[48] - Quote
Snarf Aldes wrote: I found a way to upload twice as much as normal :)
Now for this to work, you have to be sure that the market scanner you are using will hand out unique blocks of items to each client that is uploading in the same region. This is important, because otherwise you will just be uploading the same items in short succession. I don't know how others have programmed their market scanners, but mine will work the way it should.
First you start the scanner as usual, then open another tab and also start the scanner in the second tab. That's it, no voodoo required :)
You might have to time the start of the second scanner a bit, starting it just after an item from the first scanner opened worked for me. If you get the message 'Notify IGB function throttle limit reached. Only 1 IGB javascript function allowed per second.', you have to restart the second scanner and time it a bit differently. I usually get it working in one or two tries.
Once you have it running, it keeps running.
Turns out that I am seeing the occasional 'only 1 javascript function per second' message, but overall i'm still uploading way more than before. Creator of Eve Addicts |

Scrapyard Bob
EVE University Ivy League
870
|
Posted - 2012.04.15 23:23:00 -
[49] - Quote
- Definitely needs a "dark theme" as the default for the IGB
- When looking up an item like Tritanium, there needs to be a summary pane above the detailed buy/sell order listing indicating the approximate price.
- URL address needs to update so that you can copy/paste links to share with others such as the link to the Tritanium price in The Forge |

LifeHatesMe
SKULLDOGS RED.OverLord
4
|
Posted - 2012.04.16 04:14:00 -
[50] - Quote
Snarf Aldes wrote:I assume you are talking about the website, not the API?
Low valued items do have 2 decimals, look at tritanium for example.
prices smaller than 100 have 2 decimals prices between 100 and 1000 have 1 decimal bigger than 1000 have no decimals
I did this for readability.
The API should have 2 decimals always. How are you pulling these? I have mine saved as doubles.. I was thinking of using BIGINT, and then at run time converting it to BIGINT * 0.01 .. dunno :S
(Remember DOUBLE/FLOAT 1.00 could be 0.99999999 and such...) I wrote a program that calculated taxes for a city. And I made alot of rounding errors.. XD |
|

Desmont McCallock
164
|
Posted - 2012.04.16 09:52:00 -
[51] - Quote
Scrapyard Bob wrote:- Definitely needs a "dark theme" as the default for the IGB Already implemented, click "Style".
Scrapyard Bob wrote:- When looking up an item like Tritanium, there needs to be a summary pane above the detailed buy/sell order listing indicating the approximate price. I think Snarf would like you to be more specific on that. Average of day?
Scrapyard Bob wrote:- URL address needs to update so that you can copy/paste links to share with others such as the link to the Tritanium price in The Forge +1 |

Scrapyard Bob
EVE University Ivy League
871
|
Posted - 2012.04.16 11:23:00 -
[52] - Quote
EMD and EMK use the "5% simulated" method where they take the total unit volume up for sale and calculate how much you would pay if you bought the bottom 5% of the volume. EC offers a "sell percentile" in their API call, which is close to the EMK/EMD numbers. The 5% sim-buy works great for commodities, fairly well for moderate volume items, but does tend to fall apart slightly in the quieter regions on the low-volume items where sell prices can have a large spread and there's only a handful of units for sale.
I'm not a fan of straight averages, as they get unduly influenced either by the "buy a zillion units at 0.01 ISK" at the low end of the market or "selling 1 unit for a zillion ISK" at the high end. At a minimum, you have to drop the outliers (and define that in some fashion). Even EMK's harmonious mean numbers run much "hotter" then what you'll actually pay when shopping.
For buy orders it's trickier as the 5% rule doesn't work as well, especially on the lower volume items. But if you have a bunch of units that you want to move, the 5% simulated sell isn't a bad method (a 2% or 4% version might give better results).
|

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.16 15:21:00 -
[53] - Quote
Scrapyard Bob wrote:EMD and EMK use the "5% simulated" method where they take the total unit volume up for sale and calculate how much you would pay if you bought the bottom 5% of the volume. EC offers a "sell percentile" in their API call, which is close to the EMK/EMD numbers. The 5% sim-buy works great for commodities, fairly well for moderate volume items, but does tend to fall apart slightly in the quieter regions on the low-volume items where sell prices can have a large spread and there's only a handful of units for sale.
I'm not a fan of straight averages, as they get unduly influenced either by the "buy a zillion units at 0.01 ISK" at the low end of the market or "selling 1 unit for a zillion ISK" at the high end. At a minimum, you have to drop the outliers (and define that in some fashion). Even EMK's harmonious mean numbers run much "hotter" then what you'll actually pay when shopping.
For buy orders it's trickier as the 5% rule doesn't work as well, especially on the lower volume items. But if you have a bunch of units that you want to move, the 5% simulated sell isn't a bad method (a 2% or 4% version might give better results).
I have been thinking of implementing a section with that kind of info, haven't figured out yet how i want to do it exactly. The url thing shouldn't be too hard to do... will look at it when i have some time. Creator of Eve Addicts |

Snarf Aldes
University of Caille Gallente Federation
4
|
Posted - 2012.04.16 19:33:00 -
[54] - Quote
I have changed the default style to dark.
I have also added the ability to link to items, for now you have to construct the url yourself. For example: http://eve.addicts.nl/index.php?typeID=12076®ionID=10000002 In the future i'll place a link somewhere to the item + region you are viewing. Creator of Eve Addicts |

LifeHatesMe
SKULLDOGS RED.OverLord
5
|
Posted - 2012.04.17 00:47:00 -
[55] - Quote
Scrapyard Bob wrote:I'm not a fan of straight averages, as they get unduly influenced either by the "buy a zillion units at 0.01 ISK" at the low end of the market or "selling 1 unit for a zillion ISK" at the high end. At a minimum, you have to drop the outliers (and define that in some fashion). Even EMK's harmonious mean numbers run much "hotter" then what you'll actually pay when shopping.
For buy orders it's trickier as the 5% rule doesn't work as well, especially on the lower volume items. But if you have a bunch of units that you want to move, the 5% simulated sell isn't a bad method (a 2% or 4% version might give better results).
That's a really good point. perhaps the an algorithm where you look at;
Movement of items for that particular typeID for the past few hours vs. a variably set average. I guess the caveat here is what we really need is unique transactions.. (!) or some way of calculating the average buy price based on the medium volume that is not bogus vs. the medium sale volume.
Additionally, you should factor in NPC items, and that they should be calculated differently, seeing as they are seeded at a default value, and then the pricing structure changes region to region, by demand, and probably some random thing that only a crazy economist would know. (T1 Blueprints, and things like Long-Limb Roes) |

Andy DelGardo
Hedion University Amarr Empire
2
|
Posted - 2012.04.19 11:26:00 -
[56] - Quote
Hey,
can u check item id's "29966, 30050, 30151" there seems to be a mixup with a other items in the database since i see tonns of invalid priced entries.
thx Andy |

Snarf Aldes
University of Caille Gallente Federation
5
|
Posted - 2012.04.19 11:28:00 -
[57] - Quote
Andy DelGardo wrote:Hey,
can u check item id "29966" there seems to be a mixup with a other item in the database since i see tonns of invalid priced entries.
thx Andy I know, it happend after I integrated the EMDR stream. I have disabled that for now, so prices should be returning to normal. Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
2
|
Posted - 2012.04.19 13:38:00 -
[58] - Quote
Hey any hope on implementing this little update filtering box? I really would like to be able to set a minimum update time like eve-central has. Since now i can check empire/tradehubs easily, thx a bunch for this feature i often see very old entries with complete outdated prices. So being able to filter out by update/upload time would make filtering "bad" orders more comfortable.
Btw thx for the great site, i used jitonomic before and EvE Addicts is so much faster and more comfortable to use. |

Snarf Aldes
University of Caille Gallente Federation
5
|
Posted - 2012.04.19 14:14:00 -
[59] - Quote
Andy DelGardo wrote:Hey any hope on implementing this little update filtering box? I really would like to be able to set a minimum update time like eve-central has. Since now i can check empire/tradehubs easily, thx a bunch for this feature i often see very old entries with complete outdated prices. So being able to filter out by update/upload time would make filtering "bad" orders more comfortable.
Btw thx for the great site, i used jitonomic before and EvE Addicts is so much faster and more comfortable to use. I'll have a look at it this weekend. Creator of Eve Addicts |

M Kernel
Izi bizi tini wini
2
|
Posted - 2012.04.20 11:39:00 -
[60] - Quote
Hey!
Great service! I really like the simplicity and performance of the site. Also, the API is EXACTLY what i need for my Spreadsheets in Space!
Thumbs up! :) |
|

Snarf Aldes
University of Caille Gallente Federation
6
|
Posted - 2012.04.20 14:10:00 -
[61] - Quote
Quote:Hey!
Great service! I really like the simplicity and performance of the site. Also, the API is EXACTLY what i need for my Spreadsheets in Space!
Thumbs up! :) Thanks, good to know people find it useful :)
Quote:Hey any hope on implementing this little update filtering box? I really would like to be able to set a minimum update time like eve-central has. Since now i can check empire/tradehubs easily, thx a bunch for this feature i often see very old entries with complete outdated prices. So being able to filter out by update/upload time would make filtering "bad" orders more comfortable.
Btw thx for the great site, i used jitonomic before and EvE Addicts is so much faster and more comfortable to use. If you set the region to 'trade hubs', 'empire' or 'any'', you will find the text 'filter' on the top left of the sell orders. Once you hover over it, you can adjust the age of the data, 0 = any age, you can filter up to 14 days. The setting is saved in a cookie, so out of game is should remember. For the IGB you'll have to set it for each session. Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
2
|
Posted - 2012.04.20 14:15:00 -
[62] - Quote
Snarf Aldes wrote: If you set the region to 'trade hubs', 'empire' or 'any'', you will find the text 'filter' on the top left of the sell orders. Once you hover over it, you can adjust the age of the data, 0 = any age, you can filter up to 14 days. The setting is saved in a cookie, so out of game is should remember. For the IGB you'll have to set it for each session.
cool thx works nicely! |

Andy DelGardo
Hedion University Amarr Empire
2
|
Posted - 2012.04.20 14:41:00 -
[63] - Quote
btw small bug/issue for selecting a item and searching a item. If u browse and select a item it will show the orders, but if u than use the search function it will only update the order tables, but not the navigation tab. For items with similar prices i sometimes fail to realize that the show orders are indeed not for the selected item, depending on my last search. Would be less confusing if the navigation tab would update to the item accordingly, also helps to get a idea under what category the searched item actually is.
While i'm at it and its friday, what about a custom list like marketeer or marketdata, which u can create and browse? Since i mainly check specific items for each job, so basically the scan list we can create for uploading in a web friendly browsable format? |

Snarf Aldes
University of Caille Gallente Federation
6
|
Posted - 2012.04.20 16:34:00 -
[64] - Quote
Andy DelGardo wrote:btw small bug/issue for selecting a item and searching a item. If u browse and select a item it will show the orders, but if u than use the search function it will only update the order tables, but not the navigation tab. For items with similar prices i sometimes fail to realize that the show orders are indeed not for the selected item, depending on my last search. Would be less confusing if the navigation tab would update to the item accordingly, also helps to get a idea under what category the searched item actually is.
While i'm at it and its friday, what about a custom list like marketeer or marketdata, which u can create and browse? Since i mainly check specific items for each job, so basically the scan list we can create for uploading in a web friendly browsable format? The first one in really tricky. I've tried to do it, but couldn't make it work.
The second request should be possible. I'll put it on my todo list...
edit: Second one is also not possible, since i don't require people to log in, i can't use the custom lists. The only way to do it is let people create list and save them in a cookie. Creator of Eve Addicts |

Scrapyard Bob
EVE University Ivy League
884
|
Posted - 2012.04.21 14:29:00 -
[65] - Quote
I don't think you have a page like the following yet:
http://www.evemarketeer.com/item/group_summary/18
Ideally, it should list the top N market hub systems (Jita, Amarr, Dodixe, Rens).
|

Andy DelGardo
Hedion University Amarr Empire
2
|
Posted - 2012.04.23 12:07:00 -
[66] - Quote
Hehe thx Bob, i did not know this existed. Its a nice overview and i like the ability to add regions, the only problem i have is the hard cap of "just" 5 regions. The main advantage is obviously that u can easily compare item-groups and 5 different regions, which i really like to get some base figures.
Eve Addicts can handle all the "trade hubs" at once, but being able to select a whole group is kinda nice. I really like it to compare subsystems for example, so thx for the tip. |

Scrapyard Bob
EVE University Ivy League
885
|
Posted - 2012.04.23 13:07:00 -
[67] - Quote
The group summary pages are a major time saver for me as a producer. I can hit the group summary page (which is customizable if you have an EMK account) and see where I should buy my supplies from. If one region is 5-10% below the others, then it's worth a 1% shipping fee to pull inputs from that region (if my buy orders aren't pulling fast enough).
It's also a handy tool for figuring out "I have 100 units of XYZ, which trade hub offers the most ISK/u".
|

Desmont McCallock
164
|
Posted - 2012.04.24 15:25:00 -
[68] - Quote
Me wants decimals for all price range. Gimme moooaaarrr accuracy. |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.04.24 15:47:00 -
[69] - Quote
Desmont McCallock wrote:Me wants decimals for all price range. Gimme moooaaarrr accuracy. Everything is displayed with 2 decimals now. Creator of Eve Addicts |

Desmont McCallock
164
|
Posted - 2012.04.24 16:03:00 -
[70] - Quote
Ahhhh, you are so kind.... <3 I'll ship you some Exotic Dancers to show you my gratitude. |
|

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.04.25 19:04:00 -
[71] - Quote
Updated the database to Escalation, 1626 more market items \o/ Creator of Eve Addicts |

Desmont McCallock
165
|
Posted - 2012.04.26 17:51:00 -
[72] - Quote
The key you have given me is now working. Can you please meet me (you know where). |

Desmont McCallock
165
|
Posted - 2012.04.27 19:53:00 -
[73] - Quote
Btw, you are producing UF messages with incorrect info. |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.04.30 08:43:00 -
[74] - Quote
I have created something similar.
There is a new menu item called Market Groups, it opens a page where you can search for a market group to display. You can also dubble-click a market group on the left hand menu.
You can see highest buy orders, lowest sell, 5% sell, 5% buy. The last two calculate the average price if you were to buy/fill the bottom/top 5% of the orders.
Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
3
|
Posted - 2012.04.30 11:08:00 -
[75] - Quote
Snarf Aldes wrote: I have created something similar.
There is a new menu item called Market Groups, it opens a page where you can search for a market group to display. You can also dubble-click a market group on the left hand menu.
EDIT: If you set the region filter to -- Trade Hubs -- you will get data from: Jita IV - Moon 4 / Rens VI - Moon 8 / Amarr VIII (Oris) / Dodixie IX - Moon 20
For me under FF12 the "dubble-click" is not working and i also can't find a way to get a group list view of any of the T3 subsystems? Ideally i would like to see a list of either all race/type specific or just the race + type.
Thx Andy |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.04.30 13:11:00 -
[76] - Quote
Andy DelGardo wrote:
For me under FF12 the "dubble-click" is not working and i also can't find a way to get a group list view of any of the T3 subsystems? Ideally i would like to see a list of either all race/type specific or just the race + type.
Thx Andy
It's not a FF issue, for me it works with FF12.
Only groups with actual items in them are dbl-clickable. If you open 'Drones', 'Combat Drones' does not work, but 'Drone Upgrades' or 'Mining Drones' should work. Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
3
|
Posted - 2012.04.30 14:01:00 -
[77] - Quote
Snarf Aldes wrote: Only groups with actual items in them are dbl-clickable. If you open 'Drones', 'Combat Drones' does not work, but 'Drone Upgrades' or 'Mining Drones' should work.
I found the problem, i was clicking on the text itself. It works for me if i click on the empty space behind the actual text.
Thx for this feature!
PS: Btw why no love for Hek as tradehub/group? :( |

Scrapyard Bob
EVE University Ivy League
902
|
Posted - 2012.05.03 02:54:00 -
[78] - Quote
Snarf Aldes wrote: There is a new menu item called Market Groups, it opens a page where you can search for a market group to display. You can also dubble-click a market group on the left hand menu.
Thanks. Now for the next request:
Update the browser title so it says "Eve Addicts - Market Group - Minerals ID 18" and update the URL line so that Firefox can easily find that page using its "awesome bar" search. With the EMK site, I could just type "group min" into the address bar and it would pull up the EMK's summary page for the market group.
The items on the market group page should be linked so that we can go to the item detail page.
I still prefer the EMK page because I could see all (4) major market hub prices at a glance for an entire group of items, which made it easier to go shopping for things like bulk minerals / datacores where I wanted it now, at the cheapest sell price and didn't have time to babysit buy orders. Or if I had a bunch of product - I could quickly see which of the four market hubs had the best sell prices and then ship that product to that hub for selling.
Thanks for adding the 5% number. Any ETA on adding that to the API? |

Desmont McCallock
171
|
Posted - 2012.05.03 04:28:00 -
[79] - Quote
I know it's offtopic, but Bob before you describe a feature in FF as awesome check that it wasn't first introduced in Chrome. FF is copying a lot of Chrome's features lately, which make me wonder why stick on FF. |

Andy DelGardo
Hedion University Amarr Empire
3
|
Posted - 2012.05.03 09:13:00 -
[80] - Quote
Desmont McCallock wrote:I know it's offtopic, but Bob before you describe a feature in FF as awesome check that it wasn't first introduced in Chrome. FF is copying a lot of Chrome's features lately, which make me wonder why stick on FF.
He actually never said its "awesome", he just refereed to its official name being "awesome bar" and on the browser "wars" note, i simply use both. I have chrome for my pandora/slacker music sites and use FF for all other stuff, mainly because chrome still lacks dozen of FF addons i like and use. |
|

Desmont McCallock
171
|
Posted - 2012.05.03 09:26:00 -
[81] - Quote
OK, true, indeed Bob actual references the name of the feature. But to begin with, naming a feature "awesome something" from the side of Mozilla foundation, while it's actually a copy of a feature implemented first on another browser is simply unfortunate.
Andy DelGardo wrote:... and use FF for all other stuff, mainly because chrome still lacks dozen of FF addons i like and use. And this is the only think where Chrome fails (from my POV) but then again that's what makes FF a slow browser to work with. |

Desmont McCallock
171
|
Posted - 2012.05.03 18:46:00 -
[82] - Quote
Hey, Snarf. I was watching the Stats page. How come the "This Month" is lower than "This Week"? How are you calc them? |

Alexia Eupraxia
eVo Research and Development
0
|
Posted - 2012.05.10 16:08:00 -
[83] - Quote
Thanks so much this site is very very awesome, also adding a very simple easy to read XML has made my life so much easyer!
|

Andy DelGardo
Hedion University Amarr Empire
6
|
Posted - 2012.05.15 16:41:00 -
[84] - Quote
OMG site is down, the world will end! |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.05.17 11:19:00 -
[85] - Quote
Desmont McCallock wrote:Hey, Snarf. I was watching the Stats page. How come the "This Month" is lower than "This Week"? How are you calc them? It shouldn't be lower, it can't be lower afaik. It's just a mysql table with columns for day, week, month etc., I increment all columns with 1 at every upload. To reset, I run a cron job every day, week month etc, and set the relevant column to 0
Creator of Eve Addicts |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.05.17 11:24:00 -
[86] - Quote
Scrapyard Bob wrote:Snarf Aldes wrote: There is a new menu item called Market Groups, it opens a page where you can search for a market group to display. You can also dubble-click a market group on the left hand menu.
Thanks. Now for the next request: Update the browser title so it says "Eve Addicts - Market Group - Minerals ID 18" and update the URL line so that Firefox can easily find that page using its "awesome bar" search. With the EMK site, I could just type "group min" into the address bar and it would pull up the EMK's summary page for the market group. The items on the market group page should be linked so that we can go to the item detail page. I still prefer the EMK page because I could see all (4) major market hub prices at a glance for an entire group of items, which made it easier to go shopping for things like bulk minerals / datacores where I wanted it now, at the cheapest sell price and didn't have time to babysit buy orders. Or if I had a bunch of product - I could quickly see which of the four market hubs had the best sell prices and then ship that product to that hub for selling. Thanks for adding the 5% number. Any ETA on adding that to the API? You can see the prices of the 4 main hubs in 1 view, just set the region filter at the right of the screen to: -- Trade Hubs --
I'm working on a second API price page with more detailed info. Are people actually using median prices for something? Some sites include those, but i don't really see the point.
I'll have a look at the title stuff, shouldn't be too hard.
Creator of Eve Addicts |

Scrapyard Bob
EVE University Ivy League
973
|
Posted - 2012.05.17 16:28:00 -
[87] - Quote
Main things I use APIs for:
- How much my inputs are going to cost me. So the lowest 5% sell or the sell/percentile price is important. I don't base input costs on buy order values.
- What I can sell my outputs for (either to a buy order or as sell orders), again this is generally the 5% sell or sell/percentile value. If I want to sell my stuff quickly, I need to be in the bottom 5% of the total orders, not chasing some imaginary average value up in the middle of the pack.
- Figuring out if there's a possible trade opportunity across a regional boundary. In which case I'm looking at the top buy orders compared to the low-end of sells in the other region.
- Estimating what my stockpiles and assets are worth. Ideally done with either an average of the 5% sell prices in the top N market hubs, or as a 5% sell aggregate of the main market hubs. |

Andy DelGardo
Hedion University Amarr Empire
7
|
Posted - 2012.05.18 20:25:00 -
[88] - Quote
Hi,
is there a API call like the "quicklook" from eve-central to actually get the buy/sell orders in XML format?
Thx Andy |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.05.19 21:30:00 -
[89] - Quote
Scrapyard Bob wrote:Main things I use APIs for:
- How much my inputs are going to cost me. So the lowest 5% sell or the sell/percentile price is important. I don't base input costs on buy order values.
- What I can sell my outputs for (either to a buy order or as sell orders), again this is generally the 5% sell or sell/percentile value. If I want to sell my stuff quickly, I need to be in the bottom 5% of the total orders, not chasing some imaginary average value up in the middle of the pack.
- Figuring out if there's a possible trade opportunity across a regional boundary. In which case I'm looking at the top buy orders compared to the low-end of sells in the other region.
- Estimating what my stockpiles and assets are worth. Ideally done with either an average of the 5% sell prices in the top N market hubs, or as a 5% sell aggregate of the main market hubs. The API can now display 5% buy/sell prices. You have to append '&detailed=true' to the url. It does not work in combination with 'getAll'. Creator of Eve Addicts |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.05.19 21:32:00 -
[90] - Quote
Andy DelGardo wrote:Hi,
is there a API call like the "quicklook" from eve-central to actually get the buy/sell orders in XML format?
Thx Andy Nope, i'm not planning on adding anything like it, at least for the time being. Creator of Eve Addicts |
|

Golden Gnu
EVE University Ivy League
60
|
Posted - 2012.05.25 17:06:00 -
[91] - Quote
I don't know if I don't understand your API correct or it's an error, but the following API request fail: http://eve.addicts.nl/api/prices.php?detailed=true&typeID=34&stationID=60003760
On a side not: I'm going to implement this in jEveAssets... Thank you for yet another great price data source! :) Download is the meaning of life, upload is the meaning of intelligent life http://eve.nikr.net - home of jEveAssets |

Desmont McCallock
179
|
Posted - 2012.05.25 17:13:00 -
[92] - Quote
Looks like 5% buy/sell works only when querying region. http://eve.addicts.nl/api/prices.php?typeID=34®ionID=10000002&detailed=true |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.05.25 21:19:00 -
[93] - Quote
That is a bug...
Should be fixed now. Creator of Eve Addicts |

Golden Gnu
EVE University Ivy League
60
|
Posted - 2012.05.26 09:17:00 -
[94] - Quote
@Snarf Aldes Thank you for the super fast fix!  Download is the meaning of life, upload is the meaning of intelligent life http://eve.nikr.net - home of jEveAssets |

Golden Gnu
EVE University Ivy League
60
|
Posted - 2012.05.26 10:42:00 -
[95] - Quote
Another irregularity: http://eve.addicts.nl/api/prices.php?typeID=3898&detailed=true I would expect buy_price and sell_price to have the value 0.0
It's not super important - just a minor issue... :)
For the record it's the typeID for "Quafe Zero" Download is the meaning of life, upload is the meaning of intelligent life http://eve.nikr.net - home of jEveAssets |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.05.26 14:24:00 -
[96] - Quote
Fixed as well. Creator of Eve Addicts |

Golden Gnu
EVE University Ivy League
60
|
Posted - 2012.05.27 08:34:00 -
[97] - Quote
@Snarf Aldes Thank you for the quick fix (Again) 
Download is the meaning of life, upload is the meaning of intelligent life http://eve.nikr.net - home of jEveAssets |

Temoto
Aliastra Gallente Federation
0
|
Posted - 2012.06.06 07:11:00 -
[98] - Quote
You are doing the right thing.
Item input suggest does not prefer neither prefix match nor full match so it's impossible to input "Morphite" (many different Hemorphite-s show up).
Contact me [email protected] if you need developer help. |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.06.06 14:14:00 -
[99] - Quote
Temoto wrote:You are doing the right thing. Item input suggest does not prefer neither prefix match nor full match so it's impossible to input "Morphite" (many different Hemorphite-s show up). Contact me [email protected] if you need developer help. You are right, that's a bit annoying. Fixed it. Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
63
|
Posted - 2012.06.10 18:02:00 -
[100] - Quote
nm, works again :p |
|

Desmont McCallock
181
|
Posted - 2012.06.10 19:16:00 -
[101] - Quote
The release of EVEMon 1.7.0 which includes a market data uploader is currently causing issues on Eve Addicts server due to the heavy traffic it generates. The EVEMon Dev Team would like to apologize for any inconvenience caused. We expect that things will smooth out once the entire EVEMon user base has updated to the new version. This is estimated to be completed in a day or two. |

Desmont McCallock
181
|
Posted - 2012.06.11 07:47:00 -
[102] - Quote
After EVEMon release we had to disable Eve Addicts as an endpoint, to ensure the smooth operation of the site, as data flow was surging and bringing the server down. Now after several hours, things have smoothed out. Currently we are at 33 calls/sec and expecting the rate to drop even further. So if Snarf wants to enable Eve Addicts again as an endpoint, please get in touch. |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.06.11 11:24:00 -
[103] - Quote
Desmont McCallock wrote:After EVEMon release we had to disable Eve Addicts as an endpoint, to ensure the smooth operation of the site, as data flow was surging and bringing the server down. Now after several hours, things have smoothed out. Currently we are at 33 calls/sec and expecting the rate to drop even further. So if Snarf wants to enable Eve Addicts again as an endpoint, please get in touch. I have decided to stay disconnected from the EVEMon uploads. My simple vps cannot handle the massive number of connections. The system simply doesn't have the resources, upgrading would not help much. The only way i can see this working is a dedicated server, not on a vps.
Creator of Eve Addicts |

Desmont McCallock
181
|
Posted - 2012.06.11 12:08:00 -
[104] - Quote
I believe it wouldn't hurt to enable it from time to time and observe the load. What we can also do is add Eve Addicts to the endpoint list but disabled and rely on the user to enable it (which only a few users do). |

Desmont McCallock
181
|
Posted - 2012.06.11 14:17:00 -
[105] - Quote
@Snarf If you can keep up with the EMDR feed rate then you can easily keep up with EVEMon direct uploading. |

Andy DelGardo
Hedion University Amarr Empire
63
|
Posted - 2012.06.11 14:23:00 -
[106] - Quote
Snarf Aldes wrote: The only way i can see this working is a dedicated server, not on a vps.
Is this a CPU/Memory/OS problem? Which hoster/VPS package are u using atm, i used various VPS over quite some time and could check if there is a similar priced, but more powerful VPS offer. |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.06.11 18:22:00 -
[107] - Quote
Desmont McCallock wrote:@Snarf If you can keep up with the EMDR feed rate then you can easily keep up with EVEMon direct uploading. I don't think so. The problem was the amount of connections to apache, not the actual processing. I did disable history uploads from EMDR since i'm not using them anyway.
Now EMDR is working, there is not really a need for direct uploads. Creator of Eve Addicts |

Ilyk Halibut
Blackwater USA Inc. Against ALL Authorities
6
|
Posted - 2012.06.11 18:33:00 -
[108] - Quote
We go over this in the EMDR documentation, but there is substantial overhead in accepting a ton of HTTP connections. TCP sockets have to be opened from all over, managed, sending/receiving happens, then they are closed (and hang around for a while in a FINISHED_WAIT state if the server isn't properly configured), and this is done for EVERY individual upload.
Contrast this to EMDR, which uses ZeroMQ. ZeroMQ PUB/SUB arrangements are a persistent, always-on, one-way feed. The consumers just listen in and don't bother replying. You only use one socket connection, and because it stays open, you don't have the overhead associated with a ton of rapidly opening/closing TCP sockets.
I'm not trying to plug EMDR here, but I am not at all surprised people are having issues handling the traffic. EMDR's gateways are designed in a very specific way to be able to handle the volume, but I had to build for performance from the very beginning. It wasn't nearly as much of a concern when some of the existing market sites started development, due to the much lower volume of market data. It now, all of the sudden, is, and we're seeing that.
Though, this is no fault of EVEMon. It's only doing exactly what it's supposed to. EVE Market Data Relay - A real-time feed of EVE Market data http://www.eve-emdr.com |

Desmont McCallock
181
|
Posted - 2012.06.11 19:18:00 -
[109] - Quote
I admit that my knowledge regarding server build up/maintenance/running is close to none and therefore can't understand server issues unless someone explains them to me. Now that I know what's the issue with Eve Addicts, I'm backing off. |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.06.12 05:59:00 -
[110] - Quote
As you can see from the stats, i'm still getting data from EVEMon users. The volume is low enough that it doesn't cause any problems, so no worries there.
Like Ilyk said, it was the opening and closing of tcp sockets that was one of the issues. Trying to process all of the incoming data at once also did not help.... When I looked for the first time, there were 160k history and about 50k orders waiting to be processed.
Creator of Eve Addicts |
|

Andy DelGardo
Hedion University Amarr Empire
64
|
Posted - 2012.06.14 13:56:00 -
[111] - Quote
Hi,
is it possible to add the current market buy/sell volume to the detail statistics in the api? |

Andy DelGardo
Hedion University Amarr Empire
65
|
Posted - 2012.06.18 15:18:00 -
[112] - Quote
I cant get this to work with IE9, while it works in FF13? The problem is that Excels Web Data import only uses IE, so is there a way around this? I would like to import orders directly from the web-page tables into Excel.
bye |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.06.19 06:02:00 -
[113] - Quote
Andy DelGardo wrote:I cant get this to work with IE9, while it works in FF13? The problem is that Excels Web Data import only uses IE, so is there a way around this? I would like to import orders directly from the web-page tables into Excel. bye PS: There is a excel/IE error, "Line 439, Char 2, 'console' is undefined code 0", no clue if this has anything to-do with this problem. I see that the whole page is borked with IE again :( I see if i can fix it, but no promises, IE sucks, it always has, it always will. Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
66
|
Posted - 2012.06.19 07:23:00 -
[114] - Quote
Snarf Aldes wrote: I see that the whole page is borked with IE again :( I see if i can fix it, but no promises, IE sucks, it always has, it always will.
I know, but i prefer Excel over GoogleDocs/OpenOffice, but unfortunately they forget to add a option to choose your web import renderer, i wonder why :)
Thx for trying
bye |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.06.19 07:26:00 -
[115] - Quote
Andy DelGardo wrote:Snarf Aldes wrote: I see that the whole page is borked with IE again :( I see if i can fix it, but no promises, IE sucks, it always has, it always will.
I know, but i prefer Excel over GoogleDocs/OpenOffice, but unfortunately they forget to add a option to choose your web import renderer, i wonder why :) Thx for trying bye You should see content now, but the layout is still fooked up. Creator of Eve Addicts |

Andy DelGardo
Hedion University Amarr Empire
66
|
Posted - 2012.06.19 11:49:00 -
[116] - Quote
I now see the order tables in excels IE renderer, but unfortunately it wont let me select the sell/buy tables and i only get the header table imported :(
I will try a workaround and see if i can import the tables via googledocs and than import this to excel. |

Desmont McCallock
186
|
Posted - 2012.06.22 07:42:00 -
[117] - Quote
[Request] A much needed column at the ''Buy Orders' table, "Range". |

Andy DelGardo
Hedion University Amarr Empire
68
|
Posted - 2012.06.23 18:18:00 -
[118] - Quote
Hi,
i just noticed that the 5% sell/buy are just the mathematical 5% percentile of the actual buy/sell price entries? If this is correct, would it be possible to change this to a actual sell/buy simulation of 5% of the total stock?
Thx Andy |

Temoto
Aliastra Gallente Federation
1
|
Posted - 2012.06.25 17:07:00 -
[119] - Quote
Feature request for market browser: * security status filter * quantity filter * custom item list
I could help with programming of these and anything else.
Also i could help to defeat "5 minutes" update delay. |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.06.26 08:29:00 -
[120] - Quote
As you all might have noticed, i'm not that active in eve/forums lately... I'll try and look at the requests, but i can't make any promises.
Desmont McCallock wrote:[Request] A much needed column at the ''Buy Orders' table, "Range". This should not be too hard, only problem is that the table will get kind of crowded.
Andy DelGardo wrote: Hi,
i just noticed that the 5% sell/buy are "just" the mathematical 5% percentile of the actual buy/sell price entries? If this is correct, would it be possible to change this to a actual sell/buy simulation of 5% of the total stock?
Thx Andy
I don't think i understand what you mean or want. Can you give me an example?
Temoto wrote:Feature request for market browser: * security status filter * quantity filter * custom item list
I could help with programming of these and anything else.
Also i could help to defeat "5 minutes" update delay.
Again, i'll see what i can do :) The 5 minute delay is caused by the fact that i cache the queries, so that is intentional.
Creator of Eve Addicts |
|

Andy DelGardo
72
|
Posted - 2012.06.26 09:48:00 -
[121] - Quote
Quote: I don't think i understand what you mean or want. Can you give me an example?
I just noticed a difference in the 5% percentile, from your data and other sites. So my assumption was that u build the percentile based on just the price entries per order. Evemarketdata/Eve-marketeer actually simulate what avg. price u would get, if u buy/sell 5% of the total available volume, using the existing orders.
Example Orders:
price; volume 100; 2 90;2 89;1 50;1000 48;1000 20;2000
5% price percentile = 97,5, while the avg. price to buy 5% volume would be something around 50. I hope this makes sense.
bye Andy |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.06.26 10:16:00 -
[122] - Quote
Andy DelGardo wrote:Quote: I don't think i understand what you mean or want. Can you give me an example?
I just noticed a difference in the 5% percentile, from your data and other sites. So my assumption was that u build the percentile based on just the price entries per order. Evemarketdata/Eve-marketeer actually simulate what avg. price u would get, if u buy/sell 5% of the total available volume, using the existing orders. Example Orders: price; volume 100; 2 90;2 89;1 50;1000 48;1000 20;2000 5% price percentile = 97,5, while the avg. price to buy 5% volume would be something around 50. I hope this makes sense. bye Andy This is exactly what is supposed to be calculated, unfortunately there is some error in the query i'm doing. I'm trying to figure out how to solve it atm. Creator of Eve Addicts |

Desmont McCallock
187
|
Posted - 2012.06.26 10:18:00 -
[123] - Quote
Thanks for the addition of the "Range" column. As always, you live up to our expectations.  |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.06.26 11:14:00 -
[124] - Quote
Snarf Aldes wrote:Andy DelGardo wrote:Quote: I don't think i understand what you mean or want. Can you give me an example?
I just noticed a difference in the 5% percentile, from your data and other sites. So my assumption was that u build the percentile based on just the price entries per order. Evemarketdata/Eve-marketeer actually simulate what avg. price u would get, if u buy/sell 5% of the total available volume, using the existing orders. Example Orders: price; volume 100; 2 90;2 89;1 50;1000 48;1000 20;2000 5% price percentile = 97,5, while the avg. price to buy 5% volume would be something around 50. I hope this makes sense. bye Andy This is exactly what is supposed to be calculated, unfortunately there is some error in the query i'm doing. I'm trying to figure out how to solve it atm. I solved it, it was a stupid mistake in the query. Creator of Eve Addicts |

Andy DelGardo
72
|
Posted - 2012.06.26 11:15:00 -
[125] - Quote
Snarf Aldes wrote: I solved it, it was a stupid mistake in the query.
Yay thx  |

Andy DelGardo
72
|
Posted - 2012.06.26 19:07:00 -
[126] - Quote
Hi,
unfortunately the math is still of :(
Examples:
http://eve.addicts.nl/api/prices.php?typeID=30562®ionID=10000002&detailed=true http://api.eve-marketdata.com/api/item_prices2.xml?char_name=demo&type_ids=30562®ion_ids=10000002&buysell=a http://api.eve-central.com/api/marketstat?typeid=30562®ionlimit=10000002
Eve-Addicts list the 5% sell price at: 30000.00 eve-marketdata at: 74926.35 eve-central at: 74926.36
bye Andy
PS: I just noticed that the webpage-api list the correct "74926.36" price, so u might have forgotten to also apply the fix to the xml api? |

Desmont McCallock
193
|
Posted - 2012.07.23 08:11:00 -
[127] - Quote
Site down. Looks like it got ganked. |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.07.23 10:02:00 -
[128] - Quote
Desmont McCallock wrote:Site down. Looks like it got ganked. Update: Working again. The VPS is having some issues, high iowaits resulting in high load. Creator of Eve Addicts |

Desmont McCallock
193
|
Posted - 2012.07.23 10:05:00 -
[129] - Quote
May I suggest you switch to NGINX instead of Apache? Although it will not have an impact on the IO (but will on RAM and CPU usage), NGINX is suggested for VPS. |

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.07.23 10:15:00 -
[130] - Quote
Desmont McCallock wrote:May I suggest you switch to NGINX instead of Apache? Although it will not have an impact on the IO (but will on RAM and CPU usage), NGINX is suggested for VPS. AFAIK NGINX is very good for static stuff, but not as good for dynamic stuff like php. Also, Apache has never been a problem so far.
Normally everything is working fine, although MySQL could use more ram... Creator of Eve Addicts |
|

Snarf Aldes
University of Caille Gallente Federation
7
|
Posted - 2012.07.23 10:18:00 -
[131] - Quote
Sorry for the late reply...
I had indeed forgotten to change the api queries  Creator of Eve Addicts |

Desmont McCallock
193
|
Posted - 2012.07.23 10:29:00 -
[132] - Quote
Snarf Aldes wrote:Desmont McCallock wrote:May I suggest you switch to NGINX instead of Apache? Although it will not have an impact on the IO (but will on RAM and CPU usage), NGINX is suggested for VPS. AFAIK NGINX is very good for static stuff, but not as good for dynamic stuff like php. Also, Apache has never been a problem so far. Normally everything is working fine, although MySQL could use more ram... I don't think that's the case anymore. Have a look at this: http://www.sitepoint.com/php-with-nginx-is-about-to-become-a-lot-easier/
AFAIK PHP-FPM is in PHP core as from 5.3.3.
Btw, EVE Marketeer is using NGINX/MariaDB/PHP setup and it plays quite well. |

Xeross155
NED-Clan Goonswarm Federation
130
|
Posted - 2012.07.30 12:04:00 -
[133] - Quote
Desmont McCallock wrote:Snarf Aldes wrote:Desmont McCallock wrote:May I suggest you switch to NGINX instead of Apache? Although it will not have an impact on the IO (but will on RAM and CPU usage), NGINX is suggested for VPS. AFAIK NGINX is very good for static stuff, but not as good for dynamic stuff like php. Also, Apache has never been a problem so far. Normally everything is working fine, although MySQL could use more ram... I don't think that's the case anymore. Have a look at this: http://www.sitepoint.com/php-with-nginx-is-about-to-become-a-lot-easier/AFAIK PHP-FPM is in PHP core as from 5.3.3. Btw, EVE Marketeer is using NGINX/MariaDB/PHP setup and it plays quite well. NGINX itself doesn't do PHP, it hands it off through FCGI, UWSGI or otherwise. This has the benefit that not every NGINX process has to load the PHP interpreter (Something that costs a lot of RAM when using Apache).
I had a VPS with Apache+mod_php and it was continuously running out of RAM, with NGINX+php-fpm I had RAM to spare. |

Desmont McCallock
197
|
Posted - 2012.07.30 12:16:00 -
[134] - Quote
Not to mention that NGINX handles better (and more) connections than Apache, which as you remember Snarf, caused your service to fail trying to handle market data uploads from multiple EVEMon uploaders.
Edit: DOTLAN also runs on NGINX/MySQL/PHP platform. |

Wollari
Phoenix Industries
58
|
Posted - 2012.07.30 22:24:00 -
[135] - Quote
Desmont McCallock wrote:Not to mention that NGINX handles better (and more) connections than Apache, which as you remember Snarf, caused your service to fail trying to handle market data uploads from multiple EVEMon uploaders.
Edit: DOTLAN also runs on NGINX/MySQL/PHP platform. DOTLAN runs on NGINX/Apache/MySQL/PHP platform :-) I put Ngnix in front just to deliver static content and forward all dynamic/unknown stuff via reverse proxy request to the backend apache (running on a different port) to do the php stuff. The main reason was in the beginning that I was to lazy to rewrite all mod_rewrite rules to nginx ones and just wanted to drop nginx in.
If you start from scratch you can easily start with nginx+php-fpm which is fine, but if you're a long term apache user, you old knowledge about mod_rewrite and stuff needs some overhaul and a rewrite :-)
In theory I could replace the backend apache on DOTLAN with php-fpm nowdays, but doing something similar on a highly frequented page is kinda riska without proper testing of all coding parts. Maybe If I've enough time someday I'll do the switch but not now. |

Andy DelGardo
76
|
Posted - 2012.08.17 14:35:00 -
[136] - Quote
Hi,
just noticed that i don't see/get the small slider anymore, to change the update time filtering? (FF14 and Chrome) |
|
|
|
Pages: 1 2 3 4 5 :: [one page] |