| Pages: 1 2 [3] 4 :: one page |
| Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Desmont McCallock
180
   |
Posted - 2012.06.03 12:42:00 -
[61] - Quote
Andy DelGardo wrote:Maybe its the new evemon uploader? No way, as we have tested the uploaded messages with Kaladr before allowing them to get included in EC data. And I haven't changed anything since, in the message format. |
Andy DelGardo
Hedion University
Amarr Empire
57
|
Posted - 2012.06.03 12:57:00 -
[62] - Quote
I tried "fixing" the broken reports by re-uploading, but seems u can't override those broken reports with fresh data?
I'm not sure whats going on, but i get more and more missing data via API-Calls. I also tried removing the "sethour" option completely, but i still wont get the "broken" data listed via api, while this works in the web version at least. |
Andy DelGardo
Hedion University
Amarr Empire
57
|
Posted - 2012.06.03 13:07:00 -
[63] - Quote
Oki something is broken here, i just re-uploaded using evemon and now the website basically shows all my send entries in this broken "06-03 1" time format. I'm not sure what causes this behavior, but can u double check evemons date format, since it basically breaks all API calls.
I will test the old eve-marketeer uploader next and see if this is maybe a eve-central problem, for all uploads.
Here is a broken example item: http://eve-central.com/home/quicklook.html?typeid=30122
The "Reported Time" is all "06-03 1" and all those entries are filtered out and wont show up, if u use the API and not the website. |
Andy DelGardo
Hedion University
Amarr Empire
57
|
Posted - 2012.06.03 13:20:00 -
[64] - Quote
Oki this actually "seems" like a eve-mon problem, i just re-uploaded a single entry using marketeers uploader which did fix all the Jita entries to the correct "06-03 13:16:40" format.
Could also be someone just fixed eve-central, will try break the entry again with eve-mon to double check.
UPDATE: Oki i also could again break the entry using eve-mon, so u might want to disable uploading until u found the problem. |
Desmont McCallock
180
|
Posted - 2012.06.03 14:31:00 -
[65] - Quote
OK, I just checked again and it looks like an EC parsing issue. EVE-Marketeer is not using the same format as EVEMon, so you can't compare. |
Andy DelGardo
Hedion University
Amarr Empire
57
|
Posted - 2012.06.03 14:44:00 -
[66] - Quote
Ah oki, hopefully this can be fixed soon, since it basically breaks all spreadsheets that import XML data via API. |
Andy DelGardo
Hedion University
Amarr Empire
59
|
Posted - 2012.06.05 12:17:00 -
[67] - Quote
Any update on this parser error? |
Andy DelGardo
Hedion University
Amarr Empire
62
|
Posted - 2012.06.08 23:22:00 -
[68] - Quote
mhh i still see lots of "06-08 1" so there is no eta on this problem? |
Felixjet CA
Goliat Clan Vanguards
WALLTREIPERS ALLIANCE
0
|
Posted - 2012.06.11 03:20:00 -
[69] - Quote
is api down? i cant get it to work since yesterday |
Kaladr
Dreddit
Test Alliance Please Ignore
34
|
Posted - 2012.06.11 06:29:00 -
[70] - Quote
Hey folks, just looked into the parser error - its not a parsing error (input data is correct), its a display issue on the older Python code.
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Andy DelGardo
Hedion University
Amarr Empire
63
|
Posted - 2012.06.11 08:28:00 -
[71] - Quote
Kaladr wrote:Hey folks, just looked into the parser error - its not a parsing error (input data is correct), its a display issue on the older Python code.
The API should be unaffected, only the web display was affected (and is now kludge fixed).
If at all possible, please use the API for automated tasks :)
Are u sure thats the case?
I use the API and for me any order that had this invalid date/time was filtered out, mainly because the api seems to have problems calculating the "report time" correctly. For me my whole spreadsheet basically had "holes" in it if items had those bad dates? So can u double check this, simply use PLEX or whatever popular item and try to get orders via api with "sethours" set and without and compare the result to the web output. So basically try to get those "bad" entries listed via api.
I could consistently upload "bad" data using evemon and basically could break my whole spreadsheet, since i would not "see" any orders at all in my uploaded regions/items. |
Desmont McCallock
181
|
Posted - 2012.06.11 08:55:00 -
[72] - Quote
I would really much appreciate if you don't link EVEMon to this issue as EVEMon is not sending 'bad' data as you call them. You are creating misconceptions. Please try to find a different expression. |
Andy DelGardo
Hedion University
Amarr Empire
63
|
Posted - 2012.06.11 09:15:00 -
[73] - Quote
Desmont McCallock wrote:I would really much appreciate if you don't link EVEMon to this issue as EVEMon is not sending 'bad' data as you call them. You are creating misconceptions. Please try to find a different expression.
Um, sorry might have chosen my words unwisely :p I really would like to use eve-mon as updater, but because of this problem i had to revert back to the marketeer updater until now.
The problem seems "fixed" now, so i will test this later today again using eve-mon + XML API, so i'm sorry for "stirring" up troubles for u guys and i absolutely appreciate your hard work!
bye Andy |
Muscaat
EVE Markets
6
|
Posted - 2012.06.11 23:25:00 -
[74] - Quote
Is "1" a success response when uploading to the UU endpoint? Based on earlier posts in this thread it is, but just want to check ;) |
Kaladr
Dreddit
Test Alliance Please Ignore
34
|
Posted - 2012.06.12 01:46:00 -
[75] - Quote
Andy DelGardo wrote:Desmont McCallock wrote:I would really much appreciate if you don't link EVEMon to this issue as EVEMon is not sending 'bad' data as you call them. You are creating misconceptions. Please try to find a different expression. Um, sorry might have chosen my words unwisely :p I really would like to use eve-mon as updater, but because of this problem i had to revert back to the marketeer updater until now. The problem seems "fixed" now, so i will test this later today again using eve-mon + XML API, so i'm sorry for "stirring" up troubles for u guys and i absolutely appreciate your hard work! bye Andy
Let me know if you see any major discontinuities in API vs Web data - there may be a several minute caching period, but it shouldn't be major.
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Kaladr
Dreddit
Test Alliance Please Ignore
34
|
Posted - 2012.06.12 01:46:00 -
[76] - Quote
Muscaat wrote:Is "1" a success response when uploading to the UU endpoint? Based on earlier posts in this thread it is, but just want to check ;)
Yes :)
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Kaladr
Dreddit
Test Alliance Please Ignore
34
|
Posted - 2012.06.12 01:48:00 -
[77] - Quote
As a note: Peak response times sometimes took a nosedive due to the classic "collect the world" parallel garbage collector syndrome. As I've updated to Java 7u4, I've turned on the G1 collector which should significantly improve the "collect 10GB of heap" pauses. (On a side note, 'top' in Linux appears to cap out at 999% CPU).
The amount of new data thanks to EVEMon has been immense.
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Ilyk Halibut
Blackwater USA Inc.
Against ALL Authorities
6
|
Posted - 2012.06.14 02:21:00 -
[78] - Quote
Is that CPU load just in the HTTP gateway, or is that more so the storage/statistical/analytical stuff?
EVE Market Data Relay - A real-time feed of EVE Market data
http://www.eve-emdr.com |
Kaladr
Dreddit
Test Alliance Please Ignore
35
|
Posted - 2012.06.15 05:55:00 -
[79] - Quote
Ilyk Halibut wrote:Is that CPU load just in the HTTP gateway, or is that more so the storage/statistical/analytical stuff?
That is the combined REST server (sitting behind nginx), API server, analytics, and upload parsing process.
Note that the high CPU use only came across when all 12 threads were dedicated to a full compacting collection. Normally, it averages to 20-30%.
With the new G1 collector in use, and a "small" memory leak fixed in the SMTP service, I'm happy to report peak response time is significantly better.
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Kaladr
Dreddit
Test Alliance Please Ignore
36
|
Posted - 2012.07.30 23:38:00 -
[80] - Quote
A notice to everyone using the SMTP Push service:
The SMTP Push Service will be closed (i.e., no longer deliver new mail, accept signups, acknowledge its existence) on August 15th, 2012.
I advise everyone to use the EVE Market Data Relay as a (much better) replacement.
For more information, I suggest reading the blog article: http://yannramin.com/2012/07/30/sunsetting-the-mail-push-service-in-favor-of-emdr/
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Robb Stewart
EVE University
Ivy League
0
|
Posted - 2012.08.15 05:20:00 -
[81] - Quote
Marketstats like median, average, and volume are not matching quicklook or reality when it is restricted to a single system (at least).
For example, if I tell marketstats to check the price for caldari shuttle in Hek right now, the median price comes up as 150,000,000.00 isk. Quicklook (and reality) show that there are 3 sell orders for 300,000,000 isk, and a bunch for reasonable prices.
Also, median price for visible buy and sell orders are not matching the visible prices shown in the non-api section (at least for restrict to one region). Changing the settings (minimum quantity and hours) change the median price shown, but it never correctly matches the median price for all the buy and sell orders shown.
I'm not sure if I'm missing something or if it's not working right. Thanks. |
Nnaem Kvorr
Fleet-Up.com
0
|
Posted - 2012.08.17 22:28:00 -
[82] - Quote
Sounds good. EVE Central has always been my go-to for price info and where to fly to get a deal. Part of the appeal is the simple interface.
Fleet-Up.com - fitting, doctrine and fleet management made easy. Currently in beta and looking for testers. |
Kaladr
Dreddit
Test Alliance Please Ignore
36
|
Posted - 2012.08.22 04:33:00 -
[83] - Quote
Robb Stewart wrote:Marketstats like median, average, and volume are not matching quicklook or reality when it is restricted to a single system (at least).
For example, if I tell marketstats to check the price for caldari shuttle in Hek right now, the median price comes up as 150,000,000.00 isk. Quicklook (and reality) show that there are 3 sell orders for 300,000,000 isk, and a bunch for reasonable prices.
Also, median price for visible buy and sell orders are not matching the visible prices shown in the non-api section (at least for restrict to one region). Changing the settings (minimum quantity and hours) change the median price shown, but it never correctly matches the median price for all the buy and sell orders shown.
I'm not sure if I'm missing something or if it's not working right. Thanks.
Right now there is a big rift in the EVE-Central continuum. The API calls are on a much newer, more efficient, and all around fancier code base, while the web front end is still doing server-driven templates from a much older, odder, and slower code base.
The goal is to normalize everything to the API back end soon (by doing something amazing, actually ingesting your own API :)). I fixed some hilarious (depending on who is asking) bugs related to filtering and time limits on the web front end, and did some minor adjustments, so hopefully things are smoother there.
Furthermore, the median should be the median with certain outliers removed (a crude inter-quartile range check). In my opinion, the "percent" (buyup, sell, 5%) value from the API is the best number to gauge the market by.
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Khorkrak
Confetti Explosion
11
|
Posted - 2012.08.23 15:36:00 -
[84] - Quote
Damn I got nailed by that median price issue as well as some yahoo is selling 1 Condor for a ridiculous price in seemingly like every station in Lontrek currently. So with my basing the median price from the processing EVE-Central backup data dumps and not taking into consideration quantities for sale, the result is:
Crazy Condor Price (see the ship loss on the bottom right)
Ugh - so I suppose the most efficient way is via a heuristic to eliminate ludicrous prices. Is there a way to get the median prices for like every item in the game from EVE-Central on a regular (weekly) basis? The dumps are huge and time consuming to wade through.
At any rate I'll have to fix this soon and redo out all aggregates to clean this up.
Extraordinary claims require extraordinary evidence |
Robb Stewart
EVE University
Ivy League
0
|
Posted - 2012.08.25 18:39:00 -
[85] - Quote
I see. It seems like when there is ridiculously priced item, your algorithm sometimes considers the regularly priced items the outliers instead of the ridiculously priced item.
Thanks for the reply Kaladr! |
Kaladr
Dreddit
Test Alliance Please Ignore
38
|
Posted - 2012.08.28 06:59:00 -
[86] - Quote
Robb Stewart wrote:I see. It seems like when there is ridiculously priced item, your algorithm sometimes considers the regularly priced items the outliers instead of the ridiculously priced item.
Thanks for the reply Kaladr!
I'm working on improving them, in addition to consolidating statistics to one engine.
Also, new logo and top bar launched, opinions?
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Zifrian
Licentia Ex Vereor
Intrepid Crossing
394
|
Posted - 2012.09.04 15:05:00 -
[87] - Quote
The API seems to not be returning correctly formatted data. Any thoughts?
Maximze your Industry Potential! - Get EVE Isk per Hour! |
Benign Sage
Rock Ballz INC.
15
|
Posted - 2012.09.04 23:22:00 -
[88] - Quote
Loving the updates to Eve-Central thus far! I have your API integrated into my software, My EVE API, and it's working great. I am loving the new faster speed! Truly an improvement!
Any chance on getting the datestamps standardized? ie: [expires]2012-09-04[/expires] VS [reported_time]09-04 05:51:3[/reported_time]. Even having 00:00:00 after the date would be cool, saves me a step ;)
Keep up the great work!
Sage
My EVE API-á
https://www.myeveapi.com |
Kaladr
Dreddit
Test Alliance Please Ignore
38
|
Posted - 2012.09.19 07:16:00 -
[89] - Quote
Benign Sage wrote:Loving the updates to Eve-Central thus far! I have your API integrated into my software, My EVE API, and it's working great. I am loving the new faster speed! Truly an improvement! Any chance on getting the datestamps standardized? ie: [expires]2012-09-04[/expires] VS [reported_time]09-04 05:51:3[/reported_time]. Even having 00:00:00 after the date would be cool, saves me a step ;) Keep up the great work! Sage
I'd love to, but as a historical accident / not breaking everything out there, I haven't.
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Kaladr
Dreddit
Test Alliance Please Ignore
38
|
Posted - 2012.09.19 07:17:00 -
[90] - Quote
Zifrian wrote:Getting a 'The request contains bad syntax or cannot be fulfilled.' for several items in the API.
http://api.eve-central.com/api/marketstat?typeid=21815&usesystem=30000142Here is one example of the Elite Drone AI. Here are the other TypeIDs causing issues: Item IDItem Name 2083Prototype Iris Probe Launcher 13202Megathron Federate Issue 21815Elite Drone AI 22325'Daemon' Codebreaker I 22327'Codex' Codebreaker I 22329'Alpha' Codebreaker I 22331'Libram' Codebreaker I 22333Talocan Data Analyzer I 22335Sleeper Data Analyzer I 22337Terran Data Analyzer I 22339Tetrimon Data Analyzer I Also, all Faction Structures and Faction Drones. The probe launcher isn't an item you can make or buy, so I'll get rid of it. But the others haven't had issues before.
Generally I screen items on having a valid Market Group ID. If those items have a market group, then this is clearly a bug.
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
| |
|
| Pages: 1 2 [3] 4 :: one page |
| First page | Previous page | Next page | Last page |