Pages: 1 2 3 4 5 6 7 8 [9] 10 11 12 13 14 15 16 17 18 19 20 .. 21 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Scrapyard Bob
EVE University Ivy League
462
|
Posted - 2011.12.24 13:54:00 -
[241] - Quote
I figured out a new way to break the API call by putting garbage in for the type IDs.
http://www.evemarketeer.com/api/info/32_#N/A_33_#N/A_#N/A_#N/A_#N/A_#N/A_#N/A_#N/A/xml/10000002/sell_lowest5
This results in the error:
MYSQL ERROR OCCURRED: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ') AND station_id = 0 ORDER BY FIELD(type_id, 32,)' at line 1
Which may possibly mean that you are vulnerable to a SQL injection. You'll need to ensure that those values are forced into numeric types before passing them to the SQL engine. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
43
|
Posted - 2011.12.25 08:56:00 -
[242] - Quote
They are escaped before adding them into the query, that said, it's a bit weird they actually break it, but probably because the query expects them all to be numbers.
Thad said, I"ve added it to the feedback page and will see if I can fix it.
As for the Win XP error. I guess that's what I get for trying to lend stuff from EMD, the odd part is that it's actually designed to do that differently for XP, so I guessed it should work. Will fix in next version. Developer/Creator of EVE Marketeer
|
Invictra Atreides
Toward the Terra
16
|
Posted - 2011.12.27 01:44:00 -
[243] - Quote
Today I just started to use your uploader and the XML API. Now when I run the uploader it does its thing and uploads the files, but when I check on evemarketeer.com the data is not updated. It still shows the old data. why is that ?
It also uploads to eve-central.com so I also checked there and the data there was updated.
Then I also checked eve-marketdata.com and the data there was also updated, but their XML API was still showing the old data.
Is this a normal behavior? I don't understand. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
43
|
Posted - 2011.12.27 01:52:00 -
[244] - Quote
Invictra Atreides wrote:Is this a normal behavior? I don't understand.
It both is, and is not at the same time. The server was rebooted yesterday, and wasn't running any processing threads due to them all being killed because of that. It should be updating normally now. Anyhow, I really need to start doing this automatically, as these are situations I like to avoid, so hopefully this problem won't occur again.
If you ever wonder whether anything is happening to your updates, you can look at the upload statistics page. If the EVE Marketeer backlog counter keeps increasing, something might be wrong with the processing (but your uploads are still saved, and will be processed when the problem is resolved). Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
463
|
Posted - 2011.12.27 14:49:00 -
[245] - Quote
http://www.evemarketeer.com/api/info/34_35_36_37_38_39_40_11399/xml/10000002/sell_lowest5
Is showing zero data for Pyerite, Mexallon and Zydrine this morning.
http://www.evemarketeer.com/item/info/pyerite http://www.evemarketeer.com/item/info/zydrine http://www.evemarketeer.com/item/info/mexallon
|
Invictra Atreides
Toward the Terra
16
|
Posted - 2011.12.27 21:24:00 -
[246] - Quote
It seems half the database was corrupted. The restore data on the webpage helps.
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
44
|
Posted - 2011.12.28 10:13:00 -
[247] - Quote
Well, it isn't that the database is corrupted, it is more that EVE Central keeps sending empty data at times. I thought I'd fixed the problem where empty EVE Central data was sent, but it seems not. I built in the restore button in any case, so you can go back to correct data if you think the data can't possibly be right.
I'll see what is happening to make some data still being cleared. Developer/Creator of EVE Marketeer
|
TheSmokingHertog
Black Hole INC
3
|
Posted - 2011.12.28 11:16:00 -
[248] - Quote
Just found out about your site / tools. Thx for all efforts. Lets see how to put the information to good use over here :). |
Kaedaar OLeary
ADK Industries
0
|
Posted - 2011.12.29 01:48:00 -
[249] - Quote
Any idea how I can upload to the battleclinic servers as well. I see you can add more endpoints in your uploader.
Thanks for all your efforts.
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
47
|
Posted - 2011.12.29 09:36:00 -
[250] - Quote
I am not aware of battleclinic supporting direct uploading. If and when they implement one of the upload formats, they will publish an endpoint url that you can add to the uploader. Developer/Creator of EVE Marketeer
|
|
Rektide
School of Applied Knowledge Caldari State
0
|
Posted - 2011.12.29 17:54:00 -
[251] - Quote
Hi. I'd like to request some kind of streaming output. EVE Metrics had an AMQP feed, EVE Central has an email list that sends out an email with all of the raw CSV received in the last minute: I'd love something with that push-based streaming out in EVE Marketteer.
There is recent_updates, but it's something that needs to be polled & updated manually. I'm also afraid of missing contents, so I'd have to request time_since_last+1 then dedupe, which adds a little cost & complexity.
Connectivity options: email, amqp, webhook callbacks, xmpp MUC bot, zeromq, ... |
Dragonaire
Corax. PURgE Alliance
25
|
Posted - 2011.12.30 04:43:00 -
[252] - Quote
Might check out this thread as there are plans to have a unified exchange format that is being developed that all the upload sites and others are working on implementing including EMK https://forums.eveonline.com/default.aspx?g=posts&t=18466&find=unread Finds camping stations from the inside much easier. Designer of Yapeal for Eve API. Check out the Yapeal forum thread |
Scrapyard Bob
EVE University Ivy League
570
|
Posted - 2012.01.01 01:51:00 -
[253] - Quote
On the market scanner page where it shows "(6857 / 6922 updated in last 24 hours)" - that number does not appear to be updating as time goes on. So, for instance if it shows 12% has been updated in the last 24 hours, then you look at the regional page it will say something far higher after a few hours.
Also, the regional status page does not always render the first time visited in Firefox. I have to go to that URL, then force a page reload in order for it to display properly. It's a hit/miss error, possibly cache related. It may only happen once per hour (as the page gets updated).
http://www.evemarketeer.com/statistics/regions
PS: The unified uploader is running happily, 174k cache files processed since it started and no crashes. There does seem to be a memory leak somewhere because it's up to 257MB of "peak working memory" with 183MB in current use (174MB private/commit size). It started at around 35-40MB when first launched. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
63
|
Posted - 2012.01.01 18:11:00 -
[254] - Quote
@Rektide: There are still plans for streaming output using AMQP, but at the moment it's not very high on my priority list. I might be able to simulate something EVE Central like for the interval though.
@Scrapyard: I know, there is something going wrong with the way those values are calculated. I'll investigate the issue. Same goes for regions, though I have no clue as to what is causing that yet.
Good to hear that the unified uploader is running happily. I wonder what is causing the large memory consumption though. How long have you had it running? Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
575
|
Posted - 2012.01.01 23:12:00 -
[255] - Quote
Callean Drevus wrote: Good to hear that the unified uploader is running happily. I wonder what is causing the large memory consumption though. How long have you had it running?
A a guess, somewhere around 9 days and 174,000 cache files processed. So it's a fairly slow memory leak. I have 16GB of RAM, but I could see that being an issue for others.
The ".log" files don't put time-stamps in when they start-up (it just says "Logger started").
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
63
|
Posted - 2012.01.03 23:17:00 -
[256] - Quote
Ok, I guess that means it's not a very radical problem, and it explains why it hasn't shown up in my tests. Will still see whether I can do something about that, but my guess is most people don't leave their computers on for 9 days ;)
In addition, if any of you ever wondered what your wallet balance graph looks like, which I guess you didn't since we all know of EVE Mentat and all those programs, I've always felt that such a function was missing on EVE Marketeer, so I've added it.
Find it under My Market -> Wallet History Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
581
|
Posted - 2012.01.04 08:13:00 -
[257] - Quote
And a small bump because the history tab is showing chart history that only goes through Nov 27th.
http://www.evemarketeer.com/item/info/pyerite
(It's probably already on your to-do list.) |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.04 10:38:00 -
[258] - Quote
And you did upload more history than November I take it? :P It wasn't on my to do list yet thanks for letting me know. Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
582
|
Posted - 2012.01.04 14:18:00 -
[259] - Quote
Which reminds me of a question. For eve-marketdata, you had to manually switch your market screen to be looking at the "history" tab in order for it to gather data before running scans. Is that still true that the market history cache files will not be generated if you do not specifically switch to the "history" tab?
|
Kaladr
Dreddit Test Alliance Please Ignore
13
|
Posted - 2012.01.05 00:32:00 -
[260] - Quote
Yes, the history tab needs to be open for the client to make calls to get history (and in turn end up in the cache files).
EVEC still has no history interface, so of course no uploads go to it. Maybe soon, but there is a lot of core stuff in the primary "orders" land which is still taking up my time. Creator of EVE-Central.com, the longest running EVE Market Aggregator |
|
Domi Etymology
Violent Alternatives C0NVICTED
0
|
Posted - 2012.01.05 03:57:00 -
[261] - Quote
When you get a history with a single entry, and 0 orders/0 quantity, can you somehow depriorotise that item for that region, so it is hardly ever requested when scanning the market?
Currently scanning Branch, and it feels like 90% of the time I'm scanning for items that do not exist in the region, and never have :P |
Domi Etymology
Violent Alternatives C0NVICTED
0
|
Posted - 2012.01.05 04:37:00 -
[262] - Quote
Oh, and when uploading item history, nothing seems to be coming up in my upload history? |
Maeste Madeveda
The Spawning Pool Team Liquid
1
|
Posted - 2012.01.05 15:38:00 -
[263] - Quote
Would it be possible to add the 'field_filter' component to the 'station_info' (station details) request ?
I'd like to get a particular have info as precise as possible and sometimes artificial orders are messing up with the values of the item I want in the simpler item details.
Also it is possible to have the option not to delete the files updated through the unified uploader like it was in the previous uploader ? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.05 18:58:00 -
[264] - Quote
Quote:Yes, the history tab needs to be open for the client to make calls to get history (and in turn end up in the cache files). Thanks for answering that question :)
Quote:When you get a history with a single entry, and 0 orders/0 quantity, can you somehow depriorotise that item for that region, so it is hardly ever requested when scanning the market? Yes, this seems like a smart idea. Will probably try something along the lines of what Scrapyard Bob described a while back.
Quote:Oh, and when uploading item history, nothing seems to be coming up in my upload history? If you are using uploader 0.4, you should switch to 0.4b, but I assume you have done that already. I'll investigate this issue.
Quote:Would it be possible to add the 'field_filter' component to the 'station_info' (station details) request ?
I'd like to get a particular have info as precise as possible and sometimes artificial orders are messing up with the values of the item I want in the simpler item details. Yes, I'll add the field filter, I was under the impression it was there already, but it's not. Can you describe artificial order? I do my best to remove all artificial orders, but maybe someone came up with an idea good enough to pass through the filters .
It's also possible to not delete the files, but it'll probably move them to a different folder then, since it's going to interfere with the uploading otherwise (especially if people leave their client running for weeks on end , it's bound to get slower). Developer/Creator of EVE Marketeer
|
Domi Etymology
Violent Alternatives C0NVICTED
0
|
Posted - 2012.01.06 22:25:00 -
[265] - Quote
yep, 0.4b. Well 99% sure. I download the file called 0.4b from the site, and unpacked it. While it's running, however, the unified uploader says "Current Version: 0.4"
Oh also, a small thing with the unified uploader, the text where it shows the uploads, everage time, etc for ever marketeer, eve central and even marketdata...... that text is *constantly* flashing. Sorta gives me a headache if I look at it for too long. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.06 22:29:00 -
[266] - Quote
Yeah, it's version 0.4b. Probably forgot to change the version numbering (again).
The text is constantly flashing because it is being updated... I can lower the frequency though, which should make it better. On the other hand, I can hardly believe you actually spend time staring at the loveliness of uploading Developer/Creator of EVE Marketeer
|
Domi Etymology
Violent Alternatives C0NVICTED
0
|
Posted - 2012.01.07 02:29:00 -
[267] - Quote
it's.....so.... mesmerizing......
actually, I'm just glad it doesn't freeze up like the old uploader :P |
Scrapyard Bob
EVE University Ivy League
586
|
Posted - 2012.01.07 03:57:00 -
[268] - Quote
One request that came in through a private convo today with someone. This particular user also runs their own cache-scanning software.
The new uploader no longer has the option of "leave cache files in place" (i.e. "don't delete"). Or maybe we need an option of "delete after N hours".
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
64
|
Posted - 2012.01.07 09:25:00 -
[269] - Quote
Yup, I already got that 4 posts ago it will be added. Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
586
|
Posted - 2012.01.07 15:09:00 -
[270] - Quote
Ooops, guess I shouldn't post requests when running on 3 hours of sleep.
On the history graph, the little tool-tip that shows you the price value as you mouse-over the lines on the graph is very hard to read. Can you make the background more opaque and increase the contrast of the text color in relationship to the background? |
|
|
|
|
Pages: 1 2 3 4 5 6 7 8 [9] 10 11 12 13 14 15 16 17 18 19 20 .. 21 :: one page |
First page | Previous page | Next page | Last page |