Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 [15] 16 17 18 19 20 .. 21 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
89
|
Posted - 2012.02.07 22:22:00 -
[421] - Quote
Nope, not blacklisted. Seems the problem had something to do with InnoDB. Stupid innodb size... I hope it has been fixed for now. Developer/Creator of EVE Marketeer
|
Jacob Lyon Chieve
Sanguis Mortem Industrial
1
|
Posted - 2012.02.08 04:23:00 -
[422] - Quote
Having issues once more. On mouseover, the cell containing the XML call says "error: the XPath query did not return any data"
FWIW, I can get onto the website just fine. |
Dragonaire
Corax. The Big Dirty
32
|
Posted - 2012.02.08 05:01:00 -
[423] - Quote
If you're running out of database connections then you have something not releasing them correctly some where. Make sure when you're done with the connection on a page you set you variable for your connection to NULL should help make sure it gets released. Something like $mysql->close();$mysql=NULL; works wonders at times Finds camping stations from the inside much easier. Designer of Yapeal for Eve API. Check out the Yapeal PHP API library thread for more information. |
Aineko Macx
Royal Amarr Institute Amarr Empire
137
|
Posted - 2012.02.08 06:53:00 -
[424] - Quote
Some random comments/questions: - in the API description for the historical averages, the description for 'averages', 'maximum' and 'minimum' are wrong. Those refer to the item volume, not transaction count. - When querying using station_info, in the returned document station_id is null - How are you estimating the sell/buy percentages? - I'd very much like to have the historical data expanded to have a row per day, instead of just one averaged for the whole period. Would you consider doing that?
Keep up the good work! |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
89
|
Posted - 2012.02.08 09:02:00 -
[425] - Quote
Jacob Lyon Chieve wrote:Having issues once more. On mouseover, the cell containing the XML call says "error: the XPath query did not return any data"
FWIW, I can get onto the website just fine.
This might be because Google caches the request your xml call makes for a while, so it remembers whatever happened when the site was down. If the call you are doing by XML is going wrong if you enter the URL in a browser, please give me that URL, so I can investigate.
Quote:If you're running out of database connections then you have something not releasing them correctly some where. Make sure when you're done with the connection on a page you set you variable for your connection to NULL should help make sure it gets released. Something like $mysql->close();$mysql=NULL; works wonders at times Ah, turns out it wasn't connections, but InnoDB log file size, the odd thing is that it continued to work until it really couldn't do anything anymore. I do not exactly understand the reason, but the size has been increased and I do not expect to see this problem again.
- in the API description for the historical averages, the description for 'averages', 'maximum' and 'minimum' are wrong. Those refer to the item volume, not transaction count.
I think you are quite correct. Number of transactions is a meaningless number anyway. I'll fix this to state what it means correctly.
- When querying using station_info, in the returned document station_id is null
Ah, yes, this is an unfortunate artifact of not saving the station id when orders are added together. This will probably change some day, but as you already know what station it is when querying, it isn't exactly high on my list of priorities.
- How are you estimating the sell/buy percentages?
Using magic! No, the calculation is simply to see whether the average lies more in the direction of the highest transaction that day, or the lowest transaction that day. High has a good chance of being sell, low has a good chance of being buy.
- I'd very much like to have the historical data expanded to have a row per day, instead of just one averaged for the whole period. Would you consider doing that?
I thought this was already possible! Where the hell has my history API gone... Anyway, will be added ASAP. UPDATE: Yes! I already had it, but it's not on the API page: http://www.evemarketeer.com/api/history/24698/10000002/xml Developer/Creator of EVE Marketeer
|
Aineko Macx
Royal Amarr Institute Amarr Empire
137
|
Posted - 2012.02.08 19:49:00 -
[426] - Quote
Callean Drevus wrote:- I'd very much like to have the historical data expanded to have a row per day, instead of just one averaged for the whole period. Would you consider doing that? I thought this was already possible! Where the hell has my history API gone... Anyway, will be added ASAP. UPDATE: Yes! I already had it, but it's not on the API page: http://www.evemarketeer.com/api/history/24698/10000002/xml Awesome! I see you are returning the whole history set there. You might want to introduce a time period parameter (today minus n days) so we can query for just the needed history without making your servers angry |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
91
|
Posted - 2012.02.08 21:37:00 -
[427] - Quote
Filtering the days will probably not make it much faster to load, but it will make it easier on you to use ;) I'll add that to the list of stuff to do :P
In addition, I've added support for character groups today, which will allow me to do some very cool things that some other market programs already do. For more information, see the newsitem on the website. And please report any issues you find. Developer/Creator of EVE Marketeer
|
Domi Etymology
Violent Alternatives C0NVICTED
0
|
Posted - 2012.02.09 01:35:00 -
[428] - Quote
Getting a lot of Quote:Warning: mysql_select_db() expects parameter 2 to be resource, boolean given in /var/www/www.evemarketeer.com/core/lib/cordb/cordb.php on line 38 Warning: mysql_ping() expects parameter 1 to be resource, boolean given in /var/www/www.evemarketeer.com/core/lib/cordb/cordb.php on line 29 Database connection #0 failed
Got it both trying to access the index page, as well as the regions page. You messing around with something at the moment? |
Dragonaire
Corax. The Big Dirty
32
|
Posted - 2012.02.09 06:00:00 -
[429] - Quote
Just to go with the above: EVE Marketeer: Upload unknown problem: Warning: mysql_select_db() expects parameter 2 to be resource, boolean given in /var/www/www.evemarketeer.com/core/lib/cordb/cordb.php on line 38
Warning: mysql_ping() expects parameter 1 to be resource, boolean given in /var/www/www.evemarketeer.com/core/lib/cordb/cordb.php on line 29 Database connection #0 failed
So it's also effecting uploads now Finds camping stations from the inside much easier. Designer of Yapeal for Eve API. Check out the Yapeal PHP API library thread for more information. |
Scrapyard Bob
EVE University Ivy League
673
|
Posted - 2012.02.09 06:42:00 -
[430] - Quote
Dragonaire wrote:So it's also effecting uploads now
Days like these, I just point my in-game browser at either eve-marketdata market scanner page or eve-central's upload suggestions page.
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
92
|
Posted - 2012.02.09 07:28:00 -
[431] - Quote
Damn, the reproduction of the problem is bothering me. I cannot. I'll try to enter a nice new check in the page to see exactly what error is occuring. Seems it had little to do with the mass of errors I fixed in the mysql log.
I suspect my changes to yapeal are to blame. Developer/Creator of EVE Marketeer
|
Dragonaire
Corax. The Big Dirty
32
|
Posted - 2012.02.09 08:24:00 -
[432] - Quote
If it's something with Yapeal contact me and I'll go over it with you to figure it out. Also I've been cleaning some stuff up that might have been causing some slow downs in Yapeal in the last couple days so you might want to look at updating as well. I pushed it to the hg already just haven't updated the archives yet that gets to wait until tomorrow I need to head to bed Finds camping stations from the inside much easier. Designer of Yapeal for Eve API. Check out the Yapeal PHP API library thread for more information. |
6ie
The Kiwis
3
|
Posted - 2012.02.09 12:31:00 -
[433] - Quote
Did you fix the search? Its acting weird - put in Projectile Weapon Rigging You get a page: Could not find 'Projectile Weapon Rigging' Perhaps you meant one of these items?
And it only lists one item... Projectile Weapon Rigging
|
Scrapyard Bob
EVE University Ivy League
677
|
Posted - 2012.02.10 16:20:00 -
[434] - Quote
Database errors are still happening on a regular basis, both in the uploads queue as well as various pages on the website.
At a rough guess, about 1/4 of all uploads are failing, and 10-20% of the web page hits. |
Zifrian
Licentia Ex Vereor Intrepid Crossing
208
|
Posted - 2012.02.10 17:52:00 -
[435] - Quote
I've noticed that some people are having this same error:
Warning: mysql_select_db() expects parameter 2 to be resource, boolean given in /var/www/www.evemarketeer.com/core/lib/cordb/cordb.php on line 38 Warning: mysql_ping() expects parameter 1 to be resource, boolean given in /var/www/www.evemarketeer.com/core/lib/cordb/cordb.php on line 29 Database connection #0 failed
I'm getting this with the API, sometimes it works fine and other times it doesn't.
I added this to EVE IPH a few weeks ago to query the API for average price data. I'm not sure if there is an increase in queries? Let me know if I can help. Maximze your Industry Potential! - Get EVE Isk per Hour! |
Scrapyard Bob
EVE University Ivy League
677
|
Posted - 2012.02.10 19:23:00 -
[436] - Quote
From the uploader over the past few days:
EVE Marketeer - 51.6k EVE MarketData - 68.4k
So EVEMarketeer, which usually runs neck and neck with EMD, is losing about 25% of the upload attempts due to the database error.
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
94
|
Posted - 2012.02.10 19:49:00 -
[437] - Quote
Fixing it now
UPDATE: Should be fixed now. Will continue to monitor over the weekend. Developer/Creator of EVE Marketeer
|
Dragonaire
Corax. The Big Dirty
32
|
Posted - 2012.02.11 05:33:00 -
[438] - Quote
Now I've got to know what you were trying to change in Yapeal that caused the problem but I'll let you do it in a Eve-mail if you want instead of here Finds camping stations from the inside much easier. Designer of Yapeal for Eve API. Check out the Yapeal PHP API library thread for more information. |
Scrapyard Bob
EVE University Ivy League
677
|
Posted - 2012.02.11 06:57:00 -
[439] - Quote
Another wish item for the LP "best loyalty points".
- Sort the two drop-lists in alphabetical order before presenting it to the client.
And another argument in favor of only showing the list of corps that sell a particular LP item rather then every single station.
http://www.evemarketeer.com/item/info/9956
3393 rows returned on the LP Stores tab for that item, which takes a bit to load. :) |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
94
|
Posted - 2012.02.11 08:24:00 -
[440] - Quote
Oh, yes, sorting should be something that is easliy implemented, but very handy to have.
Regarding the LP store items: I agree with you that it should be done on a different corporation page (listing all the stations), the loading is not the issue for me though :P just that 3300 items are not very reasy to browse :) Developer/Creator of EVE Marketeer
|
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
96
|
Posted - 2012.02.12 14:19:00 -
[441] - Quote
Ok, today, fixed the manufacturing page, which had been unreliable for quite some time. I dropped recursive building for the moment, since it made the results look pretty odd. You now see what you see ingame as well. It also takes into account a few edge cases, most notably recycled items and extra materials which also show up in the base materials. This is not as much a feature, as an overdue fix. Developer/Creator of EVE Marketeer
|
Vaerah Vahrokha
Vahrokh Consulting
267
|
Posted - 2012.02.13 11:12:00 -
[442] - Quote
Very minimal issue but I really wish to see your site to be uber super duper extra perfect pro!
Basically you put the Z-order (at least for Firefox 10.1) of the mouse over tool tips in the main page above the Z-order of the items found drop down.
Screen shot with red arrow showing it.
The tooltips that go over the drop down are not limited to the one you see, if you hover the mouse over other headings they also appear above it. Auditing | Collateral holding and insurance | Consulting | PLEX for Good Charity
Twitter channel |
Vaerah Vahrokha
Vahrokh Consulting
267
|
Posted - 2012.02.13 11:21:00 -
[443] - Quote
Another, less minimal issue I just found.
I entered plex then pressed GO and the website displayed a Could not find 'plex' screen. So far so good.
But now I entered plex in the top search box again, I correctly get the drop down choice but then if I click on the "30 days blah blah blah" entry:
- I expect to go in the PLEX page like it did in the past
- Instead nothing happens and the top search box gets filled by a "29668" number, which I suspect is the item ID. And no PLEX page shown. Now I can try typing "plex" all day long and I only get the number. Auditing | Collateral holding and insurance | Consulting | PLEX for Good Charity
Twitter channel |
6ie
The Kiwis
3
|
Posted - 2012.02.13 13:34:00 -
[444] - Quote
The search makes absolutely no sense.
Search: "mega af" and press enter or Go Returns 50+ items, not in alphabetical, or in "most likely" order, most of which do not even have an "af" in their title. "Mega Afocal Pulse Maser I" is 12 lines down, almost off the screen.
How it should work: http://eve-marketdata.com/ Search: "mega af" Drop down of 2 items (the only 2 with "mega af" in their title), allowing you to click the one you want, and it takes you right to that items page.
Even if you get the drop down on EVE Marketeer, and click the item you want - it doesn't take you anywhere.
Oh, and GL going back to modify the text in the search box. |
Scrapyard Bob
EVE University Ivy League
682
|
Posted - 2012.02.13 14:27:00 -
[445] - Quote
Vaerah Vahrokha wrote: - Instead nothing happens and the top search box gets filled by a "29668" number, which I suspect is the item ID. And no PLEX page shown. Now I can try typing "plex" all day long and I only get the number.
Yes, this seems to be a new bug that I hit last night on some other items. However, the search worked if I clicked the "go" button and the ItemID only ended up in the search box if I clicked on the "suggestions" list that shows up under the search box as you type stuff in.
Maybe the search box needs to be smart enough to let us search on item ID numbers? :) |
Aineko Macx
Royal Amarr Institute Amarr Empire
139
|
Posted - 2012.02.13 14:32:00 -
[446] - Quote
Having played with the API in the last days, more feedback:
- For computing buyHighest5% and sellLowest5% you should do some pre-filtering on the orders. Right now, the numbers are often biased by existing but irrelevant orders like the token region-wide buy order for 1 millions units at 0,01isk. There are many ways to do that. A simplistic approach would be to discard buy orders below say -80% of the highest buy order, or something like the median of orders whose remaining volume is smaller than the initial volume and are not older than x.
- When using the station_info API, the datetime column is missing (it's there for the otherwise identical info API).
- I'd really like to a) query up 25 typeIDs in the history API and b) specify the time range. I'd rather do 210 queries that way instead of the current 5247 when I update the history |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
98
|
Posted - 2012.02.13 20:47:00 -
[447] - Quote
- Basically you put the Z-order (at least for Firefox 10.1) of the mouse over tool tips in the main page above the Z-order of the items found drop down.
Ah! Correct, I'll fix this soon.
- I entered plex then pressed GO and the website displayed a Could not find 'plex' screen. So far so good.
Umm, yes, it seems I started working on search, then forgot I was doing so, and started implementing different things. I'll fis these issues tonight.
- Maybe the search box needs to be smart enough to let us search on item ID numbers? :)
It should be, unless I broke it. If so, will fix it now :P
- For computing buyHighest5% and sellLowest5% you should do some pre-filtering on the orders. Right now, the numbers are often biased by existing but irrelevant orders like the token region-wide buy order for 1 millions units at 0,01isk. There are many ways to do that. A simplistic approach would be to discard buy orders below say -80% of the highest buy order, or something like the median of orders whose remaining volume is smaller than the initial volume and are not older than x.
There should be a lot of filtering done even before the orders actually get into the database. I've seen indications before that this wasn't correctly happening, but since I haven't received any reports on it thus far I've let it be. Will put checking this on the agenda for asap. A mechanism much like you describe has been implemented, using the highest buy order (or lowest well) as a measure is a smart thing though, and I'll see if I can add that.
- When using the station_info API, the datetime column is missing (it's there for the otherwise identical info API).
Hmm, yes, this seems somewhat odd. I'll see if I can't add this in an easy way (due to the calculations being done on orders it's not automatically and representatively there).
- I'd really like to a) query up 25 typeIDs in the history API and b) specify the time range. I'd rather do 210 small queries that way instead of the current 5247 when I update the history, pulling like 300MB of csv data in the process
a is probably not going to happen, as the history queries are quite intensive as it is (biggest table in emk). b is on my list for implementation (well, limit, but date range is probably even better) :)
- You are tracking more items in the DB than just the subset WHERE marketGroupID IS NOT NULL AND published = 1. Why?
I shouldn't be, it should even be a little less, as I'm not interested in tech 2 BPO's. Where are you getting this number?
The search makes absolutely no sense.
It actually does, it's just smarter than you, and tries it's best to find things with 'mega' and 'af' in it. It didn't give any preferential treatment to the first time though, nor to both items following eachother, which would be a good addition. Developer/Creator of EVE Marketeer
|
Vaerah Vahrokha
Vahrokh Consulting
271
|
Posted - 2012.02.13 23:42:00 -
[448] - Quote
1) Thanks for all of this effort you are pouring over.
2) If you ever put additional prices sanitizing please make them optional.
There are certain "price spikes" called Pin Bars that are fundamental to every market, they look like "errors" but they are just the buyers / sellers taking liquidity before pushing hard.
Here's an example of PBs of a real market (gold), I marked them with red arrows.
Here is your own website, correctly showing a prominent pin bar for the PLEX market, seen with monthly bars.
Finally, here's your website again, correctly showing another pin bar for the PLEX market, this time with weekly bars.
These elements (expecially on the daily bars) can very easily get lost if you cut data too much and then the graphs become completely useless.
3) A low priority tip: please put a 180 days option in the history candle stick graphs (EvE has it).
4) An improvement for your history graphs: the ability to specify a start (or end) date for the first (or last) bars / dots. So one can ie. analyze 90 days of the market at the end of 2011 instead of being forced to look at today.
Auditing | Collateral holding and insurance | Consulting | PLEX for Good Charity
Twitter channel |
6ie
The Kiwis
3
|
Posted - 2012.02.14 02:07:00 -
[449] - Quote
"Mega Af".....wait..... drops down 2 options.....click..... BAM! Right to the items page. You Rock :) Very nice fix on the searching! Thanks a lot. |
Aineko Macx
Royal Amarr Institute Amarr Empire
139
|
Posted - 2012.02.14 06:13:00 -
[450] - Quote
Callean Drevus wrote:I need specifics on the items where it's going wrong though, that will help with my investigation. Can you provide me with region/type combinations? For instance, the buyHighest5 here: http://www.evemarketeer.com/api/info/26088/csv/10000002
Quote:I shouldn't be, it should even be a little less, as I'm not interested in tech 2 BPO's. Where are you getting this number? Here: http://www.evemarketeer.com/api/region/csv/10000002
I track this subset myself, which are all available market items minus BPs, skills, reactions and supercapitals:
SELECT typeID, g.groupID, g.categoryID, typeName FROM invTypes t, invGroups g WHERE marketGroupID IS NOT NULL AND t.groupID = g.groupID AND t.published = 1 AND g.categoryID NOT IN(9, 16, 24) AND g.groupID NOT IN (30, 659) |
|
|
|
|
Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 [15] 16 17 18 19 20 .. 21 :: one page |
First page | Previous page | Next page | Last page |