Pages: 1 2 3 4 5 6 7 [8] 9 10 11 12 13 14 15 16 17 18 19 20 .. 21 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
39
|
Posted - 2011.12.17 23:36:00 -
[211] - Quote
Ah, yes, I've seen it, and it's been lodged firmly in the back of my mind since then :P
As to the not uploading anymore issue, that is probably (as I've found after a day of uploading) because there is nothing for the uploader to upload anymore. After cycling trought the entire market, the uploader starts anew, but if the same EVE client is running, and nothing has changed in the market information, the cache file isn't rewritten, thus there is nothing for the uploader to do. To check this, your best bet would be to manually lookup Tritanium and see if the uploader responds to that, if it doesn't, try buying one unit of Trit and see if it works then (I'll refund it ). If it doesn't, then something is very certainly broken.
Of course, it could be that it suddenly starts uploading again when you restart the upload client, which is a practical guarantee of something going wrong. Developer/Creator of EVE Marketeer
|
Dragonaire
Corax. PURgE Alliance
23
|
Posted - 2011.12.17 23:55:00 -
[212] - Quote
Quote:Of course, it could be that it suddenly starts uploading again when you restart the upload client, which is a practical guarantee of something going wrong. That what I had happening also if I finish doing say the Tech II BPOs then decide I only had time also do something like Minerals it would not restart uploading anything until restarted. Finds camping stations from the inside much easier. Designer of Yapeal for Eve API. Check out the Yapeal forum thread |
Scrapyard Bob
EVE University Ivy League
457
|
Posted - 2011.12.18 07:52:00 -
[213] - Quote
Callean Drevus wrote:I know, I've been having these messages for the better part of the day, and my uploader still hasn't crashed...
What does it do? Does it simply hang? Or does it seem to not do anything anymore (but still being responsive)?
It just keeps crashing on Win7 64bit - minimized, not minimized. I'm running 4 clients at it at the same time, so it's under a bit of stress. But it never uses much CPU and stays with a peak working set of about 39MB. It can run for an hour and not crash, or crash after 5 minutes, no set pattern - which means it's probably reacting to either a particular item, or a network condition when talking to the end point servers.
I can't tell whether the errors are related to the crash or just background noise, but it's the only thing showing up in the log files.
|
Dragonaire
Corax. PURgE Alliance
23
|
Posted - 2011.12.18 08:33:00 -
[214] - Quote
I'm also running on Windows 7 64 bit if that helps and I can't say I've had it crash really just stop uploading etc. Finds camping stations from the inside much easier. Designer of Yapeal for Eve API. Check out the Yapeal forum thread |
Scrapyard Bob
EVE University Ivy League
457
|
Posted - 2011.12.18 09:09:00 -
[215] - Quote
Not sure then - will do a fresh install folder and see what happens.
When I do my uploads overnight, I run multiple clients, all from the same cache directory. Sometimes 2 in the same region.
The new upload page does seem to be much better behaved and doesn't stop working like the old one did. (Nice "Christmas" theme *grin*) |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
40
|
Posted - 2011.12.18 09:22:00 -
[216] - Quote
Seems like I'll have to grab my old and dusty two alts then to do a bit of stress testing on the uploader, it must be related to uploading from multiple accounts at the same time.
And thanks, I very much like the theme too Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
457
|
Posted - 2011.12.18 18:26:00 -
[217] - Quote
Mine paused uploading today, new error message:
Traceback (most recent call last): File "Classes.pyo", line 427, in run AttributeError: 'NoneType' object has no attribute 'find'
Also, I finally got the EMK uploader to fight over a cache file with the EMD uploader and got this in the file reader log file:
Traceback (most recent call last): File "Classes.pyo", line 310, in run File "Classes.pyo", line 339, in addNewFiles IOError: [Errno 13] Permission denied: 'C:\\Users\\ScrapyardBob\\AppData\\Local\\CCP\\EVE\\c_program_files_(x86)_ccp_eve31024_tranquility\\cache\\MachoNet\\87.237.38.200\\301\\CachedMethodCalls\\7d4d.cache'
|
Domi Etymology
Violent Alternatives C0NVICTED
0
|
Posted - 2011.12.19 08:04:00 -
[218] - Quote
oh god, what did you do? the market page just keeps giving me gypsy and noble implants to attempt to upload, except there's none on the market, hence no uploads...... |
Scrapyard Bob
EVE University Ivy League
459
|
Posted - 2011.12.19 15:10:00 -
[219] - Quote
Domi Etymology wrote:oh god, what did you do? the market page just keeps giving me gypsy and noble implants to attempt to upload, except there's none on the market, hence no uploads......
Looks like it might need some tuning. (I often switch between using eve-marketdata's scanner page, eve-central's page, and EMK's page through the week.)
Thinks about the numbers... There are 6922 possible market items, 3.5 seconds per item. In an ideal world, that means you can scan the market with a single alt in the space of 6.73 hours (5.77 hours w/ the 3 sec version, but that breaks). If we have (2) bits of information (last upload, last handed out), then we need to penalize items that haven't updated recently and which have also been handed out recently. Logic dictates that you should create a 3rd field to handle this desired result and call it "next possible queue time", which makes the market scanner's page a lot simpler.
LUT = last upload time stamp (defaults to something like the start of the epoch, or something like January 2000) LHO = last handed out time NQT = next queue time (defaults to start of epoch)
NQT should be updated when either an item is handed out, or a successful upload arrives.
LHO event -> set NQT to current time + cuberoot(# hours since LUT / 25) + random(1800 seconds) - So as items are handed out, they get pushed down deeper into the stack, which will bubble other items up to the top. - Adds a bit of randomness to move things up/down by a maximum 15 minutes - The "25" divisor gives good results for items which are only seen once a year (bumps them by 7.05 hours)
LUT event (successful upload) -> set NQT to current time + 8 hours + random(4 hours) - When an item is successfully uploaded, it needs to move down towards the bottom of the stack - Since the 6922*3.5 sec = 6.73 hours, the magic number is 8 hours plus up to 4 hours
Now for the reason that we use a NQT field instead of looking at the LHO/LUT fields when figuring out what the market scanner should hand out next. When the market scanner page needs to pull 20 items to hand out, it should query the item field, sorting on NQT in ascending order, top 20 items. This way, you always get 20 items, even if the NQT values are hours/days into the future.
|
Scrapyard Bob
EVE University Ivy League
459
|
Posted - 2011.12.19 17:21:00 -
[220] - Quote
Callean Drevus wrote:Seems like I'll have to grab my old and dusty two alts then to do a bit of stress testing on the uploader, it must be related to uploading from multiple accounts at the same time.
I can trigger it by using the EMD market scanner page, using just two accounts - even if the accounts don't share a cache directory. More simultaneous accounts just triggers the bug faster / more often. |
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
41
|
Posted - 2011.12.20 20:26:00 -
[221] - Quote
Ok, now testing scanning with multiple accounts. At the very least I've found the error that was producing the EVE central errors. Now I'm seeing the EVE Marketdata timeout errors (upload within 15 minutes), so I can do something about those I hope. What I fail to understand is how my fifo queue can upload some orders correctly, only to fail on the next one...
UPDATE: Ok, rewriting the filereader led me to probably find what was causing the uploader to hang. It found a lot of files which it wasn't able to do anything with. But these files kept heaping up, because it didn't delete them, leading to what were probably immense times for scanning files. In any case, I'll keep scanning and see what happens.
UPDATE 2: The uploader get's better and better. It's now uploading into the future I've got more uploads than file reads . I guess something is still going wrong with threading. Developer/Creator of EVE Marketeer
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
41
|
Posted - 2011.12.20 22:48:00 -
[222] - Quote
I've uploaded a new version of the uploader. I hope this one improves stability, but it's still a bit stabbing in the dark, since I've yet to receive the errors myself.
And: Quote:oh god, what did you do? the market page just keeps giving me gypsy and noble implants to attempt to upload, except there's none on the market, hence no uploads......
I'm sorry, I was sorting in the wrong direction Developer/Creator of EVE Marketeer
|
Domi Etymology
Violent Alternatives C0NVICTED
0
|
Posted - 2011.12.21 03:37:00 -
[223] - Quote
serves you right for writing code while standing on your head.
The new images showing the item list of what's being scanned/uploaded are sweet :) |
Scrapyard Bob
EVE University Ivy League
460
|
Posted - 2011.12.21 15:36:00 -
[224] - Quote
I'll beat on the 0.4 version of the uploader today.
Also, the market scanner page seems a bit odd still when viewed in the in-game browser. Sometimes the icons go down the left side of the page, other times they just go in a line across. Could be browser width issues. (Will try and figure out more later.) |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.21 16:00:00 -
[225] - Quote
That might be caching issues, but I'm not sure. Only time I've seen something like that was the first time I loaded the page. Developer/Creator of EVE Marketeer
|
Controller Vrelk
New Eden Regimental Navy Rebel Alliance of New Eden
2
|
Posted - 2011.12.21 19:30:00 -
[226] - Quote
Domi Etymology wrote:serves you right for writing code while standing on your head.
The new images showing the item list of what's being scanned/uploaded are sweet :) Yea, just noticed them. Let me guess, I gave him the idea. |
Scrapyard Bob
EVE University Ivy League
461
|
Posted - 2011.12.21 20:13:00 -
[227] - Quote
Callean Drevus wrote:That might be caching issues, but I'm not sure. Only time I've seen something like that was the first time I loaded the page.
Yes, possibly cache issue, the site is now behaving on the clients where I'm running them at 1024x768 (so the browser window is only around 850-900 wide.
So far 0.4 of the uploader is passing with flying colors at keeping up with (3) simultaneous market scan clients running. Memory peaked out at around 62.4MB, CPU usage has been negligible. I've uploaded about 14k to each of the (3) endpoints in today's session.
I used EMD's scanner site for most of the day, but will switch over to using the EMK's scanner tomorrow.
Other small notes:
- The XML/JSON/CSV links on individual item pages all point at the "xml" version of the URL
- The location of the regional drop down still feels too far out of place in the upper right, maybe it should be where the item's icon is on an individual item's page. This would probably force you to move the item's icon to the left side of that area.
- Price history graphs look like they broke 3 weeks back and haven't updated.
- It would be nice if I'm on a particular item's page (say Tritanium) that I could click on a link next to the item's name (such as "Minerals") which would take me to a market group summary page for that particular item.
- Longer term wish, being able to see an entire market group (i.e. "Minerals"), with the individual items down the left and the top 5 market regions identified as column headers with the 5% buy/sell prices as the cell contents. Ignoring issues with color blindness, if values where the individual region is 5% above/below the average of the top-5 market price was colored green/red, that might be useful. Prices listed would only need to have about 4-5 decimal places of precision. This means you could switch to "k", "M", "B", "T" suffixes to trim digits off the tail end. The average price in the entire grid should control which suffix to use (up to 50,000 use no divisor, up to 1M use the 'k', up to 1B use the 'M', up to 1T use the 'B'). So you would get numbers like 4385.20, 43850.20, 438.52k, 4.3852M, 43.852M, 438.52M, 4.3852B, 43.852B, 438.52B, 4.3852T, etc.
|
Scrapyard Bob
EVE University Ivy League
461
|
Posted - 2011.12.22 18:26:00 -
[228] - Quote
0.4 is still working fine, even with multiple clients running (same region, same cache folder, etc.). Zero errors in the log files now. The market scanner page also continues to perform well.
Minor requests for the 0.4 client:
- Add a "restore" option to the right-click menu of the system tray icon. - When I double-click on the sys tray icon, it always comes back to the foreground in a minimized state. - Upload keys might need to be moved out of "config.ini" and into a "user.ini".
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.22 22:02:00 -
[229] - Quote
Yes, very feasible requests all. I'll see when I'll be able to incorporate them into the codebase. Currently incredibly busy with RL and being sick again.
UPDATE: Also very happy to hear that the uploader is still performing perfectly :)
UPDATE 2: Also, PERL and especially CPAN are absolutely terrible... Developer/Creator of EVE Marketeer
|
Dragonaire
Corax. PURgE Alliance
25
|
Posted - 2011.12.23 17:24:00 -
[230] - Quote
Quote:UPDATE 2: Also, PERL and especially CPAN are absolutely terrible... Turn away from the dark side ... Finds camping stations from the inside much easier. Designer of Yapeal for Eve API. Check out the Yapeal forum thread |
|
Controller Vrelk
New Eden Regimental Navy Rebel Alliance of New Eden
2
|
Posted - 2011.12.23 18:57:00 -
[231] - Quote
I am not getting any errors, but every so often I will open the uploaded and it will not upload anything (0.4). Restarting does not help and I do not have any other uploaders running. It was working last night before downtime, but today it is not uploading anything.
PS: I am disappointed that you didn't make a version 3D. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.23 19:01:00 -
[232] - Quote
There simply might not be anything to upload (even if the upload suggestions are still happily cycling, if nothing has changed since last time, nothing will be uploaded). The EVE client won't even write a cache file, so the uploader does nothing at all. Developer/Creator of EVE Marketeer
|
Controller Vrelk
New Eden Regimental Navy Rebel Alliance of New Eden
2
|
Posted - 2011.12.23 19:22:00 -
[233] - Quote
Callean Drevus wrote:There simply might not be anything to upload (even if the upload suggestions are still happily cycling, if nothing has changed since last time, nothing will be uploaded). The EVE client won't even write a cache file, so the uploader does nothing at all. That was it, good to know. I cleared my cache just to see if that was it, and it was. I thought the uploader deleted the cache files after uploading them. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.23 19:35:00 -
[234] - Quote
Controller Vrelk wrote:That was it, good to know. I cleared my cache just to see if that was it, and it was. I thought the uploader deleted the cache files after uploading them.
It does delete the actual file, but it doesn't clear the same cached information inside the EVE client, which for some reason also saves a copy of the data in it's memory
Why it writes the cache file to disk and additionally stores an in memory copy in addition is a big questionmark to me, but I'll happily make use of it Developer/Creator of EVE Marketeer
|
Controller Vrelk
New Eden Regimental Navy Rebel Alliance of New Eden
2
|
Posted - 2011.12.23 21:36:00 -
[235] - Quote
Hmm. I left and had the market scanner running for about 2-3 hours. I just got home and found that the uploader had only uploaded 20 things, and this is after I cleared my cache.
EDIT: The market scanner on you site seems to be going in circles, it is scanning the same things over and over. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.23 21:48:00 -
[236] - Quote
Are you certain it is going in circles? I cannot duplicate this behaviour... It should be easy to test by seeing if the items that are shown first are different if you refresh the page. Developer/Creator of EVE Marketeer
|
Controller Vrelk
New Eden Regimental Navy Rebel Alliance of New Eden
2
|
Posted - 2011.12.23 21:52:00 -
[237] - Quote
Callean Drevus wrote:Are you certain it is going in circles? I cannot duplicate this behaviour... It should be easy to test by seeing if the items that are shown first are different if you refresh the page.
When I left I saw a weathe blueprint and a quantum flux generator 3 go by, when I came back and noticed that it had uploaded 20 items I watched for a minute and saw the same things go by. |
Controller Vrelk
New Eden Regimental Navy Rebel Alliance of New Eden
2
|
Posted - 2011.12.24 07:35:00 -
[238] - Quote
Warning: mysql_ping() expects parameter 1 to be resource, boolean given in /var/www/www.evemarketeer.com/core/lib/cordb/cordb.php on line 29 Database connection #0 failed
4200 uploads to EMD and EC, 407 to EMK |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
42
|
Posted - 2011.12.24 09:52:00 -
[239] - Quote
Hmm, for some reason mysql decided that it'd had enough. More, the server seems to have decided it was enough, and it has been rebooted by my hosting provider because it was unresponsive. (Now, that is awesome, except that mysql didn't work afterwards). Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
461
|
Posted - 2011.12.24 13:16:00 -
[240] - Quote
Windows XP error (trying to install on the laptop, where it's never been installed before).
Traceback (most recent call last): File "emkUploader.py", line 19, in (module) File "wx\_core.pyo", line 7981, in __init__ File "wx\_core.pyo", line 7555, in _BootstrapApp File "emkUploader.py", line 11, in OnInit File "UploaderFrame.pyo", line 96, in __init__ File "UploaderFrame.pyo", line 150, in initialize File "UploaderFrame.pyo", line 344, in installationAutodetectButtonClick File "os.pyo", line 423, in __getitem__ KeyError: 'LOCALAPPDATA' |
|
|
|
|
Pages: 1 2 3 4 5 6 7 [8] 9 10 11 12 13 14 15 16 17 18 19 20 .. 21 :: one page |
First page | Previous page | Next page | Last page |