Pages: 1 2 3 4 5 6 7 8 9 10 [11] 12 13 14 15 16 17 18 19 20 .. 21 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
70
|
Posted - 2012.01.16 07:12:00 -
[301] - Quote
It seems sensible enough, just wrong. But I'll take a look at the unified uploader, and fix this. Thanks for the report :) Developer/Creator of EVE Marketeer
|
6ie
State War Academy Caldari State
0
|
Posted - 2012.01.16 16:58:00 -
[302] - Quote
I run 3 eve clients at once, all scanning the market. The cache folder grows to 5,000 files, then EVE starts deleting them. I think the uploader runs ok when I have 1 client running. Possibly the uploader cant handle 3 clients at once?
Zeropoint reader shows about 99% of the files are being deleted, but either they are not, or they are being missed by the uploader. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
70
|
Posted - 2012.01.16 17:19:00 -
[303] - Quote
Can you check the log files in the installation folder and see if you find anything unusual? Developer/Creator of EVE Marketeer
|
6ie
State War Academy Caldari State
0
|
Posted - 2012.01.16 17:49:00 -
[304] - Quote
(Using: Unified 0.4b) This is the folder that has the 5000 files: MachoNet\87.237.38.200\303\CachedObjects
All 4 log files in the uploader dir just read: Logger started
|
Scrapyard Bob
EVE University Ivy League
609
|
Posted - 2012.01.16 19:31:00 -
[305] - Quote
6ie wrote:Possibly the uploader cant handle 3 clients at once?
It shouldn't have an issue like that - I used to break 0.3 and 0.4 all the time with running (3) clients. But since 0.4b, haven't had a lick of trouble with the uploader (even with 3 clients, all feeding the same cache folder, or running off of diff cache folders, same region, diff region). So far, 5 days running, 235k files read, 234k files deleted by the Zeropoint reader.
But I'm on Win7 64bit.
I show about 20.4k files in my MachoNet cached objects folder. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
70
|
Posted - 2012.01.16 20:20:00 -
[306] - Quote
Ah, yes, the uploader doesn't really care about CachedObjects at all, the only thing it's interested in is CachedMethodCalls, which should be empty.
I take it it is uploading okay otherwise? With the exception of your CachedObjects folder staying full (which the uploader is not having any effect on)?
Also EVE Central might have some trouble keeping up with the uploads you are doing if you're running 3 clients at the same time, it'll just permanently stay at a queue of 50 items, and discard any excess.
@Kaladr: Fixed the URL scheme, will be included in the next iteration of the UU.
UPDATE: For those of you reading this, EMK likes it when you request item information in batches of 25 instead of one at a time :P or even better, if you're going to request them anyway, all the items in the region at the same time (and discard some of the information).
Also, I wonder who the person is that is uploading 4 orders per second with (seemingly) the old uploader, may have to add the user agent string to the uploader too. Would be able to make more sense of the access log that way. Developer/Creator of EVE Marketeer
|
6ie
State War Academy Caldari State
0
|
Posted - 2012.01.16 21:48:00 -
[307] - Quote
Ah ok, yeah i see the files come and go from CachedMethodCalls. I also see EVE Central: unable to upload in the log I don't know why CachedObjects gets so many objects - I guess I will just del them periodically.
Is there a way you can code the uploader can not del the cache files for X minutes? I like to import the cache files to Evementat (and eventually to a MYSQL DB with Reverence), but the cache files get deleted by the uploader. (or add an option to no del them at all). |
Kaladr
Dreddit Test Alliance Please Ignore
19
|
Posted - 2012.01.16 22:36:00 -
[308] - Quote
Callean Drevus wrote: Also EVE Central might have some trouble keeping up with the uploads you are doing if you're running 3 clients at the same time, it'll just permanently stay at a queue of 50 items, and discard any excess.
@Kaladr: Fixed the URL scheme, will be included in the next iteration of the UU.
Thanks :)
And I demand of myself to fix the upload performance hole.
Creator of EVE-Central.com, the longest running EVE Market Aggregator |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
71
|
Posted - 2012.01.17 06:54:00 -
[309] - Quote
Jup, the next thing I will add to the uploader is the ability to either move or not delete the cache files. It was just the easiest solution to delete them at first :) Developer/Creator of EVE Marketeer
|
Endeavour Starfleet
Center for Advanced Studies Gallente Federation
550
|
Posted - 2012.01.17 08:45:00 -
[310] - Quote
Please forgive me if you have already answered this but...
Is there a way by chance to develop something in EM that helps you find the best use of LP? I realize that it will mean manually inputting prices for the faction items but I was curious if it is possible to do it with this? |
|
6ie
State War Academy Caldari State
0
|
Posted - 2012.01.17 15:41:00 -
[311] - Quote
Callean Drevus wrote:Jup, the next thing I will add to the uploader is the ability to either move or not delete the cache files. It was just the easiest solution to delete them at first :)
Nice, thanks :) BTW, how are the credits per upload calculated? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
71
|
Posted - 2012.01.17 20:09:00 -
[312] - Quote
Damn, the forums ate my post again :S
As far as I know there is no way to retrieve either LP or faction prices (contracts) from the database. That means I could build something that allows you to input your own data, but it'd be kind of pointless. If the data is somewhere in the SSD though, it could be useful.
@6ie: Is mentioned somewhere on the previous page, basically means, the more influence your uploads have on the state of the market, the higher the reward. Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
615
|
Posted - 2012.01.18 04:02:00 -
[313] - Quote
http://prices.c0rporation.com/
Looks like you have to hand-submit prices for items sold via contracts. Not sure whether viewing a contract causes it to be written out to a cache file.
(Can't think of any other faction price sites off-hand.) |
Endeavour Starfleet
Center for Advanced Studies Gallente Federation
562
|
Posted - 2012.01.18 06:50:00 -
[314] - Quote
Callean Drevus wrote:Damn, the forums ate my post again :S
As far as I know there is no way to retrieve either LP or faction prices (contracts) from the database. That means I could build something that allows you to input your own data, but it'd be kind of pointless. If the data is somewhere in the SSD though, it could be useful.
@6ie: Is mentioned somewhere on the previous page, basically means, the more influence your uploads have on the state of the market, the higher the reward.
I would figure an input window that says "Enter sell price" For a group of LP store items of your choosing. It then knows what said items cost in LP isk and then goes to the market DB to find region prices for tags and other items that can be retrieved.
Then it will tell you LP efficiency from those group of prices.
I know it wont be very accurate. Just faster than having a spreadsheet or having to write down the tag prices every time I want to do a rough calculation. |
Trin Dainos
0
|
Posted - 2012.01.18 11:03:00 -
[315] - Quote
Don-¦t know if this question has been asked already, but I-¦d like to know how you get the movement data? Do you just use the historical date you got? But than also canceled orders would be in there, right? |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
72
|
Posted - 2012.01.18 11:23:00 -
[316] - Quote
The history data that is provided by CCP is based on transactions, so that is a fairly accurate indicator of the movement of the market. I do some more interesting things, like checking whether the average over time is closer to the highest or lowest price to determine whether there are more buy or sell orders being filled.
Today I found out that Jitanomic, the bot driven market information website had the information on loyalty points. I've tried to find it in other places, but wasn't able to find it, which must mean that it isn't normally available. Having no compunctions whatsoever about leeching off a known botter, I proceeded to scrape the website, which is now happily running :P
Hopefully means I will have some information on loyalty points, making only the faction item prices an issue of manual input. Developer/Creator of EVE Marketeer
|
Endeavour Starfleet
Center for Advanced Studies Gallente Federation
564
|
Posted - 2012.01.18 11:33:00 -
[317] - Quote
Um instead of getting that info from a site you say is run from bots why not ask CCP if there is a way to gather that info from API or something?
And I don't mind putting in the amounts info a box during the calculation if that is needed.
Edit: Seriously how about we just send you the data on the LP items and you can update it. 90 percent of the battle is diving into the market and running the calculations to find isk per lp. Anyone actually using the data should check to make sure the requirements are the same before buying the LP item.
That would allow you to avoid having to use another site's data. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
72
|
Posted - 2012.01.18 11:46:00 -
[318] - Quote
The reason for that is pretty simple. I've found no way to get the data from the API, nor from the static data dump. CCP doesn't make a habit of providing data to a single person (as in I've never heard of it happening), so the easiest solution available is getting the data from someone else.
I could ask CCP whether I have missed something, but I estimate they'll answer with 'not possible'.
This saves me both the time and trouble looking for it. That said, will have to verify it is actually accurate, there is a number of websites containing the information already, but they're either not up to date, or inaccurate (entered by players). Developer/Creator of EVE Marketeer
|
Endeavour Starfleet
Center for Advanced Studies Gallente Federation
564
|
Posted - 2012.01.18 12:13:00 -
[319] - Quote
How about you can start the feature with having us input the stuff ourselves while you make a topic in the forum asking if said data is retrievable?
Then maybe you can see if people will send screenshots of the LP page and use that to start filling in a database. If someone wants something added they need to provide a screenshot of the LP store showing the item in question. Tho I will be happy to move around to help fill holes if it is requested.
I personally think it is a hell of alot better than relying on any kind of bot to do this. And community involvement will help grow your site in my opinion.
If it falls flat on its face you could always go back to your original plan right?
|
Endeavour Starfleet
Center for Advanced Studies Gallente Federation
564
|
Posted - 2012.01.18 12:26:00 -
[320] - Quote
Wanted to show an example of what I was talking about
http://i.imgur.com/tz5ZV.jpg That was done in about 30 seconds copy pasta into paint with a crop. What I can do in gimp is put one on top of the other to get a big image that spans half or all the LP store at once. Then use extreme JPEG compression to keep it small. |
|
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
74
|
Posted - 2012.01.18 19:50:00 -
[321] - Quote
You must be kidding, I'm not going to do that to myself (creating OCR?), or to you guys.
I should probably make something clear. I'm not relying on ANY bot to get the data.
I've retrieved it once from the website, and now I can use it forever (unless CCP changes LP prices). In addition, for all I know the original data was obtained in a perfectly legal way, there is no way for me to know. The only reason I think it might have been obtained by bot is that the owner of the website in question freely admitted to botting and code injection on his/her blog.
That said, it's probably a good idea to send CCP a petition questioning whether it is alright to go ahead and use it, before I get my ass banned because I was too lazy to ask :P Developer/Creator of EVE Marketeer
|
Endeavour Starfleet
Center for Advanced Studies Gallente Federation
578
|
Posted - 2012.01.19 05:14:00 -
[322] - Quote
Even if it is somehow greenlighted (I personally doubt it) Does it not set a very bad example using data from a site that admits to breaking the EULA?
What do you need to match that data? To avoid you having to use such questionable data in my opinion I am willing to start typing out the data myself. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
74
|
Posted - 2012.01.19 07:25:00 -
[323] - Quote
In this case, I do not think it would be bad to use the data. There are other sites containing the exact same information, where I could've gotten it from too. Besides, I do not think this really constitutes an unfair game advantage, so there is no reason for the data to not be public anyway (in my opinion). Besides CCP time limitations anyway.
Using data from third parties only bothers me if I can think of ways to misuse it. Anything that saves typing and generally decreases the amount of spreadsheet fu involved is a generally a good thing in my opinion.
Anyway, a petition has been sent. Now I just have to wait for the results. Developer/Creator of EVE Marketeer
|
Endeavour Starfleet
Center for Advanced Studies Gallente Federation
594
|
Posted - 2012.01.19 08:30:00 -
[324] - Quote
Well in the meantime I have been typing away for hours here to give you the complete CONCORD LP store data.
Even if you decide to use that data from a botter. I will continue to gather this data so you can replace it with legit and cleanly made data from the community.
I will start with CONCORD obviously.
Then the Faction Navy
Then others.
BTW y u no in game or in your channel so we can talk about this?
Edit: Had a connection issue but I had saved! Whew! |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
74
|
Posted - 2012.01.19 16:56:00 -
[325] - Quote
I advise you to wait with writing out the data until I can fabricate a web form. Otherwise I might not be able to parse it. Developer/Creator of EVE Marketeer
|
Endeavour Starfleet
Center for Advanced Studies Gallente Federation
598
|
Posted - 2012.01.20 00:02:00 -
[326] - Quote
Callean Drevus wrote:I advise you to wait with writing out the data until I can fabricate a web form. Otherwise I might not be able to parse it.
That is fine. What I would like to request tho is it be made into a form that I can copy pasta over and over again filling the info. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
74
|
Posted - 2012.01.21 13:22:00 -
[327] - Quote
Ok, got something else updated today. The market scanner page now allows you to choose between history and order uploads (be sure to use the same setting for the market window in your client!), and dynamically shows how well updated a given region is. You can now see your contribution actually mattering again. Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
631
|
Posted - 2012.01.21 14:27:00 -
[328] - Quote
I prefer the old "start/stop" button being on the far right edge - made it easier to pause the updating because I could set things up so that the browser was still visible behind the market window. (This matters more on 1024x768 client windows, where space is limited.)
I'm also curious whether you can tone down the frequency of update for the 3.5 sec counter, maybe only update every 0.5 seconds. It now seems to cause graphical lag issues, even when the clients are minimized. |
Callean Drevus
Icosahedron Crafts and Shipping Silent Infinity
75
|
Posted - 2012.01.21 14:39:00 -
[329] - Quote
Have you had the lag issue before? I never heard anything about it before, and it seems to work perfectly here. At least have not noticed any oddities.
Anyway, the start stop button was ugly, but I might add it again next to the group dropdown if it's really a problem. Isn't it still possible to set it up so that it works by just switching the window positions (Market on the right hand side, browser left)? Developer/Creator of EVE Marketeer
|
Scrapyard Bob
EVE University Ivy League
631
|
Posted - 2012.01.21 14:58:00 -
[330] - Quote
I'm not entirely convinced that it's EMK's site that is doing it, I think one of the recent updates to the EVE client borked things. It used to be that when I minimized a market scanning window, the EVE client went from using 80% of a CPU core down to about 20-30% of a single CPU core. Now, the EVE clients are a lot more piggy about using the CPU - so it may be a CCP thing.
As long as the start/stop button is as far left/right as possible in the browser window, I can adjust. The advantage to having it on the right side is that the browser's "close" buttons are then available in cases where the client is laggy and hitting the "stop/pause" button doesn't seem to be working. If I put the browser left and market window to the right, the market window covers up those minimize/close window controls (making it harder to shutdown the IGB if it's laggy).
Also, this started yesterday on the group summary pages: http://www.evemarketeer.com/item/group_summary/78 MYSQL ERROR OCCURRED: Unknown column 'ji0.sell' in 'field list' |
|
|
|
|
Pages: 1 2 3 4 5 6 7 8 9 10 [11] 12 13 14 15 16 17 18 19 20 .. 21 :: one page |
First page | Previous page | Next page | Last page |