|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
0
|
Posted - 2012.04.26 16:04:00 -
[1] - Quote
EVE Stats - https://ohheck.co.uk/EVEStats/home.php
What is EVE Stats?
EVE Stats is a free wallet graphing utility. It graphs your wallet, sell orders and escrow with great detail for long periods of time. Corp wallets can also be graphed. Sample graph: Mayuko Sisters' Trading Enterprises Ltd.
Who is this tool intended for?
This is most useful for traders, but can be used by anybody. For instance if you have a hard trading night and your wallet hits 0, you can review the EVE Stats graph to see if your market escrow changed during that period, or to see how long your wallet was empty for. It also enables you to see patterns of buying and selling, and to identify the times which your items sell the best.
What's the difference between EVE Stats and any other wallet grapher?
EVE Stats aims for the maximum possible precision when graphing your wallet. We collect data at nearly the maximum rate allowed by the API (one snapshot every 5-15 minutes).
Other features?
We have a richlist for comparing your wealth to everybody else. You may opt-out of this if you want.
EVE Stats has been in closed testing (read: I couldn't be bothered to finish it) for over a year and I am pleased to announce it will now be opening to the public. Most of the pages you see on the site have been created in the last few days, so please report any bugs you find.
|
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
2
|
Posted - 2012.04.26 21:44:00 -
[2] - Quote
Thanks for the feedback.
Lord Drokoth, I've set your graph to public as requested. For future reference the control is on the "Home" page when logged in, and you can also access a private graph with the special link provided on the graph page (which doesn't require you to log in). |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
2
|
Posted - 2012.04.27 14:43:00 -
[3] - Quote
Looks fine to me. The buy/sell order information isn't updated as frequently as the wallet data, so when you first make your graph it may appear that you only have wallet for a while. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
2
|
Posted - 2012.04.28 23:21:00 -
[4] - Quote
Hi Tubrav, some of the code is quite new and untested so thanks for letting me know where the problems might lie.
The first issue you mentioned is your graph not appearing immediately after you sign up, this is because the whole system is a bit delayed in fetching your API information, which I'll admit isn't very user friendly. I'll have a look and see if I can improve this one.
Regarding the second issue, that's a rehashing of the first one. The wallet data API call has a different caching time to the market data one, which means the wallet and market data are out of sync, so when you first sign up you see your wallet data before your market data. For reasons I won't go into the script which works out your total worth uses more up to date data than the graphs, so you see that 5.6b figure before the points appear on the graph. Looking at the graph now you appear to have quite a few datapoints, and it looks like the total seems to match. Let me know if the figures are correct. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
3
|
Posted - 2012.04.29 00:19:00 -
[5] - Quote
Unfortunately CCP doesn't provide historic data for wallet or market orders, so it's impossible for me to show you how your wallet looked in the past :(
The graphs you see that go back much further have been members of the site for months, the oldest ones are my beta testers. My own graph is 9 months old :)
In other news: I split the list of graphs (the one you see when you're logged in) onto its own page, it didn't make sense to put it on the homepage. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
3
|
Posted - 2012.04.29 00:58:00 -
[6] - Quote
Yeah a few people have suggested asset wealth. Currently the system is gathering asset data, but there's no code to calculate asset prices and display them. Calculating the price of an asset is rather difficult as CCP doesn't give out market data, but luckily eve-central has median prices, so it should be possible. I'll see about doing it next week I think, got a few other things to tidy up before then. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
3
|
Posted - 2012.05.07 19:51:00 -
[7] - Quote
Some news:
I've spent a few days working on getting asset wealth added to the site after several suggestions from users. Asset graphs are still being tested, but I've added a page which lists your top assets along with an estimated total price which is available right now. This page "Top Assets" is currently private by default, so you will need to log in to see it. Price data is taken from eve-central.
Make sure your API key supports assets, if it doesn't there won't be any data to display!
Due to all the poorly tested code changes I've made there may be some bugs, so post a reply in this thread if you find any. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.08 14:47:00 -
[8] - Quote
Thanks for pointing out the error. I spotted it myself last night and fixed it.
The 'graph within the graph' for assets has already been created but I've left it in a testing mode for now. Currently there are performance issues as some people have 10000+ assets, and the server takes snapshots of these dozens of times a day which means I end up with millions of database rows to sort through every time somebody tries to view a graph. The solution is to do the same thing I did with market orders and pre-compute a lot of the statistics. Unfortunately this kind of pre-computation means I can't let you change how the asset wealth is calculated very easily.
Anyway I'll let you know when it's working properly and not taking 30 seconds to load a page :) |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.12 14:46:00 -
[9] - Quote
Indeed there was some downtime for a few hours yesterday. This was not entirely within my control, but during this time the server was still collecting data.
After that though I did some upgrades. I improved the performance of transaction handling, and of assets (the final step needed to graph them) however to do this it required me to replay all our old transaction and asset data (think millions of XML files). While handling the transactions one of the work queues filled faster than it was emptying, so new data (which got added to the end of the queue) took hours to show up on the site. The bottleneck was identified and fixed, the queue emptied and the new data showed up.
Due to this slightly unexpected complication I didn't get around to reprocessing our historic asset data into a form that's quick to search and display, but that's the plan for today :). |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.12 19:53:00 -
[10] - Quote
The time on the graph should be UTC, which is EVE time. The graph at the bottom? No idea ! I use it to navigate the main graph though.
Asset wise: I've done most of what I needed to do. Assets are now included in the richlist calculation, and are shown on the graphs with no significant performance penalty.
There are still some significant bugs with the calculations and stuff, and also I've got a lot of data that isn't in the system yet, so I'll add it over the next few days. |
|
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.12 20:14:00 -
[11] - Quote
The bugs at present are to due with blueprints. The API distinguishes between copies and originals in a really annoying way, which means I need to put in a bit of extra effort to get my code to do it. Currently the richlist is treating all blueprints as originals.
Once this gets fixed you'll move back up the richlist, as some of our industrial friends are a lot higher than they should be :)
I would like to include a link to the topAssets page, but currently it's private by default. I'll add a link to the ones which have been set public, but not tonight.
Edit 1: Regenerating some of the statistics now with a new calculation that treats all BPCs as having 0 value. This isn't accurate, but it's going to be very hard to work out a price for them anyway. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.13 22:56:00 -
[12] - Quote
I have added that feautre, but there's no interface for it at present. The graphs accept a URL parameter "samples" which you can use to resample the data (smooth it).
For example, here is your graph with only 5 samples (major smoothing):
https://ohheck.co.uk/EVEStats/graph.php?charID=245869087&samples=5 |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.14 20:06:00 -
[13] - Quote
The graph will consider items in the deliveries tab, and in corp hangars (for corporate keys). Or personal hangars for personal keys. As for the second question, yes, it considers items inside other items (containers, ships, drone bay, cargo, fittings, etc).
Right now the only thing not considered is contracts. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.21 17:10:00 -
[14] - Quote
Staxed, I haven't really thought about that much, hmm. If you enter the keyID / vCode of a new CEO/director of the corp into the signup form what is the exact error? I will work on a solution to this as soon as possible.
Tubrav, considering contracts is a lot of effort, and I basically can't be bothered. If somebody has 234234b on contracts and really wants me to graph them, they can send me some isk :)
|
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.21 18:18:00 -
[15] - Quote
Looking into the updating issue now.
Edit:
Found the issue, and fixed it. Your data should update from now on. Turns out this issue was also causing about 5 new member's data to be delayed.
Thanks for letting me know about the error, I would never have found it otherwise. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.23 16:05:00 -
[16] - Quote
I looked into it, you're right - Asset and order data was being updated, but wallet data wasn't.
If the fetching script encounters an error when calling a particular API call it is programmed to wait 24 hours before retrying to avoid spamming the API, and I think this is what happened in your case. For whatever reason something went wrong (very likely during the deployment of Inferno CCP took the API offline), which caused my script to fail and wait 24 hours. Unfortunately this means there is no wallet data for this time period, but it should resume collecting now, and it will interpolate between the datapoints it has to try and give the best idea of how much you had in your wallet during that time period.
Anyway, you wern't the only person affected, about 500 API calls failed yesterday and are on 24 hour timers. I reset the timers to 0 to speed things up.. maybe 24 hours is too long.
So, sorry about that :( |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.26 18:04:00 -
[17] - Quote
Today I did a bit of performance work, managed to speed up page generation by about 1 second. Currently working on a way to merge multiple characters/corps into a single graph, for people with a lot of alts. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.29 21:21:00 -
[18] - Quote
Hi guys. If you look at the graph pages you'll see I changed a few things around. It's now possible to view multiple characters on a single graph if the EVE Stats accounts are linked beforehand. At present only a few accounts have been linked for testing, take a look at Magnets Inc. for an example. There have also been some performance improvements, maybe amounting to half a second on the loading time of the larger graphs. Oh and you can change the y axis scale, and assets is now above escrow. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.05.29 22:02:00 -
[19] - Quote
Because it used to be the coolest ship in the game, but is now just a giant paperweight. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.06.05 03:53:00 -
[20] - Quote
It is indeed a mystery what that navigator shows. My best guess is that it's showing you the difference between the datasets you've got selected, which is fairly random most of the time (handy, right?).
I'm doing some exams at the moment so there won't be many changes to EVE Stats for at least another 10 days.
Edit: I did notice one bug actually, the richlist has started taking ages to regenerate. If you come to the site and the richlist is blank, just come back in 5 minutes and it should be regenerated. I'll fix this after the exams. |
|
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.06.06 21:01:00 -
[21] - Quote
Cookiez, send the the link to the graph and the range of times you want deleted and i'll sort it out for you :) |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.06.11 21:51:00 -
[22] - Quote
Nice idea. Exams finish in 5 days, so i'll come back then and see if I feel like doing it. Other plans include displaying profit by trade item (for traders), and maybe some kind of graph showing orders completed vs time of day, and maybe some kind of statistics on the main page (e.g. total isk graphed). Taking suggestions. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.06.15 20:17:00 -
[23] - Quote
I've deleted one of your keys, if you had two we'll find out soon enough!
You will need to re-register. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.06.15 22:14:00 -
[24] - Quote
Hi again. Your new graph has only existed for a few hours, and assets are on a 6 hour (!!) cache time (not my fault, change this please CCP), so the script has actually pulled your assets but only has a single datapoint right now, and you can't make a graph with one datapoint :)
tl;dr; come back in 12 hours and complain to CCP. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.06.16 18:37:00 -
[25] - Quote
Umm yeah. There was a slight mistake in the code which meant it bailed if it had data from a character that wasn't in the database. Normally this is no problem, but (at your request) I recently deleted your old key, so the processing scripts crashed overnight due to this bug.
The good news is the bug is now fixed, and the fetching scripts didn't break so it's likely there is actually some wallet data during that time period. Bad news is there's a backlog of 8000 API calls to be processed (they're all in the queue right now), so the site will be a bit unusable for maybe an hour.
So.. sorry! Check back later :(
|
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
4
|
Posted - 2012.06.26 00:49:00 -
[26] - Quote
Yep Drok is right. He's supported the project from the start with solid feature suggestions, so I made him a Gold member to acknowledge that. Gold members have the superpower of being able to troll everybody else who doesn't have a gold star next to their name.
If you want to be one yourself you can donate some ISK, which means I can spend less time in game making the ISK and get a few extra hours to work on the site :) It's purely optional though, you will always get all the same features as normal members.
For anybody following the changes I make to EVE Stats: Recently I've made a few behind the scenes fixes. I fixed some DNS issues which should result in slightly better site availability (though to really fix this I need to move it to a new server), I'm also in the process of replacing a failed hard drive that caused performance issues for one day (nothing loaded because the disk kept retrying). The local SQL backup script was rewritten (err, well, written) to help recover should that SSD fail or otherwise become unavailable (as happened once, some of you may remember). |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
12
|
Posted - 2012.06.28 19:54:00 -
[27] - Quote
You wern't missing anything. The code to let people link and unlink keys has been sitting idle for a while because I wasn't sure it was working properly. I've gone ahead and published it now. If you look at the "My Statistics" page you should be able to see all the accounts yours is linked with, and have the option to link new ones that are already signed up. This may be very buggy though, so just watch out. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
14
|
Posted - 2012.06.29 17:19:00 -
[28] - Quote
Hi, which URLs do you mean? Can you be more specific? |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
20
|
Posted - 2012.06.30 00:05:00 -
[29] - Quote
Well spotted. I investigated and found the problem was an odd duplication bug caused by a particular API not working the way I thought it did, which was causing MySQL to throw exceptions (duplicate primary keys), so no new asset data was being fully added to the assets table, and the asset statistics weren't regenerating. While I was there I also spotted an unrelated bug and fixed it, which will be handy if I ever start graphing asset locations.
Incidentally this bug also caused the "top assets" page to display an incomplete list if you have any containers.
Anyway, the good news is that although the assets haven't been appearing on the graphs, all the raw API call data is saved, so I'm going to delete all asset data and replay the raw data, which should take a few million years to complete, but at least all the data will be there (including the last few days).
During the replay the site may be slow, and the top assets list and graph asset data may appear to be not updating (they are though). If I've made any manual edits to your graphs (A few of you have requested it) these might be undone as the raw data is replayed, just let me know if there's anything else that needs correcting.
Other good news: I improved the asset performance while I was working on it, turns out one SQL query was using 100% of my CPU when it was running, and it typically takes minutes to complete. |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
20
|
Posted - 2012.07.02 17:29:00 -
[30] - Quote
Do you get that message when trying to sign up for EVE stats, or when trying to add this key to an existing account?
If you are adding a new key to an existing account then you need to sign that key up for EVE Stats seperately first.
Generally this message means you've got some extra text in the "Key ID" field. Check there are no spaces, or letters, which would cause the KeyID to be invalid. The KeyID should just be a number. |
|
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
22
|
Posted - 2012.07.05 19:46:00 -
[31] - Quote
It has been suggested that I add an indication of daily/weekly/monthly profit for traders.
Would anybody else find this useful? |
iskflakes
Magnets Inc. Imperial Auxiliares Regiment
22
|
Posted - 2012.07.06 23:26:00 -
[32] - Quote
Industry jobs is one of the holes in EVE Stats right now, the other major one being contracts (contract some assets to someone and EVE Stats won't know about them). There are APIs for both, which means in principle both could be added as new colors on the graph (so you could see your estimated value in industry jobs go up and down).
Currently the way the site is programmed if you've got industry jobs or contracts enabled on your API key it will gather that data, but no code has been written to display it. Maybe at some point in the future I'll bother, but right now I'm not going to.
Estimating profits (and actually asset value) is impossible to do properly for many reasons. Assets do not have a single price, only an estimated price that I have to come up with using eve-central data, and profits depend on so many factors. I don't think it's possible to give more than a rough estimate, but that is still useful, which is why I display it :)
Another feature that's been suggested is a way to tag certain parts of the graph with descriptions, so in your case you could add "Manufacturing job started here" at an appropriate place, and there could be some global tags like "Inferno released here". Haven't decided if I want this feature yet, it could create a lot of unnecessary clutter. |
iskflakes
Magnets Inc.
29
|
Posted - 2012.07.22 23:11:00 -
[33] - Quote
Technical difficulties are courtesy of my DNS provider and their terrible customer service.
Enjoy! |
iskflakes
Magnets Inc.
30
|
Posted - 2012.07.23 15:35:00 -
[34] - Quote
Update: I've setup a new DNS server, EVE Stats should now be accessible again.
There's one bug I know about with historic data from players who have only ever had a single market order up briefly. I'll fix it in the next few days. It won't affect new data. |
iskflakes
Magnets Inc.
32
|
Posted - 2012.07.25 11:03:00 -
[35] - Quote
That gap is present for DNS related reasons yes. It should be a one off, and the missing data might even be floating around somewhere on the system. I'll look into it. |
iskflakes
Magnets Inc.
34
|
Posted - 2012.08.09 18:12:00 -
[36] - Quote
That's the idea.
Ridding the world of perl, one script at a time.
(By the way, you can actually download your raw data form EVE Stats, which is something you might be interested in doing seeing as you already have a script). Track your wealth with EVE Stats: https://ohheck.co.uk/EVEStats/home.php |
iskflakes
Magnets Inc.
34
|
Posted - 2012.08.10 09:07:00 -
[37] - Quote
Hongus Gwag wrote:This is a lovely tool that gets better looking the longer you use it for, nice work!
One suggestion though, and this may allready be possible I'm just missing it; would it be possible to log in with a username/pass instead of api info? Often I'm on lots of different computers and finding my api info each time is a pain.
KeyID/vCode are used anyway, so it made sense to use them to authenticate your login instead of creating another username/password to remember. It not possible to remember a keyID/vCode, so for private graphs I added the "private graph sharable link". The way this basically works is it allows you to access your graph without logging in. I suggest you copy that link and save it as a bookmark, then visit it rather than the EVE Stats homepage. It is just as secure but much faster. Anybody you give that link to will also have access to view your graph.
Sanity: I'll look into it now Track your wealth with EVE Stats: https://ohheck.co.uk/EVEStats/home.php |
iskflakes
Magnets Inc.
34
|
Posted - 2012.08.10 09:34:00 -
[38] - Quote
There isn't a button to do that right now, but if you give me the keyID of the key you want removed I'll do that.
Normally when people want to stop using EVE Stats they delete the key on CCP's support page, and EVE Stats will then remove you from the richlist after a few days. Track your wealth with EVE Stats: https://ohheck.co.uk/EVEStats/home.php |
iskflakes
Magnets Inc.
35
|
Posted - 2012.08.11 09:40:00 -
[39] - Quote
Yes there have been some bandwidth issues in the last 24 hours. The, errr, "datacenter" that EVE Stats is hosted (my house) in is getting its ISP upgraded on monday, and for whatever reason our internet access will probably be slow until then.. sorry about that :(
Maybe one of these days I'll start hosting EVE Stats properly so we don't have constant outages/slow performance, though there would be serious disk space issues (most hosting providers only give you a couple of GB). Track your wealth with EVE Stats: https://ohheck.co.uk/EVEStats/home.php |
iskflakes
Magnets Inc.
35
|
Posted - 2012.08.11 12:10:00 -
[40] - Quote
Good news (for those of you who like graphs) -- some of the performance issues seem to have reduced and the site should be accessible again. ISP update is still happening on Monday so expect some downtime then for a few hours. Track your wealth with EVE Stats: https://ohheck.co.uk/EVEStats/home.php |
|
|
|
|