| Pages: [1] :: one page |
| Author |
Thread Statistics | Show CCP posts - 0 post(s) |
vondronage
vondronage Corp
   |
Posted - 2010.06.21 10:44:00 -
[1]
I've been writing a game log analyzer in PHP and I've gotten about as far as I can with just my own log file data. I started writing it the day after Tyrannis came out so it should work for then on.
It's designed to work with verbose gamelog files. When I say that, I mean that all "Notifications" with the exception of "Simple Damage Notifications" are checked and enabled in the esc menus "General Settings -> inflight" section.
Some of the things it reports so far include
- Damage / Attack sums/averages/dps/etc
- Salvage success / failure / wreck-type breakdown
- Hacking, Archeology success / failure / container-type breakdown
- Enemy missle types
- Web scramble occurances
- Travel log (warp destinations)
- Graphs via Google chart API
I've got a development version up HERE if you want to check it out. The broader selection of log data I have to work with, the better. Try not to upload anything over a few hundered KB for the time being though. :)
|
Hel O'Ween
Men On A Mission
|
Posted - 2010.06.21 13:38:00 -
[2]
Did you take measures to handle localized log files, so they won't break your code?
--
EVEWalletAware - an offline wallet manager |
vondronage
vondronage Corp
|
Posted - 2010.06.21 14:33:00 -
[3]
Most things are not going to work for non-English log files, at least for now. Some of the damage reports might work with localized log files now if those log file formats capitalize proper nouns like the English format does. I do check for certain markers in log lines using hard-coded English strings though.
Feel free to give it a whirl if you've got such a log file. If I can support localized log files by abstracting my English hint strings it's something that would only take a little while to work into the code at the moment. :)
|
vondronage
vondronage Corp
|
Posted - 2010.06.21 14:52:00 -
[4]
I don't want to mention their name unless they want to chime in, but one of you guys uploaded an excellent log file. Exactly the type of stuff I'm looking for. :D
I can already see I'm going to have to combine the lowest X entities into an "other" section for some charts and tweak my combat parser.
|
Jackomel
Gallente
|
Posted - 2010.06.21 16:45:00 -
[5]
I'm liking it so far, the only problem is that I have lots of logs and many of them are just junk, so I was thinking about merging them all in a single file.
You should add the support for reading such a file (or the upload of multiple files) and the possibility of filtering data by date and multiple characters.
|
vondronage
vondronage Corp
|
Posted - 2010.06.22 07:08:00 -
[6]
Well, my plan is to support zip files with an as of yet undetermined number of log files inside them. Zip files are something a lot of people are familiar with and pretty much anyone can create with even a default Windows operating system installation by doing something as simple as right-clicking a group of files and selecting "compress files".
I've already got code to recognize system jumps for the travel log, but since the session changes, resulting in a new log file every time you jump, I haven't implemented that and don't plan to until around the time I setup zip file support. I want to make sure I can parse and generate a report for a single log file without any bugs before I start working with multiple users and solar systems. 
|
Jackomel
Gallente
|
Posted - 2010.06.22 21:14:00 -
[7]
nice to know this is on the plan, keep up the good work!
|
vondronage
vondronage Corp
|
Posted - 2010.06.26 02:58:00 -
[8]
Edited by: vondronage on 26/06/2010 03:01:38
I put together support for zip files with multiple logs for a character, and multiple characters during the extended downtime we had the other day. When there are multiple logs for a character, they will be combined and a single report will be generated for all of that characters logs spanning from the earliest to the latest timestamps. When there are multiple characters in a zip file you will be able to click the characters mug shot to view their report.
I haven't tested the merging of logfiles for a single character extensively. It seems to work, but I haven't double checked numbers for accuracy and things like that.
At the moment I'm using a quick and dirty zipfile reader I wrote myself this evening while I wait for my host to get back to me about the zip extension and stream-wrapper I have on my development servers at home. It should work with regular zip files like the ones created when you select multiple log files and select "send to compressed folder" from the right-click menu. Again, I haven't tested this extensively.
The UI is starting to get a little cluttered. Once I get this zip file stuff squared away I'm going to try and organize things a little better.
// Edit - Also, I removed the link to stored reports until I get the zipfile stuff squared away and can determine how I'm going to handle them with logs from zipfiles.
|
BeanBagKing
Ch3mic4l Warfare
STR8NGE BREW
|
Posted - 2010.07.01 18:31:00 -
[9]
Excellence app, I tried it the other day when it was opened, I hope it reopens to the public soon!
|
vondronage
vondronage Corp
|
Posted - 2010.07.05 11:55:00 -
[10]
Edited by: vondronage on 05/07/2010 11:56:00
Had to leave it off-line while I looked in to an issue with remote connections for looking up character_ids for names and fetching graph images hanging indefinitely. It's back up for the time being though.
I've been noticing some people upload as much as 5 months worth of logs as one time. This hasn't been a problem so far, but I'd originally envisioned single session log files so some of the graphs (ie the DPS graphs) aren't really setup to scale well with multiple complete days, or even months worth of data. I want to work out something to detect this early on and try to graph these a little better.
|
Jackomel
Gallente
|
Posted - 2010.07.07 14:46:00 -
[11]
I think it was me who uploaded the huge file, the problem was that I never got a result from the page
|
vondronage
vondronage Corp
|
Posted - 2010.07.07 22:29:00 -
[12]
Jackomel, I did get to see your log files. I'm actually using them as input for how to deal with months worth of log files at a time here at home.
--
When a log file is uploaded the server attempts to parse it and if it appears to be a valid log I save the raw log in a secure directory for me to retrieve here at home later before deleting it from the public servers secure directory. When I retrieve logs I run them through the tool here at home until there are no more lines in the debug area meaning nothing is being missed in the log and until there are no oddities in the graphs from things like long spans of time and strange scaling. Once there's nothing more I can do using that log as input I delete it from my home server as well.
If the public servers secure directory accumulates N files before I get a chance to retrieve them you'll see the "I have enough input" message I'm sure some of you have seen.
|
Eledran Drake
Caldari
|
Posted - 2010.07.09 21:57:00 -
[13]
 Originally by: vondronage
[...]If the public servers secure directory accumulates N files before I get a chance to retrieve them you'll see the "I have enough input" message I'm sure some of you have seen.
Quote:
Thankyou for your interest, however I have enough data to work with at the moment. Please try back later. =)
Heh, that is the one that is showing right now  
Is there any way for us to see the results of your work? (not uploaded a bit there but the GET request, first time I see this...)
|
| |
|
| Pages: [1] :: one page |
| First page | Previous page | Next page | Last page |