Pages: [1] :: one page |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Chaos Tourist Mileghere
Master Blaster Enterprises
0
|
Posted - 2014.05.21 13:49:00 -
[1] - Quote
Hello all,
I see the list of static data dumps on Eve-Central.com and have not seen any posts on this subject yet.
The issue I'm having is that when I go to (https://eve-central.com/dumps/) and download yesterday's market data, it comes out as gibberish on my text editor. Is there a way I can convert the .dump.gz files into text so I can do my own research on the market?
I tried replacing the .gz with .txt but it did not seem to work.
Any help would be appreciated, I do not have SQL experience.
R/ Chaos Tourist |
Elzira Kore
Kore Inc.
3
|
Posted - 2014.05.21 14:07:00 -
[2] - Quote
.gz files are compressed archives, like ZIP-files but with a different form of compression. You can unpack them with any of several decompression tools. I recommend 7-Zip which can handle a ton of different formats and is free.
Once you've unpacked the .gz file you get a .dump file which is just a text-file with all the data in comma-separated format. |
Petrus Blackshell
Derelict Rifter Enterprise
3163
|
Posted - 2014.05.21 15:39:00 -
[3] - Quote
Elzira Kore wrote:.gz files are compressed archives, like ZIP-files but with a different form of compression. Not quite. A GZip file (.gz) is a single compressed file, not a "folder" of files like ZIP archives are. So, if you have a "blahblah.dump.gz" file, the only thing it is is a compressed version of "blahblah.dump".
Elzira Kore wrote:You can unpack them with any of several decompression tools. I recommend 7-Zip which can handle a ton of different formats and is free.
7-Zip is a good choice, +1.
Elzira Kore wrote:Once you've unpacked the .gz file you get a .dump file which is just a text-file with all the data in comma-separated format.
Comma-separated values (CSV) files normally have a .csv extension, not a .dump extension. You could rename it to a .csv extension and open it in Excel as a spreadsheet, but I'm not sure how much good that does you. I think the dump is mainly intended for people with extensive analytics or programming backgrounds to play with and extract data from. It's such a large glut of data that it simply cannot be processed by hand without special tools. Accidentally The Whole Frigate (blog) - Learning how to pew pew, one loss at a time - www.thewholefrigate.com |
Chaos Tourist Mileghere
Master Blaster Enterprises
1
|
Posted - 2014.05.21 15:41:00 -
[4] - Quote
Thank you Elzira!
The 7-Zip worked great. I found a youtube video that explains it pretty well here:
https://www.youtube.com/watch?v=ZIYJVqSMCg8
Now that I have unzipped the dump file from the .gz, I renamed the extension to .txt and that solved it. I'm using power pivot for Excel to handle the 11 million transactions without exploding my machine.
Much appreciated! Chaos Tourist
|
Petrus Blackshell
Derelict Rifter Enterprise
3163
|
Posted - 2014.05.21 15:52:00 -
[5] - Quote
Chaos Tourist Mileghere wrote: Now that I have unzipped the dump file from the .gz, I renamed the extension to .txt and that solved it. I'm using power pivot for Excel to handle the 11 million transactions without exploding my machine. If anyone wants help with power pivot, its my workaround to SQL. Powerpivot is a free add on from microsoft that lets MS Excel handle that much data.
Ah, you were prepared for the giant amount of data. Nice going, and good luck!
Accidentally The Whole Frigate (blog) - Learning how to pew pew, one loss at a time - www.thewholefrigate.com |
|
|
|
Pages: [1] :: one page |
First page | Previous page | Next page | Last page |