Pages: [1] :: one page |
|
Author |
Thread Statistics | Show CCP posts - 1 post(s) |
|
CCP Creber Cattus
C C P C C P Alliance
43
|
Posted - 2015.08.24 14:32:58 -
[1] - Quote
https://developers.eveonline.com/resource/static-data-export ( http://cdn1.eveonline.com/data/Galatea_1.0_114618_db.zip ) |
|
Desmont McCallock
560
|
Posted - 2015.08.24 14:59:42 -
[2] - Quote
Thanks for the heads up. Lets hope that this time the groups and categories yaml files are in there. |
Uppsy Daisy
Red Federation RvB - RED Federation
637
|
Posted - 2015.08.24 15:35:37 -
[3] - Quote
I have been away from this for a few months.
The invTypes table is not in the database. Has it been replaced by the YAML file? |
Desmont McCallock
560
|
Posted - 2015.08.24 15:36:26 -
[4] - Quote
Uppsy Daisy wrote:I have been away from this for a few months.
The invTypes table is not in the database. Has it been replaced by the YAML file? Since Aegis.
|
Desmont McCallock
560
|
Posted - 2015.08.24 15:47:54 -
[5] - Quote
@Steve Ronuken Do you have any idea what's up with this tournamentRuleSets.yaml file? |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5521
|
Posted - 2015.08.24 17:32:50 -
[6] - Quote
I've not looked at it yet
That'll come when I get home. Then I'll run my regular (new and improved, using python) conversion process and poke around at anything new.
(yay for security guards not turning up until late, and having to stick around because I'm a keyholder)
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5521
|
Posted - 2015.08.24 21:03:26 -
[7] - Quote
Having looked at it, I'd just ignore it. It's very niche data. Banned ships (totally banned. like the Nestor), and the costs for ships by group or typeid, in the current AT.
I'm working up the conversion now, and should have a release soon. It's based off my new python conversion process (including the universe data) so there may be artefacts which need corrected. The main advantage is, once it's smoothed out, it's a case of 'load all data into the MSSQL db, then convert to mysql. done.' Increases the bus factor, which is always a good thing.
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5521
|
Posted - 2015.08.25 00:31:49 -
[8] - Quote
mysql https://www.fuzzwork.co.uk/dump/mysql56-galatea-1.114618.tbz2 sqlite https://www.fuzzwork.co.uk/dump/galatea-1.114618/eve.db.bz2 Postgres https://www.fuzzwork.co.uk/dump/galatea-1.114618/postgres-galatea-1.114618.dmp.bz2 MS SQL https://www.fuzzwork.co.uk/dump/galatea-1.114618/galatea-1.114618.bak.bz2 other stuff https://www.fuzzwork.co.uk/dump/galatea-1.114618/
Conversion was done with: https://github.com/fuzzysteve/SDE-loaders
The mysql migration toolkit A mysql > sqlite conversion script pgloader (from mysql)
It's getting there.
Some datatypes may have changed a bit, as the conversion process is different. Just be aware. Translation data is loaded back into trnTranslations.
The scripts on github load everything into an SQL server DB. (that's why there's an mssql db backup there now)
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Desmont McCallock
561
|
Posted - 2015.08.25 06:39:49 -
[9] - Quote
Steve Ronuken wrote:Having looked at it, I'd just ignore it. It's very niche data. Banned ships (totally banned. like the Nestor), and the costs for ships by group or typeid, in the current AT. I'm working up the conversion now, and should have a release soon. It's based off my new python conversion process (including the universe data) so there may be artefacts which need corrected. The main advantage is, once it's smoothed out, it's a case of 'load all data into the MSSQL db, then convert to mysql. done.' Increases the bus factor, which is always a good thing. (The bus factor is why I started converting in the first place. I was depending on someone else, who got slower and slower after releases. So I worked up my own process, so I didn't need to wait.) 1. I'm ignoring it also. 2. Ah yes the bus factor.One of the things I constantly was nagging to my former boss, when he was trying to assign me more responsibilities. |
Mona Kasenumi
Wrong Cyno Brothers of Tangra
4
|
Posted - 2015.08.25 09:36:31 -
[10] - Quote
I tried to download it a few times but the file seem to be corrupted. I'm getting "unexpected EOF" and I can't unpack it (at least with winrar). |
|
Mona Kasenumi
Wrong Cyno Brothers of Tangra
4
|
Posted - 2015.08.25 10:56:18 -
[11] - Quote
Just found out the issue: CDN is ending the download prematurely for some reason. I had to run wget multiple times to get a working version.
wget http://cdn1.eveonline.com/data/Galatea_1.0_114618_db.zip converted 'http://cdn1.eveonline.com/data/Galatea_1.0_114618_db.zip' (ANSI_X3.4-1968) -> 'http://cdn1.eveonline.com/data/Galatea_1.0_114618_db.zip' (UTF-8) --2015-08-25 05:49:46-- http://cdn1.eveonline.com/data/Galatea_1.0_114618_db.zip Resolving cdn1.eveonline.com (cdn1.eveonline.com)... 54.230.0.73, 54.230.0.107, 54.230.0.24, ... Connecting to cdn1.eveonline.com (cdn1.eveonline.com)|54.230.0.73|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 114416535 (109M) [application/zip] Saving to: 'Galatea_1.0_114618_db.zip.4'
Galatea_1.0_114618_db.zi 5%[> ] 6.05M 14.5MB/s in 0.4s
2015-08-25 05:49:47 (14.5 MB/s) - Connection closed at byte 6344412. Retrying.
--2015-08-25 05:49:48-- (try: 2) http://cdn1.eveonline.com/data/Galatea_1.0_114618_db.zip Connecting to cdn1.eveonline.com (cdn1.eveonline.com)|54.230.0.73|:80... connected. HTTP request sent, awaiting response... 416 Requested Range Not Satisfiable
The file is already fully retrieved; nothing to do. |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5524
|
Posted - 2015.08.25 11:42:25 -
[12] - Quote
Probably related to the other CDN problems CCP's been suffering from yesterday and today.
One alternate option you have is to grab the 'updated' backup from mine (has all the yaml and sqlite db rolled into it)
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Desmont McCallock
561
|
Posted - 2015.08.25 11:46:43 -
[13] - Quote
Indeed there are issues with the CDN. Posting mirror link. |
Ydnari
Estrale Frontiers
404
|
Posted - 2015.08.25 21:07:45 -
[14] - Quote
Hmm - industryActivityMaterials.consume appears to have disappeared.
my teapot is ready
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5524
|
Posted - 2015.08.25 22:16:14 -
[15] - Quote
Ydnari wrote:Hmm - industryActivityMaterials.consume appears to have disappeared.
It stopped being in the SDE a while ago. I just had it auto fill with 1.
With the change in process, I didn't bother filling it in again.
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
salacious necrosis
Federal Defense Union Gallente Federation
13
|
Posted - 2015.08.26 02:43:31 -
[16] - Quote
Hey Steve,
Looks like none of the skin tables are populated this time around (although the schemas still exist). On purpose? It's not difficult to populate from the YAML, just curious if you intended this.
sal
EveKit - your EVE data on the web!
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5524
|
Posted - 2015.08.26 12:17:28 -
[17] - Quote
salacious necrosis wrote:Hey Steve,
Looks like none of the skin tables are populated this time around (although the schemas still exist). On purpose? It's not difficult to populate from the YAML, just curious if you intended this.
sal
Nope. Turns out with an edit I did because the materials file changed, it didn't actually commit anything (Not sure why, tbh. should have done).
I'll be releasing those files again tonight. (not a full release though)
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Golden Gnu
EVE University Ivy League
169
|
Posted - 2015.08.27 15:11:04 -
[18] - Quote
@Steve Ronuken Looks like there is UTF-8 errors in your MySQL conversion: Ex.: invTypes->TypeID: 34457 Should be: µ£½µùѵ¦Ös£¦t¦ºYC117s¦¦të¦sê½tëê" Is: ?????YC117???? My database is: utf8_general_ci (I don't know if that matters) Imported with: mysql.exe on win10 (Also, I don't know if that matters - always worked before)
As, always, thanks for the conversion. One hell of a timesaver o7
Download is the meaning of life, upload is the meaning of intelligent life
http://eve.nikr.net - home of jEveAssets
|
Desmont McCallock
561
|
Posted - 2015.08.27 15:44:50 -
[19] - Quote
Steve, typeName and description are nvarchar not just varchar. I made the same mistake with my tool. |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5526
|
Posted - 2015.08.27 16:41:04 -
[20] - Quote
Desmont McCallock wrote:Steve, typeName and description are nvarchar not just varchar. I made the same mistake with my tool.
bah. Thought I'd caught all of that. I'll see about kicking it some more, and see what I can get done.
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5527
|
Posted - 2015.08.27 19:49:54 -
[21] - Quote
I've corrected it in my conversion process.
(unless someone really wants it, I'll leave it till the next patch?)
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Legedric Striker
Blue Republic RvB - BLUE Republic
61
|
Posted - 2015.08.28 05:45:20 -
[22] - Quote
Anyone knows what happened to tables certcerts and certskills? They were in there until last patch but now vanished?
Perhaps I missed something as I am not that active in EVE at the moment ;)
Join R-v-B -- The MOST active PVP community in EVE!
EVE-Skillplan.net - Plan your training online using a PC, tablet or smartphone!
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5528
|
Posted - 2015.08.28 11:56:30 -
[23] - Quote
Legedric Striker wrote:Anyone knows what happened to tables certcerts and certskills? They were in there until last patch but now vanished?
Perhaps I missed something as I am not that active in EVE at the moment ;)
certCerts? and certSkills?
Those are tables I put together from the yaml. Not official tables. (They're in my conversion. It's case sensitive on most platforms.)
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Legedric Striker
Blue Republic RvB - BLUE Republic
61
|
Posted - 2015.08.28 17:18:01 -
[24] - Quote
Ok but they were included in the mySQL conversion and when I downloaded it today they were not ;)
Join R-v-B -- The MOST active PVP community in EVE!
EVE-Skillplan.net - Plan your training online using a PC, tablet or smartphone!
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5528
|
Posted - 2015.08.28 18:13:58 -
[25] - Quote
Legedric Striker wrote:Ok but they were included in the mySQL conversion and when I downloaded it today they were not ;)
uhh...
oops?
I know what happened. Must not have run that conversion script the second time. (I had a script failure due to a change, so needed to rebuild it. And must have not run that one )
Sorry about that.
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Chloe Westminstrel
Federal Defense Union Gallente Federation
0
|
Posted - 2015.09.08 09:48:46 -
[26] - Quote
The postgresql conversion seems to be missing Primary Key constraints. Aegis dump was working correctly, but in the Galatea version the pk's are defined only as UNIQUE. |
Zifrian
Licentia Ex Vereor Phoebe Freeport Republic
1653
|
Posted - 2015.09.08 11:37:42 -
[27] - Quote
Steve Ronuken wrote:Ydnari wrote:Hmm - industryActivityMaterials.consume appears to have disappeared. It stopped being in the SDE a while ago. I just had it auto fill with 1. With the change in process, I didn't bother filling it in again. I noticed you did this too. I took a different approach and kept it but marked skills as 0. It was really just to maintain my old code but worth a thought to include.
GÇ£Any fool can criticize, condemn, and complain - and most fools do. GÇ¥ - Dale Carnegie
Maximze your Industry Potential! - Download EVE Isk per Hour!
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5543
|
Posted - 2015.09.08 16:39:37 -
[28] - Quote
Chloe Westminstrel wrote:The postgresql conversion seems to be missing Primary Key constraints. Aegis dump was working correctly, but in the Galatea version the pk's are defined only as UNIQUE.
I'll see about poking sqlalchemy for the next one, to make it create appropriately.
(the php conversion process involved me precreating the tables with handcrafted sql. The python one uses sqlalchemy to create as needed.)
I had a few problems with pgloader, which may have been related.
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
|
|
|
Pages: [1] :: one page |
First page | Previous page | Next page | Last page |