Pages: [1] 2 3 4 5 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 4 post(s) |
Desmont McCallock
363
|
Posted - 2014.02.23 15:28:00 -
[1] - Quote
With the latest changes on how CCP distributes the SDE from now on, by exporting the data to yaml files, sqlite db files and an MSSQL dump, the necessity for a tool that can import all external data back into an MSSQL DB arose.
So I'm presenting to you the SDEExternalsToSql tool. A tool that we use also in EVEMon.
You can find the source code at EVEMon's repository as the tool is embedded in it (look into the Tools folder).
The compiled version can be found for downloading here.
Direct dl link: EVEMonSDEExternalsToSql.zip
Notice: Yaml files and SQLite db files are not distributed along with the tool. You will have to get them from the community toolkit page
Enjoy responsibly. |
Hel O'Ween
Men On A Mission
60
|
Posted - 2014.02.24 17:57:00 -
[2] - Quote
Thanks a bunch, mate! EVEWalletAware - an offline wallet manager. |
Desmont McCallock
366
|
Posted - 2014.02.24 20:09:00 -
[3] - Quote
Hel O'Ween wrote:Thanks a bunch, mate! No problem. |
Darkblad
Hilfe is like Free Entertainment
124
|
Posted - 2014.03.11 08:48:00 -
[4] - Quote
Cold be only me, but the tool crashes while attempting to import mapDenormalized from the Rubicon 1.3 SDE. My bet is that CCP fiddled with table formats in the sqlite? (will provide the error message soon) EVE Infolinks -+-áOld and new-áPortraits |
Darkblad
Hilfe is like Free Entertainment
124
|
Posted - 2014.03.11 10:22:00 -
[5] - Quote
Here's what I get on importing data: unfortunately as a screenshot only and, to make it harder, from a German language Windows installation :/ The path given (e:\Projects\...) in the error message is not given in the .config or any of the .xml files EVE Infolinks -+-áOld and new-áPortraits |
|
CCP FoxFour
C C P C C P Alliance
2980
|
Posted - 2014.03.11 10:44:00 -
[6] - Quote
Awesome stuff! Thank you for putting the time into this, I imagine it will make lots of lives a lot easier. :) CCP FoxFour // Game Designer @regnerba |
|
Rob Crowley
State War Academy
278
|
Posted - 2014.03.11 10:45:00 -
[7] - Quote
Darkblad wrote:Cold be only me, but the tool crashes while attempting to import mapDenormalized from the Rubicon 1.3 SDE. My bet is that CCP fiddled with table formats in the sqlite? (will provide the error message soon) It's not just you, I fixed this quick and dirty by
MapDenormalizeTable.cs wrote:@@ -72,7 +72,14 @@ parameters["y"] = mDenorm.y.GetValueOrDefaultString(); parameters["z"] = mDenorm.z.GetValueOrDefaultString(); parameters["radius"] = mDenorm.radius.GetValueOrDefaultString(); - parameters["itemName"] = String.Format("'{0}'", mDenorm.itemName.Replace("'", Database.StringEmpty)); + if (mDenorm.itemName != null) { + parameters["itemName"] = String.Format("'{0}'", + mDenorm.itemName.Replace("'", Database.StringEmpty)); + } + else + { + parameters["itemName"] = "Null"; + } parameters["security"] = mDenorm.security.GetValueOrDefaultString(); parameters["celestialIndex"] = mDenorm.celestialIndex.GetValueOrDefaultString(); parameters["orbitIndex"] = mDenorm.orbitIndex.GetValueOrDefaultString();
It ran through like that, but Desmont will know best how to do this properly.
|
Risingson
78
|
Posted - 2014.03.11 14:46:00 -
[8] - Quote
omg thank you for saving me from horror time ! Eveeye Prototype YD-114 Onboard Computer Systems |
Desmont McCallock
374
|
Posted - 2014.03.11 16:09:00 -
[9] - Quote
I'll get on it as soon as I finish with work. Expect a new version shortly. |
Desmont McCallock
374
|
Posted - 2014.03.11 19:42:00 -
[10] - Quote
Issues have been fixed. Code was improved. New release have been issued. Same link. Enjoy. |
|
Darkblad
Hilfe is like Free Entertainment
128
|
Posted - 2014.03.11 20:00:00 -
[11] - Quote
Desmont McCallock wrote:Issues have been fixed. Code was improved. New release have been issued. Same link. Enjoy. Worked like a charm, thanks a lot!
EVE Infolinks -+-áOld and new-áPortraits |
Hel O'Ween
Men On A Mission
66
|
Posted - 2014.03.11 23:24:00 -
[12] - Quote
New Eden might be a cold, harsh place, but this Tech Lab forum feels like the lone worm and cozy inn in that dark void.
Thanks, Desmont. EVEWalletAware - an offline wallet manager. |
Sentenced 1989
Quantum Anomaly Corporation
42
|
Posted - 2014.03.17 15:05:00 -
[13] - Quote
Desmont McCallock wrote:With the latest changes on how CCP distributes the SDE from now on, by exporting the data to yaml files, sqlite db files and an MSSQL dump, the necessity for a tool that can import all external data back into an MSSQL DB arose.
Nice of you to provide the tool, downloading now and thank you very much
|
Hel O'Ween
Men On A Mission
67
|
Posted - 2014.03.20 11:41:00 -
[14] - Quote
Quick question, because I don't "speak" a word C# and therefore don't know where to look for this in the source: does the tool empty/drop existing tables/data before importing?
Or put another way: when an import failed (for whatever reason), do I need to remove the tables create by it before attempting another import? EVEWalletAware - an offline wallet manager. |
Desmont McCallock
376
|
Posted - 2014.03.20 20:08:00 -
[15] - Quote
Hel O'Ween wrote:Quick question, because I don't "speak" a word C# and therefore don't know where to look for this in the source: does the tool empty/drop existing tables/data before importing?
Or put another way: when an import failed (for whatever reason), do I need to remove the tables create by it before attempting another import? The tool drops and recreates the tables, except the invTypes table where it creates the columns (if they don't exist) and updates them. |
Hel O'Ween
Men On A Mission
67
|
Posted - 2014.03.21 12:05:00 -
[16] - Quote
Awesome!
So it's basically a "no-brainer" tool. Exactly what the doctor prescribed ...
EVEWalletAware - an offline wallet manager. |
Desmont McCallock
377
|
Posted - 2014.03.21 19:08:00 -
[17] - Quote
Hel O'Ween wrote:Awesome! So it's basically a "no-brainer" tool. Exactly what the doctor prescribed ... Yeap, I always try to make "idiot proof" apps and tools.
|
T'rixie
Criminally Incompetent Baja Panti Mafia
6
|
Posted - 2014.05.03 23:17:00 -
[18] - Quote
Desmont McCallock wrote:With the latest changes on how CCP distributes the SDE from now on, by exporting the data to yaml files, sqlite db files and an MSSQL dump, the necessity for a tool that can import all external data back into an MSSQL DB arose.
I've spent hours in the last few days installing & configuring MS SQL, getting my software to interface with it, working through the tables to find where things were only to discover the map data was missing, so then hunting through the interwebs and these forums to finally find my way here to this lovely thread.
Desmont - your tool ran the first time out of the box and worked beautifully. Thank you!
|
Desmont McCallock
381
|
Posted - 2014.05.04 08:01:00 -
[19] - Quote
T'rixie wrote:Desmont McCallock wrote:With the latest changes on how CCP distributes the SDE from now on, by exporting the data to yaml files, sqlite db files and an MSSQL dump, the necessity for a tool that can import all external data back into an MSSQL DB arose.
I've spent hours in the last few days installing & configuring MS SQL, getting my software to interface with it, working through the tables to find where things were only to discover the map data was missing, so then hunting through the interwebs and these forums to finally find my way here to this lovely thread. Desmont - your tool ran the first time out of the box and worked beautifully. Thank you! Glad you found it useful. :)
|
Darkblad
Hilfe is like Free Entertainment
226
|
Posted - 2014.05.15 23:03:00 -
[20] - Quote
Just a short note:
Rubicon 1.4 SDE just got released http://cdn1.eveonline.com/data/Rubicon_1.4_97069_db.zip
And the tool handled the externals w/o error, which lets me assume that it worked just fine EVE Infolinks -+-áOld and new-áPortraits |
|
Darkblad
Hilfe is like free Entertainment
269
|
Posted - 2014.05.30 11:50:00 -
[21] - Quote
Same applies to Kronos 1.0 SDE: http://content.eveonline.com/data/Kronos_1.0_98431_db.zip EVE Infolinks -+-áOld and new-áPortraits |
Tuborg Uitoh
10
|
Posted - 2014.06.15 17:03:00 -
[22] - Quote
hey traying to get this tool to work i keep getting this error
"Connection to SQL Database: Failed Reason was: A network-related or instance-specific error occurred while establis hing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to a llow remote connections. (provider: SQL Network Interfaces, error: 26 - Error Lo cating Server/Instance Specified) Press any key to exit."
im extracting the db directly from the zip downloaded from eve website and i also trayed using it on a sqllite db from fuzzworks keeps giving me the same error... i rename all files to universDataDx.db what am i duing wrong ?? |
Desmont McCallock
384
|
Posted - 2014.06.15 20:18:00 -
[23] - Quote
You must specify the data source in the connection string at the config file. How do you expect the tool to know where the SQL server is and how you named the database? |
Darkblad
Hilfe is like Free Entertainment
341
|
Posted - 2014.07.10 20:58:00 -
[24] - Quote
The tool worked fine for the http://cdn1.eveonline.com/data/Crius_1.0_beta3.zip (i.e. no errors)
Further tables got removed from the MSSQL SDE and moved another .yaml file, as stated in today's Devblog
Removed table invBlueprintTypes Removed table ramTypeRequirements Removed table ramAssemblyLines Added YAML file blueprints.yaml EVE Infolinks -+-áOld and new-áPortraits |
Azarion Sinak
Crescent Fortress Industrialists
0
|
Posted - 2014.07.11 01:27:00 -
[25] - Quote
Why the move to YAML instead of MSSQL? I don't understand the attraction to flat files versus a rationalized indexed database. Perhaps its the DBA in me, but seriously? |
Calvin
Israeli Space Corporation
4
|
Posted - 2014.07.14 22:56:00 -
[26] - Quote
Desmont McCallock wrote:You must specify the data source in the connection string at the config file. How do you expect the tool to know where the SQL server is and how you named the database?
Hi Desmont, I apologize for the totally n00b question here, but... well that's a good description of my skills in this area (I nearly had a panic attack when I saw the BP material list being moved to YAML).
Where exactly do I need to change the connection string so your tool hooks up with my MS SQL database? I see the connectionStrings section in the config file, but it's all greek to me at the moment. |
Hel O'Ween
Men On A Mission
83
|
Posted - 2014.07.16 17:00:00 -
[27] - Quote
Calvin wrote:Now I need to figure out how to get it to import the blueprints.yaml file...
When extracting the archive, it creates two folders: SQLITEFILES and YAMLFILES, with the YAMLFILES folder holding a file appropriately named "Put yaml files here" .
Now I leave it to you to guess how to import that blueprints.yaml file ... EVEWalletAware - an offline wallet manager. |
Darkblad
Hilfe is like Free Entertainment
348
|
Posted - 2014.07.16 17:47:00 -
[28] - Quote
Hel O'Ween wrote:Calvin wrote:Now I need to figure out how to get it to import the blueprints.yaml file... When extracting the archive, it creates two folders: SQLITEFILES and YAMLFILES, with the YAMLFILES folder holding a file appropriately named "Put yaml files here" . Now I leave it to you to guess how to import that blueprints. yaml file ... Problem is, that the current version of Desmont's tool doesn't respect the blueprints.yaml (new file for crius). First thing that comes to mind would be "what if I change its name to one of the .yaml files that Desmont's tool actually uses" - but that would break things - worst case being that the wrong data gets inserted into the wrong tables of the MSSQL database. EVE Infolinks -+-áOld and new-áPortraits |
Calvin
Israeli Space Corporation
4
|
Posted - 2014.07.17 02:12:00 -
[29] - Quote
Darkblad wrote:Hel O'Ween wrote:Calvin wrote:Now I need to figure out how to get it to import the blueprints.yaml file... When extracting the archive, it creates two folders: SQLITEFILES and YAMLFILES, with the YAMLFILES folder holding a file appropriately named "Put yaml files here" . Now I leave it to you to guess how to import that blueprints. yaml file ... Problem is, that the current version of Desmont's tool doesn't respect the blueprints.yaml (new file for crius). First thing that comes to mind would be "what if I change its name to one of the .yaml files that Desmont's tool actually uses" - but that would break things - worst case being that the wrong data gets inserted into the wrong tables of the MSSQL database.
Thanks Dark, that about sums up the problem. I'm starting to hit panic mode as I'm about to loose my BP material list table, which means about 85% of all my database functionality goes out the window... I love Desmont's tool, but arg, stops short of solving my problem at the moment! |
Desmont McCallock
386
|
Posted - 2014.07.18 18:58:00 -
[30] - Quote
Guys don't panic. I will work on a new version that supports the Crius patch this weekend. Stay tuned. |
|
|
|
|
Pages: [1] 2 3 4 5 :: one page |
First page | Previous page | Next page | Last page |