Pages: 1 2 [3] 4 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 6 post(s) |
Darkblad
Hilfe is like Free Entertainment
97
|
Posted - 2014.01.27 22:12:00 -
[61] - Quote
This one did actually help, as I was able to download it while the other link is dead for now. thanks for that! EvE Infolinks-áGÇô Umfangreiche Sammlung von Links mit informationen ++ber EvE, inklusive Guides und Infos von mir selbst |
Captain Thunk
Sniggerdly Pandemic Legion
147
|
Posted - 2014.01.29 08:21:00 -
[62] - Quote
Rob Crowley wrote:Desmont McCallock wrote:The description for the values can be found in the 'dgmAttributeTypes' table, column "displayName" (ship bonuses are with categoryID = 7) although some lack a proper 'displayName' (e.g. eliteBonusHeavyInterdictors1, eliteBonusElectronicAttackShip1, eliteBonusBlackOps1 etc.) The vast majority of ship bonuses in dgmTypeAttributes have generic attributes from category 7 or 9 that don't have a display name and don't reference the type of bonus at all. What would be required would be a displayName for the ship bonus effect in dgmTypeEffects. And there's also the problem of linking the bonus values in dgmTypeAttributes with the appropriate entries in dgmTypeEffects. E.g. for a Merlin we have "shipBonusCF = -4" and "shipBonusCF2 = 5", but in dgmTypeEffects there's "shipShield*ResistanceCF2" and "shipHybridDamageBonusCF2". So I don't really see a way to link the right numbers to the corresponding effects. Kid Delicious wrote:Using the Nestor as an example I grepped Steve's dump for "Amarr Battleship bonuses" which appears in the traits tab for that ship and got nothing. Well, the "Amarr Battleship" part is apparently coded as "AB" which would still be somewhat usable, what I'm missing more is the text description of the bonus' effect.
The data is incomplete, the static DB released by CCP is missing a key table, called dgmExpressions iirc. This table contains the necessary information to link the Attributes and Effects. It also uses python executable code which makes it difficult to work with unless your app is also in python.
To get this table you need Entity's Reverence and a script to extract it from the client.
|
Desmont McCallock
360
|
Posted - 2014.01.29 20:20:00 -
[63] - Quote
Captain Thunk wrote:Rob Crowley wrote:Desmont McCallock wrote:The description for the values can be found in the 'dgmAttributeTypes' table, column "displayName" (ship bonuses are with categoryID = 7) although some lack a proper 'displayName' (e.g. eliteBonusHeavyInterdictors1, eliteBonusElectronicAttackShip1, eliteBonusBlackOps1 etc.) The vast majority of ship bonuses in dgmTypeAttributes have generic attributes from category 7 or 9 that don't have a display name and don't reference the type of bonus at all. What would be required would be a displayName for the ship bonus effect in dgmTypeEffects. And there's also the problem of linking the bonus values in dgmTypeAttributes with the appropriate entries in dgmTypeEffects. E.g. for a Merlin we have "shipBonusCF = -4" and "shipBonusCF2 = 5", but in dgmTypeEffects there's "shipShield*ResistanceCF2" and "shipHybridDamageBonusCF2". So I don't really see a way to link the right numbers to the corresponding effects. Kid Delicious wrote:Using the Nestor as an example I grepped Steve's dump for "Amarr Battleship bonuses" which appears in the traits tab for that ship and got nothing. Well, the "Amarr Battleship" part is apparently coded as "AB" which would still be somewhat usable, what I'm missing more is the text description of the bonus' effect. The data is incomplete, the static DB released by CCP is missing a key table, called dgmExpressions iirc. This table contains the necessary information to link the Attributes and Effects. It also uses python executable code which makes it difficult to work with unless your app is also in python. To get this table you need Entity's Reverence and a script to extract it from the client. Ah yes, you are describing the perfect solution, scrubbing the bulk data from EVE cache folder.
P.S. I'm not mocking you Captain Thunk, merely CCP for an incomplete SDE.
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
2620
|
Posted - 2014.01.30 11:23:00 -
[64] - Quote
https://www.fuzzwork.co.uk/dump/rubicon-1.1-94321/invTraits.xls.bz2 https://www.fuzzwork.co.uk/dump/rubicon-1.1-94321/invTraits.sql.bz2
I've not done a new complete conversion, as I'm unsure if 1.1.2 has any other updates in it. If it does, I'll do a full conversion. otherwise, I'll leave it for now.
loader is https://github.com/fuzzysteve/yamlloader/tree/master/traits Steve Ronuken for CSM 9! http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter |
|
CCP Creber Cattus
C C P C C P Alliance
25
|
Posted - 2014.01.30 11:28:00 -
[65] - Quote
Desmont McCallock wrote:Captain Thunk wrote:Rob Crowley wrote:Desmont McCallock wrote:The description for the values can be found in the 'dgmAttributeTypes' table, column "displayName" (ship bonuses are with categoryID = 7) although some lack a proper 'displayName' (e.g. eliteBonusHeavyInterdictors1, eliteBonusElectronicAttackShip1, eliteBonusBlackOps1 etc.) The vast majority of ship bonuses in dgmTypeAttributes have generic attributes from category 7 or 9 that don't have a display name and don't reference the type of bonus at all. What would be required would be a displayName for the ship bonus effect in dgmTypeEffects. And there's also the problem of linking the bonus values in dgmTypeAttributes with the appropriate entries in dgmTypeEffects. E.g. for a Merlin we have "shipBonusCF = -4" and "shipBonusCF2 = 5", but in dgmTypeEffects there's "shipShield*ResistanceCF2" and "shipHybridDamageBonusCF2". So I don't really see a way to link the right numbers to the corresponding effects. Kid Delicious wrote:Using the Nestor as an example I grepped Steve's dump for "Amarr Battleship bonuses" which appears in the traits tab for that ship and got nothing. Well, the "Amarr Battleship" part is apparently coded as "AB" which would still be somewhat usable, what I'm missing more is the text description of the bonus' effect. The data is incomplete, the static DB released by CCP is missing a key table, called dgmExpressions iirc. This table contains the necessary information to link the Attributes and Effects. It also uses python executable code which makes it difficult to work with unless your app is also in python. To get this table you need Entity's Reverence and a script to extract it from the client. Ah yes, you are describing the perfect solution, scrubbing the bulk data from EVE cache folder. P.S. I'm not mocking you Captain Thunk, merely CCP for an incomplete SDE.
I have not checked if we changed anything in Rubicon 1.1.2 that we ship with the SDE (except adding the traits), but I THINK not.. :p |
|
Darkblad
Hilfe is like Free Entertainment
97
|
Posted - 2014.01.30 11:58:00 -
[66] - Quote
Darkblad wrote:This one did actually help, as I was able to download it while the other link is dead for now. thanks for that! Appears to work with the 1.1.2 Dump as well. As a sidenote: initial run of the tool didn't import factionID values into invTypes (didn't neither work with 1.1.) Used a dirty workaround to fix that for me: typeIDs.yaml:
- replace iconID with tempID
- replace factionID with iconID
run the import, then In the database
- rename iconID column to factionID
Import again, with the unmodified yaml files EvE Infolinks-áGÇô Umfangreiche Sammlung von Links mit informationen ++ber EvE, inklusive Guides und Infos von mir selbst |
Berluth Luthian
Meltdown.
176
|
Posted - 2014.01.30 16:02:00 -
[67] - Quote
Does this have the new universe data? |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
2622
|
Posted - 2014.01.30 16:19:00 -
[68] - Quote
Berluth Luthian wrote:Does this have the new universe data?
New universe data? Steve Ronuken for CSM 9! http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter |
Desmont McCallock
361
|
Posted - 2014.01.30 18:47:00 -
[69] - Quote
Darkblad wrote:Darkblad wrote:This one did actually help, as I was able to download it while the other link is dead for now. thanks for that! Appears to work with the 1.1.2 Dump as well. As a sidenote: initial run of the tool didn't import factionID values into invTypes (didn't neither work with 1.1.) Used a dirty workaround to fix that for me: typeIDs.yaml:
- replace iconID with tempID
- replace factionID with iconID
run the import, then In the database
- rename iconID column to factionID
Import again, with the unmodified yaml files Didn't noticed the factionID, I'll make sure to include that and the masteries.
Edit: And the Traits. |
Desmont McCallock
362
|
Posted - 2014.02.01 20:25:00 -
[70] - Quote
Updated EVEMonYamlToSql tools. It now imports all fields that the yaml files include into an MSSQL database (masteries, factionID, trais included).
In case you find any mistake pls post on this thread. |
|
Rob Crowley
State War Academy
278
|
Posted - 2014.02.15 01:13:00 -
[71] - Quote
I finally had some time to play with the new traits info and found that a couple bonuses have some precision/rounding issues:
typeIDs.yaml wrote:bonus: 99.650000000000006 bonusText: reduction in Torpedo Launcher powergrid requirement
bonus: 33.329999999999998 bonusText: reduction in Ice Harvester duration and activation cost The ones I found were limited to stealth bombers and mining barges/exhumers. Maybe you could do something about those and make them correct and pretty. |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
2652
|
Posted - 2014.02.15 01:18:00 -
[72] - Quote
New conversions.
https://www.fuzzwork.co.uk/dump/sqlite-latest.sqlite.bz2 https://www.fuzzwork.co.uk/dump/postgres-latest.sql.bz2 https://www.fuzzwork.co.uk/dump/mysql-latest.tar.bz2
https://www.fuzzwork.co.uk/dump/rubicon-1.2-94438/
For mysql, you'll find the universe data in a separate file to import. the others have it embedded.
I'm /pretty/ sure it'll work, though the conversion tool I used had some data type issues. Seriously considering picking up a commercial tool for this. Smile Steve Ronuken for CSM 9! https://forums.eveonline.com/default.aspx?g=posts&m=4236322 http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter |
Darkblad
Hilfe is like free Entertainment
101
|
Posted - 2014.02.15 10:20:00 -
[73] - Quote
I'm a bit lost here and maybe some of you can help me out. With the universe data now separated to an sqlite file, I've lost the option to do external queries to those tables from (you may start to hate me now:) Excel. Is there any option for me to get those tables back into the original SDE (mssql)? I've already got myself the sqlite odbc driver, but start to realize that I'm too much of an amateur for this challenge (I'm happy to put together some basic sql queries)
I feel tempted to pick the mysql conversion Steve created to merge them with the mssql SDE. Would that work?
I'd appreciate some help with that - feel free to call me names EVE Infolinks -+-áOld and new-áPortraits |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
2661
|
Posted - 2014.02.15 18:53:00 -
[74] - Quote
Darkblad wrote:I'm a bit lost here and maybe some of you can help me out. With the universe data now separated to an sqlite file, I've lost the option to do external queries to those tables from (you may start to hate me now:) Excel. Is there any option for me to get those tables back into the original SDE (mssql)? I've already got myself the sqlite odbc driver, but start to realize that I'm too much of an amateur for this challenge (I'm happy to put together some basic sql queries) I feel tempted to pick the mysql conversion Steve created to merge them with the mssql SDE. Would that work? I'd appreciate some help with that - feel free to call me names
What might work better for you, is loading data into the tables that are there, from CSV dumps from sqlite? (or from my site.)
http://blog.sqlauthority.com/2008/02/06/sql-server-import-csv-file-into-sql-server-using-bulk-insert-load-comma-delimited-file-into-sql-server/
http://stackoverflow.com/questions/15655380/import-csv-into-sql-server-including-automatic-table-creation
http://stackoverflow.com/questions/75675/how-do-i-dump-the-data-of-some-sqlite3-tables
https://www.sqlite.org/download.html Steve Ronuken for CSM 9! https://forums.eveonline.com/default.aspx?g=posts&m=4236322 http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter |
Darkblad
Hilfe is like free Entertainment
101
|
Posted - 2014.02.15 23:00:00 -
[75] - Quote
I'll try that, thanks! EVE Infolinks -+-áOld and new-áPortraits |
Desmont McCallock
363
|
Posted - 2014.02.16 09:53:00 -
[76] - Quote
Darkblad wrote:I'm a bit lost here and maybe some of you can help me out. With the universe data now separated to an sqlite file, I've lost the option to do external queries to those tables from (you may start to hate me now:) Excel. Is there any option for me to get those tables back into the original SDE (mssql)? I've already got myself the sqlite odbc driver, but start to realize that I'm too much of an amateur for this challenge (I'm happy to put together some basic sql queries) I feel tempted to pick the mysql conversion Steve created to merge them with the mssql SDE. Would that work? I'd appreciate some help with that - feel free to call me names If you give me some time I may be able to help you as I'm already in the works for creating a tool that imports all separately data back into the MSSQL DB (as we need that for generating the EVEMon data files). |
Darkblad
Hilfe is like free Entertainment
101
|
Posted - 2014.02.16 18:47:00 -
[77] - Quote
Desmont McCallock wrote:If you give me some time I may be able to help you as I'm already in the works for creating a tool that imports all separately data back into the MSSQL DB (as we need that for generating the EVEMon data files). That's just great \o/ And there's a pile of other projects that'll keep me busy for quite some time (compiling a Mining Guide /w the current state, I start to love it ) EVE Infolinks -+-áOld and new-áPortraits |
Jess Technite
Almost Absolute
1
|
Posted - 2014.02.19 13:38:00 -
[78] - Quote
After this and your post about CSM candidature you can count with my vote, clearly.
|
Hel O'Ween
Men On A Mission
59
|
Posted - 2014.02.20 10:25:00 -
[79] - Quote
Desmont McCallock wrote:If you give me some time I may be able to help you as I'm already in the works for creating a tool that imports all separately data back into the MSSQL DB (as we need that for generating the EVEMon data files).
That would be a nice little helper, as I'm also relying on creating EWA's data from MS SQL. EVEWalletAware - an offline wallet manager. |
Desmont McCallock
363
|
Posted - 2014.02.22 12:17:00 -
[80] - Quote
I'm almost done with the tool that imports the ' from now on extracted to another format' data back into MSSQL, but...
@CCP Creber Cattus First, I have stumbled on a issue with the data types. In mapCelestialStatistics table the 'locked' column is defined as "int" although it should be defined as "bit". This difference is causing me troubles when casting the type. Is it possible to switch the data type to the correct type?
Second, in mapLandmarks table there is no 'radius' and 'importance' columns which leads to data loss as previous SDE versions contained data in those columns. Is there an explanation to this? |
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
2724
|
Posted - 2014.02.22 17:38:00 -
[81] - Quote
Desmont McCallock wrote:I'm almost done with the tool that imports the ' from now on extracted to another format' data back into MSSQL, but...
@CCP Creber Cattus First, I have stumbled on a issue with the data types. In mapCelestialStatistics table the 'fragmented' and 'locked' columns are defined as "int" although they should be defined as "bit". This difference is causing me troubles when casting the type.
Also "pressure", "radius" and "mass" are defined as 'int' although they should be defined as "real" which results to incorrect data (data are different in previous SDE versions).
Is it possible to switch the data type to the correct type?
Second, in mapLandmarks table there is no 'radius' and 'importance' columns which leads to data loss as previous SDE versions contained data in those columns. Is there an explanation to this?
Quote:The reason for this change is that the radius and importance columns were only used for landmark authoring. Steve Ronuken for CSM 9! https://forums.eveonline.com/default.aspx?g=posts&m=4236322 http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter |
Desmont McCallock
363
|
Posted - 2014.02.22 18:27:00 -
[82] - Quote
Steve, although I can't find the source of the quote you posted, I trust it's true. Still issue No 1 remains. |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
2724
|
Posted - 2014.02.22 18:35:00 -
[83] - Quote
Desmont McCallock wrote:Steve, although I can't find the source of the quote you posted, I trust it's true. Still issue No 1 remains.
It's in the dev blog for the new update. http://community.eveonline.com/news/dev-blogs/eve-universe-static-data-export/
There are other issues with that update though. Like a bunch of empty tables (without the data being in the sqlite file) Steve Ronuken for CSM 9! https://forums.eveonline.com/default.aspx?g=posts&m=4236322 http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter |
Desmont McCallock
363
|
Posted - 2014.02.22 19:05:00 -
[84] - Quote
lol, Steve, although I read the dev blog when it was first published, I probably skipped that part. Haven't stumbled across any empty tables yet, but if you say so. |
Darkblad
Hilfe is like free Entertainment
102
|
Posted - 2014.02.22 19:52:00 -
[85] - Quote
Desmont McCallock wrote:lol, Steve, although I read the dev blog when it was first published, I probably skipped that part. Haven't stumbled across any empty tables yet, but if you say so. An empty one without a direct substitute within the sqlite is chrFactions, which I've learned the hard way. EVE Infolinks -+-áOld and new-áPortraits |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
2724
|
Posted - 2014.02.22 19:58:00 -
[86] - Quote
staStations, all the agent tables. All the corporation tables. (I've listed them in the comments on the devblog) Steve Ronuken for CSM 9! https://forums.eveonline.com/default.aspx?g=posts&m=4236322 http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter |
Desmont McCallock
363
|
Posted - 2014.02.23 08:56:00 -
[87] - Quote
Holly smokes, guys you are right. For the tool I'm doing I was working with a Rubicon 1.1.2 backup. Now that I restored the Rubicon 1.2 SDE, the whole hell broke lose.
Calling CCP Creber Cattus and CCP Prism X to the rescue. |
Desmont McCallock
363
|
Posted - 2014.02.23 15:33:00 -
[88] - Quote
Proudly presenting SDEExternalsToSql tool. |
Celebrain
1st Steps Academy Fidelas Constans
0
|
Posted - 2014.02.26 03:34:00 -
[89] - Quote
Trying to restore DATADUMP201401300958.bak from http://cdn1.eveonline.com/data/Rubicon_1.1.2_94438_db.zip to SQL Express 2008 R2 on Windows XP and getting the following error:
===================================
Specified cast is not valid. (SqlManagerUI)
Program Location:
at Microsoft.SqlServer.Management.SqlManagerUI.SqlRestoreDatabaseGeneral.PopulateGridWithBackupSetsFromDevices() at Microsoft.SqlServer.Management.SqlManagerUI.SqlRestoreDatabaseGeneral.GetBackupSetsFromDevices() at Microsoft.SqlServer.Management.SqlManagerUI.SqlRestoreDatabaseGeneral.textDeviceSelected_TextChanged(Object sender, EventArgs e) at System.Windows.Forms.Control.OnTextChanged(EventArgs e) at System.Windows.Forms.TextBoxBase.OnTextChanged(EventArgs e) at System.Windows.Forms.Control.set_Text(String value) at System.Windows.Forms.TextBoxBase.set_Text(String value) at System.Windows.Forms.TextBox.set_Text(String value) at Microsoft.SqlServer.Management.SqlManagerUI.SqlRestoreDatabaseGeneral.buttonSelectDevice_Click(Object sender, EventArgs e) at System.Windows.Forms.Control.OnClick(EventArgs e) at System.Windows.Forms.Button.OnClick(EventArgs e) at System.Windows.Forms.Button.OnMouseUp(MouseEventArgs mevent) at System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks) at System.Windows.Forms.Control.WndProc(Message& m) at System.Windows.Forms.ButtonBase.WndProc(Message& m) at System.Windows.Forms.Button.WndProc(Message& m) at System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m) at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m) at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
2732
|
Posted - 2014.02.26 14:02:00 -
[90] - Quote
Celebrain wrote:Trying to restore DATADUMP201401300958.bak from http://cdn1.eveonline.com/data/Rubicon_1.1.2_94438_db.zip to SQL Express 2008 R2 on Windows XP and getting the following error: =================================== Specified cast is not valid. (SqlManagerUI)
Program Location: at Microsoft.SqlServer.Management.SqlManagerUI.SqlRestoreDatabaseGeneral.PopulateGridWithBackupSetsFromDevices() at Microsoft.SqlServer.Management.SqlManagerUI.SqlRestoreDatabaseGeneral.GetBackupSetsFromDevices() at Microsoft.SqlServer.Management.SqlManagerUI.SqlRestoreDatabaseGeneral.textDeviceSelected_TextChanged(Object sender, EventArgs e) at System.Windows.Forms.Control.OnTextChanged(EventArgs e) at System.Windows.Forms.TextBoxBase.OnTextChanged(EventArgs e) at System.Windows.Forms.Control.set_Text(String value) at System.Windows.Forms.TextBoxBase.set_Text(String value) at System.Windows.Forms.TextBox.set_Text(String value) at Microsoft.SqlServer.Management.SqlManagerUI.SqlRestoreDatabaseGeneral.buttonSelectDevice_Click(Object sender, EventArgs e) at System.Windows.Forms.Control.OnClick(EventArgs e) at System.Windows.Forms.Button.OnClick(EventArgs e) at System.Windows.Forms.Button.OnMouseUp(MouseEventArgs mevent) at System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks) at System.Windows.Forms.Control.WndProc(Message& m) at System.Windows.Forms.ButtonBase.WndProc(Message& m) at System.Windows.Forms.Button.WndProc(Message& m) at System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m) at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m) at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)
That's because it's a 2012 export. you'll need to upgrade. Steve Ronuken for CSM 9! https://forums.eveonline.com/default.aspx?g=posts&m=4236322 http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter |
|
|
|
|
Pages: 1 2 [3] 4 :: one page |
First page | Previous page | Next page | Last page |