Pages: 1 [2] 3 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Airi Cho
Dark-Rising Executive Outcomes
12
|
Posted - 2014.08.01 21:33:00 -
[31] - Quote
actually i can only find https://www.fuzzwork.co.uk/dump/crius-1.6-100370/postgres-crius-1.6-1000370.sql.bz2
which is actually a pg_dump format :)
remember to use pg_restore --no-owner when restoring. |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
3623
|
Posted - 2014.08.01 22:27:00 -
[32] - Quote
oops.
URLs updated. Woo! CSM 9! http://fuzzwork.enterprises/ Twitter: @fuzzysteve on Twitter |
Desmont McCallock
388
|
Posted - 2014.08.02 21:28:00 -
[33] - Quote
Acid Kanshi wrote:Any CCP person can check this out? Scourge Fury Heavy Missile manufacturing http://i.imgur.com/HsNnJNZ.pngBut in SDE there are materials Tritanium, Zydrine etc. Outdated materials. Has been fixed in Crius 1.6 SDE. Looks like it's time to work on updating EVEMon's data.
|
Desmont McCallock
388
|
Posted - 2014.08.03 09:36:00 -
[34] - Quote
Just a heads up, MarketGroupID: 1912 (* Outpost Platform Blueprint) and MarketGroupID: 1913 (Station * Blueprint) are missing from the invMarketGroups table. |
Timcanpy Yvormes
Lero Industries
0
|
Posted - 2014.08.03 11:02:00 -
[35] - Quote
Can some one help me
in the database if i do this -- Base materials SELECT t.typeName, m.quantity FROM invTypeMaterials AS m INNER JOIN invTypes AS t ON m.materialTypeID = t.typeID WHERE m.typeID = 11400--jaguar
I'm asking because i was trying to build my sheet using the conversion that Steve made to xls and the materials are also there, so i went to the DB and checked
I get materials as tritanium and others But if use Steve Ronuken site i dont see this materials I'm i doing something wrong? because i think that now most of the T2 dont have any tritanium and other low minerals.
Regards Tim |
Desmont McCallock
388
|
Posted - 2014.08.03 11:17:00 -
[36] - Quote
Timcanpy Yvormes wrote:Can some one help me
in the database if i do this -- Base materials SELECT t.typeName, m.quantity FROM invTypeMaterials AS m INNER JOIN invTypes AS t ON m.materialTypeID = t.typeID WHERE m.typeID = 11400--jaguar
I'm asking because i was trying to build my sheet using the conversion that Steve made to xls and the materials are also there, so i went to the DB and checked
I get materials as tritanium and others But if use Steve Ronuken site i dont see this materials I'm i doing something wrong? because i think that now most of the T2 dont have any tritanium and other low minerals.
Regards Tim If I'm not mistaken InvTypeMaterials table is now referring to what the item reprocess to. If you are looking for the manufacturing materials you need to look at Steve's industryActivityMaterials table. Further more if you are using MSSQL DB you can use my YAML/SqLite files importer for your sanity. |
Laendra
Wildly Inappropriate Goonswarm Federation
52
|
Posted - 2014.08.09 04:43:00 -
[37] - Quote
So what genius decided that the activity data needed to be moved out into YAML files? And for what purpose? I mean seriously, a "human readable format"...have they even looked at it, it's not "human readable" at all. Let's look at what that data is used for...3rd party development, and what do they put the rest of the SDE out in, hmmm, a sql database....because that is what 3rd party developers use...databases
:end-rant |
Aineko Macx
Royal Amarr Institute Amarr Empire
302
|
Posted - 2014.08.09 05:36:00 -
[38] - Quote
Laendra wrote:Let's look at what that data is used for...3rd party development, and what do they put the rest of the SDE out in, hmmm, a sql database.... It's not even SQL, but a dump in a closed, proprietary format of a closed, proprietary database. It's beyond me why they don't release standard SQL, which would be trivial through ODBC... iveeCore: PHP library for calculation of industrial activities, now with Crius support |
Desmont McCallock
389
|
Posted - 2014.08.09 17:33:00 -
[39] - Quote
Guys, let's face it, the entire SDE will be moved to YAML files. It was announces (for CCP standards) ages ago. |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
3640
|
Posted - 2014.08.09 19:35:00 -
[40] - Quote
Why is data being put out in yaml files?
Because that's how they're storing it in their versioning system. Because it allows them easy diffing, to see when something was changed, and how it changed. As someone who supports a development team, I can see that's a good reason.
As for why they put it out as a backup file, well, that's just easy for them. Anything else would be extra effort.
As for 'standard SQL', heh. heh heh heh. hehehehehehehehehehehehehehehe. *keels over* Sure, there are SQL standards. The vast majority of databases only kind of stick to them. Woo! CSM 9! http://fuzzwork.enterprises/ Twitter: @fuzzysteve on Twitter |
|
Laendra
Wildly Inappropriate Goonswarm Federation
67
|
Posted - 2014.08.09 23:25:33 -
[41] - Quote
Steve Ronuken wrote:Why is data being put out in yaml files?
Because that's how they're storing it in their versioning system. Because it allows them easy diffing, to see when something was changed, and how it changed. As someone who supports a development team, I can see that's a good reason.
As for why they put it out as a backup file, well, that's just easy for them. Anything else would be extra effort.
As for 'standard SQL', heh. heh heh heh. hehehehehehehehehehehehehehehe. *keels over* Sure, there are SQL standards. The vast majority of databases only kind of stick to them.
Yes, but they are providing the SDE as a convenience for 3rd party developers...YAML isn't a convenience at all. It's pure crap, to be honest.
I am the technical lead developer of my team, and understand the value of having version control for what gets migrated between environments, but if you are going to provide data for other people to use, make it in a format that is easily used by a MAJORITY of the people that are going to want to use it. SQL was fine when it was in there, but there are a lot more standardized ways to share data...XML is old, but reliable enough for this....however, JSON is what is winning out across our LAN.
I wouldn't care if they removed the SQL database part of it, I create JSON data files for what I need out of it anyway....but something a little bit more standardized for public dissemination would sure go a long way to making a lot more people happy..(you know, the ones that haven't illegally hacked into the program/data to get their exports early)
|
Aineko Macx
Royal Amarr Institute Amarr Empire
302
|
Posted - 2014.08.10 06:52:00 -
[42] - Quote
Steve Ronuken wrote:As for 'standard SQL', heh. heh heh heh. hehehehehehehehehehehehehehehe. *keels over* Sure, there are SQL standards. The vast majority of databases only kind of stick to them. Sure, databases have their own extensions and SQL dialects, but exports can be made quite ANSI compliant. iveeCore: PHP library for calculation of industrial activities, now with Crius support |
Aineko Macx
Royal Amarr Institute Amarr Empire
313
|
Posted - 2014.08.10 06:52:27 -
[43] - Quote
Steve Ronuken wrote:As for 'standard SQL', heh. heh heh heh. hehehehehehehehehehehehehehehe. *keels over* Sure, there are SQL standards. The vast majority of databases only kind of stick to them. Sure, databases have their own extensions and SQL dialects, but exports can be made quite ANSI compliant.
To place an analogy: It's akin to CCP releasing eve in icelandic and leaving the translation up to the players. Instead, the correctly recognize that icelandic is not the lingua franca of the internet. The dumps of SQL Server are nowhere near any standard or common norm. If you need to pull the effort card as justification, it just shows once more the priority that 3rd party developer support has at CCP...
iveeCore: PHP library for calculation of industrial activities, now with Hyperion support
|
Codeguard
Codes Corp
97
|
Posted - 2014.08.10 16:44:35 -
[44] - Quote
According to the database, "Civilian Miner" (typeID=3651) contains -2566 Trtanium (negative value!)
select * from invtypematerials inner join invTypes on (invtypematerials.typeID = invTypes.typeID) where invtypematerials.quantity < 0
Funny thing, you can see the same in-game. It also has some funny secret China blueprint. |
Paka-Tegat Birshiri
Paragon Material Extraction and Processing
5
|
Posted - 2014.08.12 16:19:01 -
[45] - Quote
Thanks for the conversion to MySQL, Steve. Question: Is there a set of release notes indicating which YAML files you rolled into non-standard tables? |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
4069
|
Posted - 2014.08.12 18:40:10 -
[46] - Quote
Paka-Tegat Birshiri wrote:Thanks for the conversion to MySQL, Steve. Question: Is there a set of release notes indicating which YAML files you rolled into non-standard tables?
umm, no. I should probably write something, but haven't.
blueprints.yaml is in the industryActivity tables
certificates.yaml is in the cert* tables
iconIDs.yaml is in eveIcons
typeIDs.yaml has: the mastery information broken out into certMasteries the trait information broken out into invTraits
There's additional information in there I've not broken out, as I've not needed it yet.
I've not touched graphicIDs.yaml yet. When/if I do, it'll probably go into a new table. Probably eveGraphics, to match the eveIcons table (which was a recreation of the table that it used to be in)
Woo! CSM 9!
http://fuzzwork.enterprises/
Twitter: @fuzzysteve on Twitter
|
salacious necrosis
Federal Defense Union Gallente Federation
0
|
Posted - 2014.08.13 02:25:47 -
[47] - Quote
Steve Ronuken wrote:Paka-Tegat Birshiri wrote:Thanks for the conversion to MySQL, Steve. Question: Is there a set of release notes indicating which YAML files you rolled into non-standard tables? umm, no. I should probably write something, but haven't. blueprints.yaml is in the industryActivity tables certificates.yaml is in the cert* tables iconIDs.yaml is in eveIcons typeIDs.yaml has: the mastery information broken out into certMasteries the trait information broken out into invTraits There's additional information in there I've not broken out, as I've not needed it yet. I've not touched graphicIDs.yaml yet. When/if I do, it'll probably go into a new table. Probably eveGraphics, to match the eveIcons table (which was a recreation of the table that it used to be in)
re: eveGraphics, that's the route I went, I just recreated the table. However, there are some new fields between versions which occasionally need to be added. I wrote a loader for the yaml which barfs when it finds a new field, at which point I go in and add the field and re-run the loader, etc. The graphics data is one of the easier files to handle.
Slightly off topic, but I have a handy little script that helps me get organized around migrating between DB versions. My script compares two DB versions (hosted on a MySQL server) and reports new tables, missing tables (i.e. tables removed in the latest version), and schema changes for common tables.
I've made the code available on GitHub for those interested.
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
4069
|
Posted - 2014.08.13 12:01:05 -
[48] - Quote
salacious necrosis wrote: Slightly off topic, but I have a handy little script that helps me get organized around migrating between DB versions. My script compares two DB versions (hosted on a MySQL server) and reports new tables, missing tables (i.e. tables removed in the latest version), and schema changes for common tables.
In case people are looking for another tool to do this kind of thing, the mysql utilities package has a bunch of useful tools in it, including one to compare DB schemas.
https://dev.mysql.com/downloads/utilities/
To compare schemas. https://dev.mysql.com/doc/mysql-utilities/1.4/en/mysqldiff.html
To compare schemas, including at the data level. https://dev.mysql.com/doc/mysql-utilities/1.4/en/mysqldbcompare.html
Woo! CSM 9!
http://fuzzwork.enterprises/
Twitter: @fuzzysteve on Twitter
|
salacious necrosis
Federal Defense Union Gallente Federation
0
|
Posted - 2014.08.13 13:35:51 -
[49] - Quote
NICE! Can't believe I missed those. Way less hacky than what I put together. |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
4069
|
Posted - 2014.08.19 00:00:43 -
[50] - Quote
1.9 is out (oops. Missed this being released for around a week.)
Official release is on: http://community.eveonline.com/community/fansites/toolkit/
Conversions: Mysql: https://www.fuzzwork.co.uk/dump/mysql56-crius-1.9-100804.tbz2
Sqlite: https://www.fuzzwork.co.uk/dump/crius-1.9-100804/eve.db.bz2
Postgres https://www.fuzzwork.co.uk/dump/crius-1.9-100804/postgres-crius-1.9-100804.dmp.bz2
Postgres dump is now done in postgres format, for restoration with pg_restore. excludes privileges.
Everything else: https://www.fuzzwork.co.uk/dump/crius-1.9-100804/
Woo! CSM 9!
http://fuzzwork.enterprises/
Twitter: @fuzzysteve on Twitter
|
|
Derrick Miles
EVENumbers
10291
|
Posted - 2014.08.20 07:05:26 -
[51] - Quote
Steve Ronuken wrote:1.9 is out (oops. Missed this being released for around a week.)
You're slipping!
Thanks for the conversions. |
Zifrian
Licentia Ex Vereor Northern Associates.
1573
|
Posted - 2014.08.20 11:09:05 -
[52] - Quote
Desmont McCallock wrote:Guys, let's face it, the entire SDE will be moved to YAML files. It was announces (for CCP standards) ages ago. But when they changes all the universe data, they put it out as an SQLite file...not to mention that post about yaml was several years ago and we've seen little in the movement to it until Cirus.
I think expecting whatever hodgepodge system they want to use that day will be what we get. 3rd party dev support is a collateral anyway, we can't expect much when it's not their primary goal. We just have to be flexible.
GÇ£Any fool can criticize, condemn, and complain - and most fools do. GÇ¥ - Dale Carnegie
Maximze your Industry Potential! - Download EVE Isk per Hour!
|
Desmont McCallock
408
|
Posted - 2014.08.21 09:49:54 -
[53] - Quote
Zifrian wrote:Desmont McCallock wrote:Guys, let's face it, the entire SDE will be moved to YAML files. It was announces (for CCP standards) ages ago. But when they changes all the universe data, they put it out as an SQLite file...not to mention that post about yaml was several years ago and we've seen little in the movement to it until Cirus. I think expecting whatever hodgepodge system they want to use that day will be what we get. 3rd party dev support is a collateral anyway, we can't expect much when it's not their primary goal. We just have to be flexible. Universe data where a little massive to extract to a YAML file and that's why they chose Sqllite. From my point of view they should had gone with Sqlite for the entire SDE, as it's another DB format anyway which wouldn't be much of a hassle to adjust our tools and apps to it.
|
salacious necrosis
Federal Defense Union Gallente Federation
0
|
Posted - 2014.08.23 14:27:08 -
[54] - Quote
Hi Steve,
Looks like you have dups in industryActivityRaces. Two for every row it seems. If that was on purpose then I don't understand your devious scheme
Cheers, sal
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
4069
|
Posted - 2014.08.23 14:40:07 -
[55] - Quote
salacious necrosis wrote:Hi Steve, Looks like you have dups in industryActivityRaces. Two for every row it seems. If that was on purpose then I don't understand your devious scheme Cheers, sal
Umm. I know exactly why that happened. oops.
(I used my intermediate schema as a place to create that table, and forgot to dump it before the most recent load. so it was loaded into twice)
Woo! CSM 9!
http://fuzzwork.enterprises/
Twitter: @fuzzysteve on Twitter
|
Desmont McCallock
408
|
Posted - 2014.08.26 14:27:38 -
[56] - Quote
Hyperion 1.0 SDE is out. Let the conversions begin! |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
3746
|
Posted - 2014.08.26 14:54:00 -
[57] - Quote
Official release is on: http://community.eveonline.com/community/fansites/toolkit/
Conversions: Mysql: https://www.fuzzwork.co.uk/dump/mysql56-hyperion-1.0-101505.tbz2
Sqlite: https://www.fuzzwork.co.uk/dump/hyperion-1.0-101505/eve.db.bz2
Postgres https://www.fuzzwork.co.uk/dump/hyperion-1.0-101505/postgres-hyperion-1.0-101505.dmp.bz2
Postgres dump is now done in postgres format, for restoration with pg_restore. excludes privileges.
Everything else: https://www.fuzzwork.co.uk/dump/hyperion-1.0-101505/ Woo! CSM 9! http://fuzzwork.enterprises/ Twitter: @fuzzysteve on Twitter |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
4069
|
Posted - 2014.08.26 14:54:02 -
[58] - Quote
Official release is on: http://community.eveonline.com/community/fansites/toolkit/
Conversions: Mysql: https://www.fuzzwork.co.uk/dump/mysql56-hyperion-1.0-101505.tbz2
Sqlite: https://www.fuzzwork.co.uk/dump/hyperion-1.0-101505/eve.db.bz2
Postgres https://www.fuzzwork.co.uk/dump/hyperion-1.0-101505/postgres-hyperion-1.0-101505.dmp.bz2
Postgres dump is now done in postgres format, for restoration with pg_restore. excludes privileges.
Everything else: https://www.fuzzwork.co.uk/dump/hyperion-1.0-101505/
NEW: https://www.fuzzwork.co.uk/dump/hyperion-1.0-101505/postgres-hyperion-1.0-101505-evesde.dmp.bz2
The same postgres conversion, but in a distinct schema 'evesde' rather than public
Woo! CSM 9!
http://fuzzwork.enterprises/
Twitter: @fuzzysteve on Twitter
|
Desmont McCallock
408
|
Posted - 2014.08.26 15:28:35 -
[59] - Quote
Just a heads up. There are new categories added in dgmAttributeCategories. |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
4069
|
Posted - 2014.08.26 15:41:02 -
[60] - Quote
Desmont McCallock wrote:Just a heads up. There are new categories added in dgmAttributeCategories.
Really? I'm only seeing 28 of them, same as before?
Woo! CSM 9!
http://fuzzwork.enterprises/
Twitter: @fuzzysteve on Twitter
|
|
|
|
|
Pages: 1 [2] 3 :: one page |
First page | Previous page | Next page | Last page |