Pages: [1] 2 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 4 post(s) |
Desmont McCallock
542
|
Posted - 2015.07.08 20:27:15 -
[1] - Quote
SDE for Aegis just got released so get your copies. Stay tuned for more info on it. |
Medusa The Gorgon
Temple of the Serpent The Gorgon Empire
3
|
Posted - 2015.07.08 20:29:42 -
[2] - Quote
Desmont McCallock wrote:SDE for Aegis just got released so get your copies. Stay tuned for more info on it. invTypes table is empty |
Desmont McCallock
542
|
Posted - 2015.07.08 20:32:15 -
[3] - Quote
We already knew that this would happen. |
Medusa The Gorgon
Temple of the Serpent The Gorgon Empire
3
|
Posted - 2015.07.08 20:35:49 -
[4] - Quote
You mean it won't be released or it somewhere else or the dump is flawed? My killboard relies on that table... |
|
CCP Tellus
C C P C C P Alliance
9
|
Posted - 2015.07.08 20:42:02 -
[5] - Quote
Medusa The Gorgon wrote:You mean it won't be released or it somewhere else or the dump is flawed? My killboard relies on that table... The types are now stored in one of the YAML files, typeIDs.yaml. |
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5420
|
Posted - 2015.07.08 21:02:22 -
[6] - Quote
CCP Tellus wrote:Medusa The Gorgon wrote:You mean it won't be released or it somewhere else or the dump is flawed? My killboard relies on that table... The types are now stored in one of the YAML files, typeIDs.yaml. But a bunch of the information which was in invTypes is now completely gone.
| mass | double | YES | | NULL | | | volume | double | YES | | NULL | | | capacity | double | YES | | NULL | | | portionSize | int(11) | YES | | NULL | | | raceID | tinyint(3) unsigned | YES | | NULL | | | basePrice | decimal(19,4) | YES | | NULL | | | published | tinyint(1) | YES | | NULL | | | marketGroupID | int(11) | YES | | NULL | | | chanceOfDuplicating | double | YES | | NULL | |
all missing.
Will it be returned (in some form), or is it gone forever?
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
|
CCP Tellus
C C P C C P Alliance
9
|
Posted - 2015.07.08 21:11:56 -
[7] - Quote
Steve Ronuken wrote:Will it be returned (in some form), or is it gone forever? I'll poke some people and see if they know where this data has vanished to.
|
|
Desmont McCallock
543
|
Posted - 2015.07.08 21:13:33 -
[8] - Quote
Well, the disturbing part with this SDE release is the data lose it introduces on the invTypes table. We (3rd party devs) already mentioned that this would be a problem for us but why should CCP had listen to us. |
Medusa The Gorgon
Temple of the Serpent The Gorgon Empire
3
|
Posted - 2015.07.08 21:23:13 -
[9] - Quote
Data supplied in yaml is not enough. I don't see groupID or mass or baseprice, for exampe. Please return table in MSSQL dump. Even if you supplied the correct yaml - what are you trying to achieve ? Portion of data in MSSQL, another portion in yaml. This is stupid. Next time you disable XML API and tell us all to use CREST ? I hope, I will be retired player when you'll think about it. |
Ydnari
Estrale Frontiers
403
|
Posted - 2015.07.08 21:35:05 -
[10] - Quote
Pretty shoddy.
my teapot is ready
|
|
Mr Mac
Dark Goliath
72
|
Posted - 2015.07.08 22:24:25 -
[11] - Quote
Heh, CCP make more challenge in DB than the game for capsuleers |
Zifrian
Licentia Ex Vereor Phoebe Freeport Republic
1647
|
Posted - 2015.07.08 22:36:24 -
[12] - Quote
Desmont McCallock wrote:Well, the disturbing part with this SDE release is the data lose it introduces on the invTypes table. We (3rd party devs) already mentioned that this would be a problem for us but why should CCP had listen to us. invGroups and invCategories are also empty. The thing that is odd is that the empty tables are still in the SDE.
I would have liked to have a better heads up on this. The previous discussion Desmont refers too sounded like a thing that will happen, but not this patch.
GÇ£Any fool can criticize, condemn, and complain - and most fools do. GÇ¥ - Dale Carnegie
Maximze your Industry Potential! - Download EVE Isk per Hour!
|
Zifrian
Licentia Ex Vereor Phoebe Freeport Republic
1647
|
Posted - 2015.07.08 22:39:42 -
[13] - Quote
Steve Ronuken wrote:CCP Tellus wrote:Medusa The Gorgon wrote:You mean it won't be released or it somewhere else or the dump is flawed? My killboard relies on that table... The types are now stored in one of the YAML files, typeIDs.yaml. But a bunch of the information which was in invTypes is now completely gone. | mass | double | YES | | NULL | | | volume | double | YES | | NULL | | | capacity | double | YES | | NULL | | | portionSize | int(11) | YES | | NULL | | | raceID | tinyint(3) unsigned | YES | | NULL | | | basePrice | decimal(19,4) | YES | | NULL | | | published | tinyint(1) | YES | | NULL | | | marketGroupID | int(11) | YES | | NULL | | | chanceOfDuplicating | double | YES | | NULL | | all missing. Will it be returned (in some form), or is it gone forever? Volume, portionSize, raceID, published and marketGroupID are all essential to IPH processing.
GÇ£Any fool can criticize, condemn, and complain - and most fools do. GÇ¥ - Dale Carnegie
Maximze your Industry Potential! - Download EVE Isk per Hour!
|
Jack Tronic
borkedLabs
239
|
Posted - 2015.07.09 00:03:09 -
[14] - Quote
Those are all dogma attributes.
Learn 2 database guis |
Darkblad
Hilf Dir selbst in EVE
1656
|
Posted - 2015.07.09 06:04:18 -
[15] - Quote
Entries with tcID 33 also got removed from trnTranslationColumns and trnTranslations It contained translations of invTypes.description, which is in the typeIDs.yaml
I can't remember the tcID of translations for typeName right now.
Next to other use cases, tcID was essential for a special use case, as I already mentioned in the #devfleet slack.
EVE Infolinks GÇó Mining Guide GÇó Missions
(EN & DE)
|
Darkblad
Hilf Dir selbst in EVE
1657
|
Posted - 2015.07.09 06:16:20 -
[16] - Quote
It also appears to be intentional, that invGroups and invCategories is empty:
ebs_DATADUMP.sql wrote:-- -- CHANGE LOG STARTS
-- CHANGED IN (realeaseName) (releaseNumber)
-- Removed table invTypes -- Removed table invGroups -- Removed table invCategories -- Removed all keys on and referring invTypes, invGroups and invCategories (no DROP TABLE for any of those in the sql below)
I love it how the CHANGED IN values did'nt get added
EVE Infolinks GÇó Mining Guide GÇó Missions
(EN & DE)
|
Hel O'Ween
Men On A Mission
120
|
Posted - 2015.07.09 07:14:01 -
[17] - Quote
Medusa The Gorgon wrote:what are you trying to achieve
CCP's reason is (simply put) shifting (the client's) database lookup away from the centralized server and towards decentralized/local lookups. Which is good for the game (server load) and the game client ... but leaves us 3rd party devs with the mess we're currently facing ...
EVEWalletAware - an offline wallet manager.
|
Desmont McCallock
548
|
Posted - 2015.07.09 07:28:48 -
[18] - Quote
There is only one workaround I see atm. Copy missing data from previous SDE and hope for the best. But this is not long term viable solution. I still have hope that the guy/guys at CCP will rise to the occasion. |
Darkblad
Hilf Dir selbst in EVE
1658
|
Posted - 2015.07.09 07:42:02 -
[19] - Quote
Taking into account how much CCP did rise regarding the missing tcID 33 that happened with the carnyx SDE ("not"), I'm not optimistic. Though that flaw most likely only affected A few 3rd parties.
EVE Infolinks GÇó Mining Guide GÇó Missions
(EN & DE)
|
Desmont McCallock
548
|
Posted - 2015.07.09 07:44:41 -
[20] - Quote
Yet another workaround is to tap directly into the dbs the client uses. Have a look at your clients' bin folder. You will find there the missing data (evecategories.db, evegroups.db, evetypes.db). Those are SQLite dbs. |
|
Darkblad
Hilf Dir selbst in EVE
1664
|
Posted - 2015.07.09 08:06:38 -
[21] - Quote
CCP Tellus wrote:Steve Ronuken wrote:Will it be returned (in some form), or is it gone forever? I'll poke some people and see if they know where this data has vanished to. To quote myself from last week's thread on this matter:Within evetypes.db you will find this, within evegroups.db there's that while evecategories.db contains this.
I think we don't have any access to
typeNameID, groupNameID, categoryNameID
right?
Edit: Should've refreshed this thead before posting, Desmont already mentioned that.
EVE Infolinks GÇó Mining Guide GÇó Missions
(EN & DE)
|
Kali Izia
GoomWaffe Goonswarm Federation
53
|
Posted - 2015.07.09 10:03:36 -
[22] - Quote
Darkblad wrote:I think we don't have any access to
typeName, groupNameID, categoryNameID
right? The localized strings are stored as standard Python pickled objects in the shared resource cache, for example res:/localizationfsd/localization_fsd_en-us.pickle. You just load that and then look up the IDs to get the names. |
Darkblad
Hilf Dir selbst in EVE
1664
|
Posted - 2015.07.09 10:08:02 -
[23] - Quote
That's far beyond my own knowledge, and I'm bot sure how this would be in regards of eula limitations
EVE Infolinks GÇó Mining Guide GÇó Missions
(EN & DE)
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5421
|
Posted - 2015.07.09 10:09:21 -
[24] - Quote
Medusa The Gorgon wrote:Data supplied in yaml is not enough. I don't see groupID or mass or baseprice, for exampe. Please return table in MSSQL dump. Even if you supplied the correct yaml - what are you trying to achieve ? Portion of data in MSSQL, another portion in yaml. This is stupid. Next time you disable XML API and tell us all to use CREST ? I hope, I will be retired player when you'll think about it.
What they're working on is shifting data to a system which allows them to properly version control it (which is really difficult to do with a regular database)
We, unfortunately, are collateral damage. Which I'm hopeful will get fixed, because CCP does realise the value of their developer community.
Woo! CSM X!
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Desmont McCallock
549
|
Posted - 2015.07.09 10:23:04 -
[25] - Quote
Steve Ronuken wrote:Medusa The Gorgon wrote:Data supplied in yaml is not enough. I don't see groupID or mass or baseprice, for exampe. Please return table in MSSQL dump. Even if you supplied the correct yaml - what are you trying to achieve ? Portion of data in MSSQL, another portion in yaml. This is stupid. Next time you disable XML API and tell us all to use CREST ? I hope, I will be retired player when you'll think about it. What they're working on is shifting data to a system which allows them to properly version control it (which is really difficult to do with a regular database) We, unfortunately, are collateral damage. Which I'm hopeful will get fixed, because CCP does realise the value of their developer community. Steve, I haven't lost hope yet cause I'm counting on you.
|
Desmont McCallock
549
|
Posted - 2015.07.09 10:33:13 -
[26] - Quote
Kali Izia wrote:Darkblad wrote:I think we don't have any access to
typeName, groupNameID, categoryNameID
right? The localized strings are stored as standard Python pickled objects in the shared resource cache, for example res:/localizationfsd/localization_fsd_en-us.pickle. You just load that and then look up the IDs to get the names. Kali, thanks for the tip.
So here it goes:
- Go to your EVE client installation folder and locate the 'resfileindex.txt' or the 'resfileindex_prefetch.txt'.
- In any of those files locate 'res:/localizationfsd/localization_fsd_en-us.pickle'
- You will see after it some comma separated GUID values like '2c/2c3038b3c38e91a1_73c2c98a71e82e768ed5576850c89554'. '2c' is the name of the folder under the 'SharedCache/ResFiles' folder and '2c3038b3c38e91a1_73c2c98a71e82e768ed5576850c89554' is the file inside that folder.
- In case you can't locate the file do a 'Date modified' (assuming you work on Windows) asc ordering and open the first file in the list. This is the most resent cached file.
- Assuming that you are looking for the "groupNameID": 63576, do a search with the ID in the file and you will end up with 'sI63576 (V#System' where '#System' is the name you are looking for.
This of course doesn't make our lifes any easier but at least now you know where to find what you are looking for. |
Zifrian
Licentia Ex Vereor Phoebe Freeport Republic
1647
|
Posted - 2015.07.09 11:15:44 -
[27] - Quote
Desmont McCallock wrote:Kali Izia wrote:Darkblad wrote:I think we don't have any access to
typeName, groupNameID, categoryNameID
right? The localized strings are stored as standard Python pickled objects in the shared resource cache, for example res:/localizationfsd/localization_fsd_en-us.pickle. You just load that and then look up the IDs to get the names. Kali, thanks for the tip. So here it goes:
- Go to your EVE client installation folder and locate the 'resfileindex.txt' or the 'resfileindex_prefetch.txt'.
- In any of those files locate 'res:/localizationfsd/localization_fsd_en-us.pickle'
- You will see after it some comma separated GUID values like '2c/2c3038b3c38e91a1_73c2c98a71e82e768ed5576850c89554'. '2c' is the name of the folder under the 'SharedCache/ResFiles' folder and '2c3038b3c38e91a1_73c2c98a71e82e768ed5576850c89554' is the file inside that folder.
- In case you can't locate the file do a 'Date modified' (assuming you work on Windows) asc ordering and open the first file in the list. This is the most recent cached file.
- Assuming that you are looking for the "groupNameID": 63576, do a search with the ID in the file and you will end up with 'sI63576 (V#System' where '#System' is the name you are looking for.
This of course doesn't make our lifes any easier but at least now you know where to find what you are looking for. So those numbers are for localzation and not just the eveNames ids?
Also, given the screenshots above from Darkblad, it doesn't look like all the missing typeNames data is there either (volume, portionsize, seem to be there but no raceid or marketgroup, which I bet the answer will be to look it up elsewhere)
GÇ£Any fool can criticize, condemn, and complain - and most fools do. GÇ¥ - Dale Carnegie
Maximze your Industry Potential! - Download EVE Isk per Hour!
|
Darkblad
Hilf Dir selbst in EVE
1665
|
Posted - 2015.07.09 11:23:37 -
[28] - Quote
Zifrian wrote:This of course doesn't make our lifes any easier but at least now you know where to find what you are looking for. So those numbers are for localzation and not just the eveNames ids?[/quote] That's correct. You'll find tons of (localized) strings in there, including but not limited to the names above but also mission and exploration site names etc.
Using the pickle streams, keep in mind that there are two of them (for each language). The one with "_fsd_" in the name should be that with mostly UI related strings
Currently, the ones for en-us are:
res:/localization/localization_en-us.pickle, c5/c57ec45bccb817c6_a6cdff32f12b2b313d39bec8b3ee1498,a6cdff32f12b2b313d39bec8b3ee1498 ,11802775,3327543
res:/localizationfsd/localization_fsd_en-us.pickle, 2c/2c3038b3c38e91a1_83d437095945038afd8283de2c046472,83d437095945038afd8283de2c046472 ,9516237,2035771
EVE Infolinks GÇó Mining Guide GÇó Missions
(EN & DE)
|
|
CCP Creber Cattus
C C P C C P Alliance
41
|
Posted - 2015.07.09 17:02:53 -
[29] - Quote
Wow.. looks like this release was a bit broken SDE wise!
We have now added the missing attributes to the types in typeIDs.yaml: mass, volume, capacity, portionSize, raceID, basePrice, published and marketGroupID
Also group and category info has been added (new files: groupIDs.yaml and categoryIDs.yaml).
Hope this helps |
|
Desmont McCallock
551
|
Posted - 2015.07.09 17:04:56 -
[30] - Quote
CCP Creber Cattus wrote:Wow.. looks like this release was a bit broken SDE wise! We have now added the missing attributes to the types in typeIDs.yaml: mass, volume, capacity, portionSize, raceID, basePrice, published and marketGroupID Also group and category info has been added (new files: groupIDs.yaml and categoryIDs.yaml). Hope this helps Better late than never. You guys restored my confidence.
|
|
|
|
|
Pages: [1] 2 :: one page |
First page | Previous page | Next page | Last page |