EVE Search - Retribution 1.0 SDE Issues

Check My IP Information

All Channels

EVE Technology Lab

Retribution 1.0 SDE Issues

» Click here to find additional results for this topic using Google

Monitor this thread via RSS [?]


Author	Thread Statistics \| Show CCP posts - 16 post(s)

CCP Prism X C C P C C P Alliance 1005	Posted - 2012.12.06 08:50:00 - [1] - Quote Sorry for that guys. In my defense I no longer maintain the SDE code nor have anything to do with its generation. I just knew people would want to get their hands on it ASAP so I Tweeted it. But I think the new SDE guy might be busy with post expansion fallout. I'll poke at him and if he is I'll just get stuff sorted myself. @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1006	Posted - 2012.12.06 11:23:00 - [2] - Quote Quantix BlackStar wrote: The 'Fleet Assistance Modules' market group (listed as groupId 799 in the SDE), has no sub groups so ganglinks, portal generators, etc are in groups that do not exist currently. Not sure what you mean. Group 799 is a hasTypes=1 group so subgroups are not to be expected. Instead there are types in invTypes that have a marketGroupID of 799. Am I misunderstanding something? @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1006	Posted - 2012.12.06 12:34:00 - [3] - Quote Muscaat wrote: CCP Prism X wrote: Quantix BlackStar wrote: The 'Fleet Assistance Modules' market group (listed as groupId 799 in the SDE), has no sub groups so ganglinks, portal generators, etc are in groups that do not exist currently. Not sure what you mean. Group 799 is a hasTypes=1 group so subgroups are not to be expected. Instead there are types in invTypes that have a marketGroupID of 799. Am I misunderstanding something? 799 is present and correct AFAICT; it's the group for blueprints of items that live in subgroups of the missing 779. Ah! Now we're talking! @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1010	Posted - 2012.12.07 08:28:00 - [4] - Quote Just checking in so nobody thinks I forgot about you. Yesterday was quite intensive on meetings with regards to going over the deployment, the development cycle leading up to it and starting to line up our ducks for the next cycle. In between those I was looking at the SDE (and other things) and I'm pretty confident I'll be done with it by noon GMT. I'll try and shanghai some people into releasing it ASAP and post the new link here as well as twitter. @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1011	Posted - 2012.12.07 11:13:00 - [5] - Quote New SDE, probably with new bugs in it! @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1011	Posted - 2012.12.07 11:57:00 - [6] - Quote Hmm, not 100% sure atm but it sure does look like something got sanitized out of the types that shouldn't have. I'll beat at it with a stick for a while and see what happens. @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1011	Posted - 2012.12.07 12:01:00 - [7] - Quote Yeah I accidentally put an inner join on the description, change log clearly states that was a mistake. Gimmie a few moments. @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1011	Posted - 2012.12.07 12:10:00 - [8] - Quote Vessper wrote: mapSolarSystems has no rows in the new SDE? Dunno about the broken one I generated but the one I'm uploading now seems cool: SELECT COUNT() FROM mapSolarSystems 7929 (1 row(s) affected) @CCP_PrismX* EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1011	Posted - 2012.12.07 12:19:00 - [9] - Quote Yeah that makes sense. The sun types do not have a description authored. Therefore they did not get dumped into the types table, and thus all solar systems were removed as they have a sunTypeID authored and all sun types were deleted. However: New fixedfixed version uploaded to same addy and CDN cache purged. That's attempt two, I'm aiming for "Third time's the charm!" though! @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1012	Posted - 2012.12.07 13:21:00 - [10] - Quote Probably is. And this is why we should be releasing the SDE before deploying the expansion. I'm going to wait for some more issues to crop up before generating another one. @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express



CCP Prism X C C P C C P Alliance 1015	Posted - 2012.12.18 09:29:00 - [11] - Quote I'm not ignoring this, I'm just busy with other things. My plan is to do my utmost to get everything I need to have done, and fix the SDE as well, before I go on vacation. Please don't hate me, I'm delicate like a lotus flower in bloom. @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1015	Posted - 2012.12.18 12:42:00 - [12] - Quote Can't speak for the company, but this is low on my priority list because I'm actually not responsible for this and would rather finish up stuff first for which I will be held accountable. Not an ideal situation I know, but them's the breaks. As to why this breaks all the time: Multiple reasons. Bad authoring + bad integration of static data between branches + bad code in the generation scripts that has never been bad before because it needed the bad authoring + bad integration to actually become an issue, was the first issue. So I had to make code changes to shield you from broken relations, empty record names and such. And when you change code ** breaks. And thus I'm really responsible for this. And that's why I'll be making another dump, fixed according to the issues I see here. I was going to wait a few days to sort out all the issues, as I understood from the first few posts that the issues weren't that critical anymore. Just some missing eveUnits records. Apparently that is not the case. But other stuff comes up. I need to respond to that as well. It's no fun when what you need gets ranked on a low priority but it has to happen somewhere. Otherwise you're not prioritizing. But I was planning on doing this today, that might not work out anymore as I've lost a lot of time between the morning and noon due to unforeseen issues. Today or tomorrow. Sorry for the delay. If someone would make a conscice bulletpointed list of all the remaining issues, I might consider hugging him next FanFest. But it's not like it's a huge issue for me to do it myself either. But then you don't get to feel like you helped! @CCP_PrismX EVE** Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1015	Posted - 2012.12.18 13:02:00 - [13] - Quote I'm not much involved with the YAML files. I suspect they'll just create more issues, at least for a fair bit. They already have. I see numerous posts here about people wondering why invTypes doesn't have an iconID, and that's because typeID->iconID and typeID->graphicID relations have been moved into YAML files. So we now have type information split between the restore data and the YAML data. However, YAML data should be less prone to bullshit incidents such as the data we ship to you not being the 100% current data of the release branch. As it stands we have a code versioning system and a seperate data versioning system, which means the data can be out of synch with the code. Of course we've put a lot of effort into both avoiding that and handling such incidents gracefully so we don't notice this, f.e. all the unnamed types went out to TQ and broke nothing but broke lots of third party apps. And CREST has nothing to do with the SDE. Just like the API has nothing to do with the SDE. Although obviously any application that uses the API (Legacy or, in the future, CREST) could benefit from having data from the SDE stored locally. @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1016	Posted - 2012.12.18 15:34:00 - [14] - Quote We've got a new SDE up guys, get it while it's hot! IMPORTANT NOTICE: READ THIS OR YOU'LL GET ANGRY WHEN I MAKE FUN OF YOU FOR NOT HAVING READ THIS! Now that I got your attention, reading this will also make you angry. There is no iconID or graphicID in invTypes anymore. You will never find it there again. It has been moved into the types.YAML file we ship with the SDE zip file. If you're using a third party conversion that does not include this data in one form or another that's your converter doing something wrong. If you are doing a conversion and want this data back into a relationial database, you're going to have to get it from the YAML file. Changelog: invTypes: Problem: table is missing the iconID column. Solution: Get them, along with the graphicIDs, from types.YAML. They will not be found in the official backup. eveUnits: Problem: unitID 103, 122, 129 is missing. Solution: These units do not have a display name, do include units without a display name. dogmaTypeAttributes, dogmaAttributeTypes: Problem: Missing slot attributes Solution: Fixing eve units to include the units will retain the slot data rathre than sanitizing it out as a broken relation. invMarketGroups, invTypes Problem: Missing records. Solution: These are unreleased DUST records which do not belong in the SDE. ramTypeRequirements Problem: Data Interfaces for invention have a damage per job of 1. Solution: This is how the data is authored and always has been. Checked the history. I can't fix things that are by design. Interfaces are special cased in our code. Maybe one day I get to rewrite the clusterintimacy that the S&I backend is. invMarketGroups Problem: Market groups exist with hasTypes = 0, but still have types. Market groups exist with hasTypes = 1 but have no types. Solution: Check these relations and sanitize out bad data. I have no clue when GD will actually fix the data but at least I can fix your SDE @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1017	Posted - 2012.12.19 09:40:00 - [15] - Quote Fixing stools! I'm going on vacation after tomorrow, Thursday the 20th of December. That means if there are more issues after tomorrow they will not get fixed until 2013. I'm going carefully over all the joins I added to ensure that no further data is lost from the first update to remove the nameless records. Hopefully there will be no further issues with that specific change. But if there's anything other broken, the window to report it is getting slimmer by the minute. @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express


CCP Prism X C C P C C P Alliance 1019	Posted - 2012.12.19 11:26:00 - [16] - Quote Yet another SDE Deployment: http://content.eveonline.com/data/Retribution_1.0.7_463858_db.zip @CCP_PrismX EVE Database Developer and Expert Ranter Member of Team Pony Express

COPYRIGHT NOTICE
EVE Online, the EVE logo, EVE and all associated logos and designs are the intellectual property of CCP hf. All artwork, screenshots, characters, vehicles, storylines, world facts or other recognizable features of the intellectual property relating to these trademarks are likewise the intellectual property of CCP hf. EVE Online and the EVE logo are the registered trademarks of CCP hf. All rights are reserved worldwide. All other trademarks are the property of their respective owners. CCP hf. has granted permission to EVE-Search.com to use EVE Online and all associated logos and designs for promotional and information purposes on its website but does not endorse, and is not in any way affiliated with, EVE-Search.com. CCP is in no way responsible for the content on or functioning of this website, nor can it be liable for any damage arising from the use of this website.