Pages: 1 [2] 3 4 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 17 post(s) |
Desmont McCallock
604
|
Posted - 2016.04.26 14:23:10 -
[31] - Quote
@CCP Tellus Questions: 1. Will this be the naming format for the SDE filename from now on? 2. Where do we find the 'translationTables' table? Do we have to create it on our own? |
|
CCP Tellus
C C P C C P Alliance
59
|
Posted - 2016.04.26 14:45:14 -
[32] - Quote
Desmont McCallock wrote:1. Will this be the naming format for the SDE filename from now on? Is there any particular reason you're relying on the filename format remaining consistent? It may or may not change in the future.
Desmont McCallock wrote:2. Where do we find the 'translationTables' table? Do we have to create it on our own? The 'translationTables' table was an internal look-up table used to construct the 'trnTranslations' and 'trnTranslationColumns' tables. It had not gotten deleted after the SDE export script ran. Do you know of a use-case for that table?
Desmont McCallock wrote:3. Would you mind fixing the duplicate entries in blueprints.yaml file? (Can provide exact info if needed) I can take a look at blueprints.yaml. Can you send me the details? |
|
Desmont McCallock
604
|
Posted - 2016.04.26 14:53:18 -
[33] - Quote
CCP Tellus wrote: Is there any particular reason you're relying on the filename format remaining consistent? It may or may not change in the future.
In my tool I have an algorithm that tries to detect if the user has dropped in the specific folder the zipped file or (s)he has extracted the content of the zipped file. If a zipped file is detected the tool unzips the content automatically. The algorithm does a match search depending on the file name (we don't want to unzip any zip file but only the SDE one)
CCP Tellus wrote: The 'translationTables' table was an internal look-up table used to construct the 'trnTranslations' and 'trnTranslationColumns' tables. It had not gotten deleted after the SDE export script ran. Do you know of a use-case for that table?
Mainly for backwards compatibility. I haven't ran into a situation nor seen anyone talking about that table, but you know how things goes. Remove something and someone will complain about it.
CCP Tellus wrote: I can take a look at blueprints.yaml. Can you send me the details?
Details already provided via editing my OP. |
Salvoxia
Evoke. Ev0ke
8
|
Posted - 2016.04.26 14:55:12 -
[34] - Quote
Hi,
previous SDE releases always contained some kind of version or build number (for the last one it was 117575 for example). I always used it to reference the exact SDE release. Will there be something similar for the new release format or will you just use the release date?
Best Regards, Salvoxia |
|
CCP Tellus
C C P C C P Alliance
59
|
Posted - 2016.04.26 15:55:08 -
[35] - Quote
Desmont McCallock wrote:In my tool I have an algorithm that tries to detect if the user has dropped in the specific folder the zipped file or (s)he has extracted the content of the zipped file. If a zipped file is detected the tool unzips the content automatically. The algorithm does a match search depending on the file name (we don't want to unzip any zip file but only the SDE one) . You can use the following regular expression:
sde-(.+).zip We will probably not change the file naming scheme, but we may change where we host static data exports in the future.
Salvoxia wrote:previous SDE releases always contained some kind of version or build number (for the last one it was 117575 for example). I always used it to reference the exact SDE release. Will there be something similar for the new release format or will you just use the release date? Use the date and the branch name. |
|
Hel O'Ween
Men On A Mission
159
|
Posted - 2016.04.26 16:05:28 -
[36] - Quote
Is this upposed to be the official SDE release for the Citadel expansion. If so, ramTypeRequirements seems to have some PK issues:
Reason was: Violation of PRIMARY KEY constraint 'ramTypeRequirements_PK'. A duplicate key can't be inserted into the dbo.ramTypeRequirements object. The duplicate key value is (41590, 1, 38).
EVEWalletAware - an offline wallet manager.
|
|
CCP Tellus
C C P C C P Alliance
59
|
Posted - 2016.04.26 16:11:45 -
[37] - Quote
Hel O'Ween wrote:Is this upposed to be the official SDE release for the Citadel expansion. If so, ramTypeRequirements seems to have some PK issues: Am I missing something? I am not able to find a table called ramTypeRequirements.
|
|
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5978
|
Posted - 2016.04.26 16:17:39 -
[38] - Quote
ramTypeRequirements is an old table. And it's probable that the 'bug' there is due to the conversion from yaml to the sqlserver db, with Desmont's code?
I'm running again for CSM 11, and I'd appreciate your vote.
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Desmont McCallock
604
|
Posted - 2016.04.26 16:37:47 -
[39] - Quote
Yeah guys, it has to do with the duplicate entry in blueprints.yaml file I have already reported in this thread. |
Desmont McCallock
604
|
Posted - 2016.04.26 16:43:39 -
[40] - Quote
CCP Tellus wrote:Desmont McCallock wrote:In my tool I have an algorithm that tries to detect if the user has dropped in the specific folder the zipped file or (s)he has extracted the content of the zipped file. If a zipped file is detected the tool unzips the content automatically. The algorithm does a match search depending on the file name (we don't want to unzip any zip file but only the SDE one) . You can use the following regular expression: sde-(.+).zip We will probably not change the file naming scheme, but we may change where we host static data exports in the future. I would rather avoid adding another regex search but you're the Boss.
|
|
Cwittofur Cesaille
Quantum Distributions Crit My Hole
4
|
Posted - 2016.04.26 17:29:30 -
[41] - Quote
Desmont McCallock wrote:CCP Tellus wrote:Desmont McCallock wrote:In my tool I have an algorithm that tries to detect if the user has dropped in the specific folder the zipped file or (s)he has extracted the content of the zipped file. If a zipped file is detected the tool unzips the content automatically. The algorithm does a match search depending on the file name (we don't want to unzip any zip file but only the SDE one) . You can use the following regular expression: sde-(.+).zip We will probably not change the file naming scheme, but we may change where we host static data exports in the future. I would rather avoid adding another regex search but you're the Boss. Edit: Just for educational purpose here the regex expression I use to match the filename of all SDE releases so far. ".*_\d+\.\d+[\.\d+]*_\d+[_db]*\.zip|sde-\d+-\w+[-legacy]*\.zip"
That's a gnarly regex. Why are you using Square brackets everywhere? Those only match single characters. It may be different based on languages but I believe you should change your [_db]* to (_db)? and your [-legacy]* to (-legacy)? |
Desmont McCallock
604
|
Posted - 2016.04.26 17:32:43 -
[42] - Quote
No I don't, cause I don't want to group match. "_db" and "_legacy" may appear or not in the filename. |
Cwittofur Cesaille
Quantum Distributions Crit My Hole
4
|
Posted - 2016.04.26 17:45:01 -
[43] - Quote
Desmont McCallock wrote:No I don't, cause I don't want to group match. "_db" and "_legacy" may appear or not in the filename.
That's what the ? is for, it makes it so it can appear but isn't required. I just read [_db]* as "zero or more of _ d or b" |
Desmont McCallock
604
|
Posted - 2016.04.26 18:03:30 -
[44] - Quote
Cwittofur Cesaille wrote:Desmont McCallock wrote:No I don't, cause I don't want to group match. "_db" and "_legacy" may appear or not in the filename. That's what the ? is for, it makes it so it can appear but isn't required. I just read [_db]* as "zero or more of _ d or b" Parentheses are for grouping. I don't want that. Never the less, the regex expression works for me so... |
Cwittofur Cesaille
Quantum Distributions Crit My Hole
4
|
Posted - 2016.04.26 18:14:55 -
[45] - Quote
Desmont McCallock wrote:Cwittofur Cesaille wrote:Desmont McCallock wrote:No I don't, cause I don't want to group match. "_db" and "_legacy" may appear or not in the filename. That's what the ? is for, it makes it so it can appear but isn't required. I just read [_db]* as "zero or more of _ d or b" Parentheses are for grouping. I don't want that. Never the less, the regex expression works for me so...
I know it's meant for grouping; I'm not being argumentative here I'm trying to understand. I was taught to use parenthesis when I needed a distinct pattern to appear. And adding the question mark at the end just makes the group optional. I don't see an issue with the grouping if you're not actively using it. Again; not trying to argue, I really just want to understand. |
Desmont McCallock
604
|
Posted - 2016.04.26 18:19:44 -
[46] - Quote
OK. Here is some food for thought.
Let's say we have the folowings:
sde-20160426-TRANQUILITY.zip sde-20160426-TRANQUILITY-legacy.zip Parallax_1.0_115480_db.zip YC-118-3_1.0_117575.zip Aegis_1.1.1_114255_db.zip someotherfilename.zip
Write a regex expression that matches with the first five (5) lines only without grouping. |
Cwittofur Cesaille
Quantum Distributions Crit My Hole
4
|
Posted - 2016.04.26 18:30:30 -
[47] - Quote
Point made.
Why are you against grouping though? |
Desmont McCallock
604
|
Posted - 2016.04.26 18:39:15 -
[48] - Quote
Cwittofur Cesaille wrote:Point made.
Why are you against grouping though? I'm not. It just doesn't serve any purpose in this case. |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5978
|
Posted - 2016.04.26 19:50:07 -
[49] - Quote
Something to try:
Rename a file to sde-20160426-TRANQUILITY-legcay.zip and see if it still matches.
It may just be the regex engine I'm used to (PCRE), but I think it'll still match.
I'm running again for CSM 11, and I'd appreciate your vote.
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
|
CCP Tellus
C C P C C P Alliance
59
|
Posted - 2016.04.26 20:44:42 -
[50] - Quote
Desmont McCallock wrote:3. Would you mind fixing the duplicate entries in blueprints.yaml file? (blueprintTypeID: 41590 has typeID: 38 for manufacturing specified two (2) times with different quantity) This his how it appears in-game: "Required Input Materials" for that blueprint lists 3x Nocxium and 5x Nocxium. |
|
|
Desmont McCallock
604
|
Posted - 2016.04.26 21:37:29 -
[51] - Quote
Steve Ronuken wrote:Something to try:
Rename a file to sde-20160426-TRANQUILITY-legcay.zip and see if it still matches.
It may just be the regex engine I'm used to (PCRE), but I think it'll still match. It does Steve and in this case the only expression I could come up with to exclude that is ".*_\d+\.\d+(\.\d+)?_\d+(_db)?\.zip|sde-\d+-\w+(-legacy)?\.zip" which justifies Cwittofur Cesaille case, but still there is no need to group matching. Never the less, this whole regex expression thing isn't about which is right but merely what suits needs.
|
Desmont McCallock
604
|
Posted - 2016.04.26 21:38:15 -
[52] - Quote
CCP Tellus wrote:Desmont McCallock wrote:3. Would you mind fixing the duplicate entries in blueprints.yaml file? (blueprintTypeID: 41590 has typeID: 38 for manufacturing specified two (2) times with different quantity) This his how it appears in-game: "Required Input Materials" for that blueprint lists 3x Nocxium and 5x Nocxium. And from your experience is this correct? Should it be such?
|
|
CCP Tellus
C C P C C P Alliance
59
|
Posted - 2016.04.26 22:16:58 -
[53] - Quote
Desmont McCallock wrote:And from your experience is this correct? Should it be such? That's not for me to judge. I suggest you file a bug report and one of the game design teams will take a look at it. :)
|
|
Desmont McCallock
604
|
Posted - 2016.04.27 09:47:28 -
[54] - Quote
@CCP Tellus Mate in legacy format, restoring the MSSQL datadump reveals that table dgmAtrributeTypes is empty. |
Pete Butcher
KarmaFleet Goonswarm Federation
324
|
Posted - 2016.04.27 13:16:45 -
[55] - Quote
And we're back to the integrity problems with the SDE. Someone should really clean it up.
http://evernus.com - the ultimate multiplatform EVE trade tool + nullsec Alliance Market tool + Trade Advisor
|
|
CCP Tellus
C C P C C P Alliance
59
|
Posted - 2016.04.27 14:26:42 -
[56] - Quote
Desmont McCallock wrote:Edit2: Importing the dgmAtrributeTypes table from the yaml file, I notice that a clean up has been made. 994 entries have been removed including some that we use in EVEMon data files generator. Is this intentional? That was not intentional. I'll make a new build of the SDE with several fixes, should have it ready in a few hours. Thanks for your patience. :)
|
|
|
CCP Tellus
C C P C C P Alliance
60
|
Posted - 2016.04.27 21:11:54 -
[57] - Quote
Hello everyone! I published a new SDE that should hopefully contain fixes for all the reported issues. Please let us know if there are any more issues.
https://cdn1.eveonline.com/data/sde/tranquility/sde-20160427-TRANQUILITY.zip https://cdn1.eveonline.com/data/sde/tranquility/sde-20160427-TRANQUILITY-legacy.zip |
|
Shish Tukay
Caldari Provisions Caldari State
38
|
Posted - 2016.04.27 21:51:30 -
[58] - Quote
Constructive: If you really hate the idea that you'll get more groups in output, you can also do "(?:_db)?" to make the group non-capturing while still being correct :)
Criticism: Using square brackets really is incorrect though, not merely a matter of taste. Sure, it works, sort of, sometimes, if you ignore all the cases in which it doesn't work; but is it not better to work all the time? "(_db)?" = "may or may not contain '_db'", which is right; "[_db]*" = "can contain any number of '_', 'd', or 'b'", eg it allows 'bbbbbbbbb_b_b_b___ddbbdbb', which is wrong. Still really confused why you would even want to avoid groups though - that's like avoiding "else" statements and just writing "if(foo) {}; if(not foo) {}" all over the place because you don't like "if(foo) {} else {}" o___O |
Steve Ronuken
Fuzzwork Enterprises Vote Steve Ronuken for CSM
5978
|
Posted - 2016.04.27 23:20:06 -
[59] - Quote
\o/ <3
I'm running again for CSM 11, and I'd appreciate your vote.
Fuzzwork Enterprises
Twitter: @fuzzysteve on Twitter
|
Desmont McCallock
604
|
Posted - 2016.04.28 08:07:40 -
[60] - Quote
Shish Tukay wrote:Constructive: If you really hate the idea that you'll get more groups in output, you can also do "(?:_db)?" to make the group non-capturing while still being correct :)
Criticism: Using square brackets really is incorrect though, not merely a matter of taste. Sure, it works, sort of, sometimes, if you ignore all the cases in which it doesn't work; but is it not better to work all the time? "(_db)?" = "may or may not contain '_db'", which is right; "[_db]*" = "can contain any number of '_', 'd', or 'b'", eg it allows 'bbbbbbbbb_b_b_b___ddbbdbb', which is wrong. Still really confused why you would even want to avoid groups though - that's like avoiding "else" statements and just writing "if(foo) {}; if(not foo) {}" all over the place because you don't like "if(foo) {} else {}" o___O Thanks for your input. The matter is closed. Explicit capture option resolves any mismatch in my case.
|
|
|
|
|
Pages: 1 [2] 3 4 :: one page |
First page | Previous page | Next page | Last page |