Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 .. 13 :: [one page] |
|
Author |
Thread Statistics | Show CCP posts - 12 post(s) |
|
t20
|
Posted - 2006.01.05 12:04:00 -
[1]
This devblog gives you the updated type info, construction requirements, TL2 construction details, universe-wide info, station details and much more ... happy fiddling
Post requests here if you have any (that are related to this subject)
|
|
Benilopax
|
Posted - 2006.01.05 12:05:00 -
[2]
Edited by: Benilopax on 05/01/2006 12:06:49 Edited by: Benilopax on 05/01/2006 12:05:50 first woot!
first time ever!
hahaha better luck next time!
Sounds good! Cheers T20!
|
bumcheekcity
|
Posted - 2006.01.05 12:06:00 -
[3]
Originally by: Mallikanth My 1st 1st!
Own3d -- bumcheekcity |
Mallikanth
|
Posted - 2006.01.05 12:06:00 -
[4]
Edited by: Mallikanth on 05/01/2006 12:05:50 My 1st 1st!
Dammit! My First 2nd!
In the beginning the Universe was created. This has made a lot of people very angry and has been widely regarded as a bad move. - Douglas Adams
|
Simon Illian
|
Posted - 2006.01.05 12:09:00 -
[5]
just averrryyy big thank you !!!!! [BoBO Corp WebSite]
BoBo Diplomat |
Martinus Crimson
|
Posted - 2006.01.05 12:09:00 -
[6]
/emote hugs t20
thanks ----------------------- Nuttin ^^ |
Crayathan
|
Posted - 2006.01.05 12:18:00 -
[7]
i love you t20
Even though I walk through the valley of the shadow of death, I fear no evil |
Jack Tau
|
Posted - 2006.01.05 12:39:00 -
[8]
The promised ú500,000 in unmarked bills are in the post. Thanks again!!
If you dont understand this sig, you need to get out less ;) |
Iron Wraith
|
Posted - 2006.01.05 13:02:00 -
[9]
hi all just seen the dev blog over lunch
does anyone know if the agent info is based on what it is now, or what it will be on the 8th after the agents have moved?
realy hoping its the new locations, not looking forward to finding a new system to run misison in. but if i can spend hours fiddling with code to find my new home i'll be much happier than spending hours fiddling with corp agent tabs Because sometimes you just have to go back to your roots: [2005.02.20 01:08:03] (combat) Your Civilian Light Electron Blaster perfectly strikes Serpentis Smuggler, wrecking for 20.3 damage. |
Elissen
|
Posted - 2006.01.05 13:48:00 -
[10]
Thank you Sir!
P.S. Did you edit your old blog? My news bot didn't pick it up ---- ICSC Red Moon Rising edition: Jumpplanner tool - Routeplanner for all jumpcapable ships! |
|
FireFoxx80
|
Posted - 2006.01.05 14:00:00 -
[11]
Does this include outposts in the station data?
23? # Missile Tool # ex: P-TMC : USAC |
Sirilonwe
|
Posted - 2006.01.05 14:25:00 -
[12]
Thanks!
|
Nyphur
|
Posted - 2006.01.05 14:36:00 -
[13]
Any chance on getting the NPC data? It was apparantly removed from the eve game files. Or could we get at least a word on why it was removed? I was making heavy use of it and now I can't even check what damage types NPCs do any more.
|
Crayathan
|
Posted - 2006.01.05 14:44:00 -
[14]
Originally by: Iron Wraith does anyone know if the agent info is based on what it is now, or what it will be on the 8th after the agents have moved?
It appears not, one of my agents that moved is still in his old system
Even though I walk through the valley of the shadow of death, I fear no evil |
Jack Tau
|
Posted - 2006.01.05 15:07:00 -
[15]
Originally by: Nyphur Any chance on getting the NPC data? It was apparantly removed from the eve game files. Or could we get at least a word on why it was removed? I was making heavy use of it and now I can't even check what damage types NPCs do any more.
It's all in there, if you understand relational databases. Enkidu Production & Research Manager
If you dont understand this sig, you need to get out le |
Nyphur
|
Posted - 2006.01.05 15:20:00 -
[16]
Originally by: Jack Tau
Originally by: Nyphur Any chance on getting the NPC data? It was apparantly removed from the eve game files. Or could we get at least a word on why it was removed? I was making heavy use of it and now I can't even check what damage types NPCs do any more.
It's all in there, if you understand relational databases.
I do. Which files is it in? The guys at http://www.evegames.hostingbig.com/eve/data/ told me it was removed.
|
Iron Wraith
|
Posted - 2006.01.05 15:24:00 -
[17]
re: new agent locations
quick heads up, t20 answerd my Q in his blog. he doesn't think it will have the new agent locations in but a new data set will be posted when the agents move
once again, thanks t20 Because sometimes you just have to go back to your roots: [2005.02.20 01:08:03] (combat) Your Civilian Light Electron Blaster perfectly strikes Serpentis Smuggler, wrecking for 20.3 damage. |
Jack Tau
|
Posted - 2006.01.05 15:43:00 -
[18]
Originally by: Nyphur
Originally by: Jack Tau
Originally by: Nyphur Any chance on getting the NPC data? It was apparantly removed from the eve game files. Or could we get at least a word on why it was removed? I was making heavy use of it and now I can't even check what damage types NPCs do any more.
It's all in there, if you understand relational databases.
I do. Which files is it in? The guys at http://www.evegames.hostingbig.com/eve/data/ told me it was removed.
I ment no offense, sorry if it came out wrong :) I'm not going to sit here and explain exactly where it all is, it is a fairly big schema(And I havent made a sensibly formatted export for this latest feed yet), but I will say it all starts off with the main item type, which links via the Type ID to all the data you need. The two main files in the old feeds were "dgmAttributeTypes.csv" and "dgmTypeAttributes.csv". HTH, I'm still looking through the new feeds myself, but those should still be the right files. Enkidu Production & Research Manager
If you dont understand this sig, you need to get out le |
Jack Tau
|
Posted - 2006.01.05 15:47:00 -
[19]
While I'm at it, Mr T20, did you take all the commas out of the strings in the CSV files this time? I know its fairly easily fixed, but it's annoying that I have to edit and run scripts on all the data feeds before I can use them. Enkidu Production & Research Manager
If you dont understand this sig, you need to get out le |
Nyphur
|
Posted - 2006.01.05 16:06:00 -
[20]
Originally by: Jack Tau
Originally by: Nyphur
Originally by: Jack Tau
Originally by: Nyphur Any chance on getting the NPC data? It was apparantly removed from the eve game files. Or could we get at least a word on why it was removed? I was making heavy use of it and now I can't even check what damage types NPCs do any more.
It's all in there, if you understand relational databases.
I do. Which files is it in? The guys at http://www.evegames.hostingbig.com/eve/data/ told me it was removed.
I ment no offense, sorry if it came out wrong :) I'm not going to sit here and explain exactly where it all is, it is a fairly big schema(And I havent made a sensibly formatted export for this latest feed yet), but I will say it all starts off with the main item type, which links via the Type ID to all the data you need. The two main files in the old feeds were "dgmAttributeTypes.csv" and "dgmTypeAttributes.csv". HTH, I'm still looking through the new feeds myself, but those should still be the right files.
Thanks, I'll have a look at that later and inform the guys at http://www.evegames.hostingbig.com/eve/data/ if the data is still there.
|
|
Vaux
|
Posted - 2006.01.05 16:15:00 -
[21]
Thanks! This is great!
Not to be picky, but in the type table, some of the descriptions of items are surrounded by quotes, while others are not. This is throwing off my script.
---------- Vaux CEO, Red Frog Investments |
Ashwa
|
Posted - 2006.01.05 16:35:00 -
[22]
hmm what do you use these files for? is it something i as the average user needs to download
|
Jack Tau
|
Posted - 2006.01.05 16:49:00 -
[23]
Originally by: Ashwa hmm what do you use these files for? is it something i as the average user needs to download
If your not into databases or masochism, then no ;) Enkidu Production & Research Manager
If you dont understand this sig, you need to get out le |
Crayathan
|
Posted - 2006.01.05 17:09:00 -
[24]
Originally by: Vaux Thanks! This is great!
Not to be picky, but in the type table, some of the descriptions of items are surrounded by quotes, while others are not. This is throwing off my script.
find and replace
Even though I walk through the valley of the shadow of death, I fear no evil |
Entity
|
Posted - 2006.01.05 17:56:00 -
[25]
Hands off everyone, t20 is mine! ♥♥♥♥
|
Jaabaa Prime
|
Posted - 2006.01.05 18:28:00 -
[26]
Three cheers for t20
hip hip \o/ hip hip \o/ hip hip \o/ --
Mini Skill Planner |
Iron Wraith
|
Posted - 2006.01.05 19:05:00 -
[27]
ahhhh, agent hunting the way it should be :) 2 hrs of messing with queries later i am now ready to import the new data and go prospecting with my short list :)
thank yoooooou t20, you've just taken all the pain i was suffering away from the agent move
/me eagerly awaits the next extract with the new agent locations Because sometimes you just have to go back to your roots: [2005.02.20 01:08:03] (combat) Your Civilian Light Electron Blaster perfectly strikes Serpentis Smuggler, wrecking for 20.3 damage. |
Gutor
|
Posted - 2006.01.05 19:26:00 -
[28]
oooooo...
raw materials and apis make gutor a happy coder.
thanks t20!
Free teamspeak server: connect to evetools.com in teamspeak, no password. More Info |
Kylania
|
Posted - 2006.01.05 19:43:00 -
[29]
hehe, I love CCP:
These drills, are capable of causing more environmental devastation than you can shake an extremely large stick at with both hands. And that's unassembled.
The astrofarm is very cool.
Meat Popsicle - The inhospitability of space no longer bothers this individual. -- Lil Miner |
Vessper
|
Posted - 2006.01.05 19:52:00 -
[30]
Thanks for the updated info
Looks like the type descriptions are truncated as in the Cold War data. Any chance of fixing this when you release the updated file for agent info??
|
|
Darmed Khan
|
Posted - 2006.01.05 19:58:00 -
[31]
Originally by: Vaux Not to be picky, but in the type table, some of the descriptions of items are surrounded by quotes, while others are not. This is throwing off my script.
I haven't finished downloading the files yet to see how well formatted the CSV data is, but it is perfectly acceptable for some entries to be quoted strings and others to be unqouted. I suggest you upgrade your CSV parser
http://www.ietf.org/rfc/rfc4180.txt (I did find a simpler explanation when writing a parser once, but I guess that one will do)
|
Dowser
|
Posted - 2006.01.05 20:16:00 -
[32]
t20, two things.
First, all description fields appear to be truncated at 255 characters in miscData.
Second, can we get additional data for the ship bonuses. For example, Apocalypse has the shipBonusAB attribute with a value of -10. There is no way to programmatically correlate the value of shipBonusAB with the attribute it affects (in this case large energy turret capacitor use). A really hacky way would be to use the ship description, but the description is truncated.
|
Zydigo
|
Posted - 2006.01.05 22:25:00 -
[33]
Oh hell yes. I've been working on a script/webapp combo that uploads the exported market data csv files to a webapp which dumps them into a mysql db. If the station and system IDs match up between the two, I am set.
|
Sigillum Diaboli
|
Posted - 2006.01.05 22:59:00 -
[34]
Looks great, but the stations table seems to contain test data for Outposts, instead of information about the actual ones in the game.
I was starting to wonder who this duperTum Corp was and how they got so rich ...
|
Dale Cussler
|
Posted - 2006.01.05 23:21:00 -
[35]
Many thanks Mr. t20 :D
|
Deliz Seemack
|
Posted - 2006.01.06 00:54:00 -
[36]
Thanks god, I'll be able to get my data fix. __________________________________________________ -He conquers who endures. -Never underestimate game companies' greed. |
Dale Cussler
|
Posted - 2006.01.06 01:50:00 -
[37]
Small request for the next dump, if possible, to have it in XML format? The CSV files work fine to load into Excel, but any other tools I use to manipulate CSV files just plain out choke on it, mostly due to unescaped commas inside quoted strings.
To get the data in XML format would be even nicer since that'll save me from having to do a few conversions.
|
jide
|
Posted - 2006.01.06 05:09:00 -
[38]
Originally by: Nyphur
Originally by: Jack Tau
Originally by: Nyphur
Originally by: Jack Tau
Originally by: Nyphur Any chance on getting the NPC data? It was apparantly removed from the eve game files. Or could we get at least a word on why it was removed? I was making heavy use of it and now I can't even check what damage types NPCs do any more.
It's all in there, if you understand relational databases.
I do. Which files is it in? The guys at http://www.evegames.hostingbig.com/eve/data/ told me it was removed.
I ment no offense, sorry if it came out wrong :) I'm not going to sit here and explain exactly where it all is, it is a fairly big schema(And I havent made a sensibly formatted export for this latest feed yet), but I will say it all starts off with the main item type, which links via the Type ID to all the data you need. The two main files in the old feeds were "dgmAttributeTypes.csv" and "dgmTypeAttributes.csv". HTH, I'm still looking through the new feeds myself, but those should still be the right files.
Thanks, I'll have a look at that later and inform the guys at http://www.evegames.hostingbig.com/eve/data/ if the data is still there.
There's only one of me :P Anyway, I still don't think the data is in the cache files in the client. If they are they are very well hidden. They are in the dgmTypeAttributes.CSV from data_misc.rar though. I'll use it to complete what I have when I get a little more time on my hands.
|
Sigillum Diaboli
|
Posted - 2006.01.06 05:21:00 -
[39]
Originally by: Dale Cussler Small request for the next dump, if possible, to have it in XML format? The CSV files work fine to load into Excel, but any other tools I use to manipulate CSV files just plain out choke on it, mostly due to unescaped commas inside quoted strings.
To get the data in XML format would be even nicer since that'll save me from having to do a few conversions.
Commas don't need to be escaped inside quoted strings. That's the point of quoting the string.
|
Nightblade
|
Posted - 2006.01.06 05:23:00 -
[40]
It seems there are a few problems with the invTypes data.
I tried opening in both Excel and OO.o 2 and both have some strange data.
Couple of examples, Kernite has a volume of '1-Feb' and Carbonized Lead S has a volume of 8e+13.
Anyone else see this or is it just me?
|
|
jide
|
Posted - 2006.01.06 06:08:00 -
[41]
Originally by: Nightblade It seems there are a few problems with the invTypes data.
I tried opening in both Excel and OO.o 2 and both have some strange data.
Couple of examples, Kernite has a volume of '1-Feb' and Carbonized Lead S has a volume of 8e+13.
Anyone else see this or is it just me?
It's not just you.
|
elFarto
|
Posted - 2006.01.06 09:49:00 -
[42]
Originally by: jide They are in the dgmTypeAttributes.CSV from data_misc.rar though. I'll use it to complete what I have when I get a little more time on my hands.
It appears all the information that was hidden from the local cache files is here, including damage the NPC's do and the chance/range/strength of all their new abilities.
\/
Regards elFarto
Stratego > 2005.10.22 14:15:17 combat Imperium Alliance petitions you, glancing off causing no real damage. |
Jack Tau
|
Posted - 2006.01.06 09:50:00 -
[43]
Originally by: Nightblade It seems there are a few problems with the invTypes data.
I tried opening in both Excel and OO.o 2 and both have some strange data.
Couple of examples, Kernite has a volume of '1-Feb' and Carbonized Lead S has a volume of 8e+13.
Anyone else see this or is it just me?
This is the same problem that was in the last feeds, there are commas inside the text fields... Obviously a CSV file relies on commas, so its all screwed up. Load the file up in a text editor and take all the commas out of text field, or surround all the text fields with speech marks. Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
Ms Freak
|
Posted - 2006.01.06 13:07:00 -
[44]
Ok,
I've just downloaded all the files EXCEPT the data_map.rar (the 200mb one) - i can see all the descriptions of items and stations and the map data etc thats all sweet.
However i want to be able to see what each item (say a shield booster) does to what attributes.
Where is this data stored?? Its prolly just me but i cant see it? some pointers would be nice :)
|
Phyra
|
Posted - 2006.01.06 13:17:00 -
[45]
t20: great stuff!
could you include the NPC ships in your next update too pls? Shipname, Shiptype, rank (like in TomB's post, just complete) would suffice for me, although more info would be welcome.
regards
Phyra
|
Tanya Kovacs
|
Posted - 2006.01.06 13:19:00 -
[46]
Hey thanks alot for this data. Finally I can build my own little tools
|
Jaabaa Prime
|
Posted - 2006.01.06 18:41:00 -
[47]
Problem
miscData_RMR.xls seems to be incorrectly formatted.
All of the "Float/Real" fields are text fields and I can't get them to format correctly either.
e.g. basePrice - ".0000" mass - "2500.0"
"," would be the correct display for my NLS settings, so it's not as though the fields are even the correct type
The last excel was ok, this one is broken.
Any chance of getting one that is correctly formatted ? --
Mini Skill Planner |
Nightblade
|
Posted - 2006.01.06 21:07:00 -
[48]
Originally by: Jack Tau This is the same problem that was in the last feeds, there are commas inside the text fields... Obviously a CSV file relies on commas, so its all screwed up. Load the file up in a text editor and take all the commas out of text field, or surround all the text fields with speech marks.
The CSV files in this pull are fine. If you looked at the data, the table I was talking about is in the XLS file.
|
Nyphur
|
Posted - 2006.01.07 13:50:00 -
[49]
Originally by: jide There's only one of me :P Anyway, I still don't think the data is in the cache files in the client. If they are they are very well hidden. They are in the dgmTypeAttributes.CSV from data_misc.rar though. I'll use it to complete what I have when I get a little more time on my hands.
Are you sure? I could have sworn there were at least eight jides :p. Thanks so much for getting the info back up. You're a lifesaver.
|
Netrunner
|
Posted - 2006.01.07 19:47:00 -
[50]
Great start for me, I was just looking to see if anyone had information like this!!!
Does anyone know if there has ever been a data export for the ship and equipment information (Attributes, Manufacturing and Fittings Tabs for everything) and if so, can you post a link??
I've been gone a long time. Have ran some searches but not finding anything on this and I'm anxious to start some coding
|
|
Elissen
|
Posted - 2006.01.07 20:28:00 -
[51]
It's all in there I think Netrunner. Building information for sure as I use that, but I've seen tables of damage attrobutes. Download the files and take a very close look at them. ---- ICSC Red Moon Rising edition: Jumpplanner tool - Routeplanner for all jumpcapable ships! |
Iron Wraith
|
Posted - 2006.01.08 15:09:00 -
[52]
alloha! agents have now moved. any idea when were gonna get the new data export?
once again, thanks for this t20, really gonna help me find my new agent home Because sometimes you just have to go back to your roots: [2005.02.20 01:08:03] (combat) Your Civilian Light Electron Blaster perfectly strikes Serpentis Smuggler, wrecking for 20.3 damage. |
Somatic Neuron
|
Posted - 2006.01.10 12:57:00 -
[53]
t20, can you please update for the new stuff that was released today? Also, on the materialForActivity tab, can you add columns for at least includeInWaste, and preferrably categoryID? ---------- |
Warner Caslet
|
Posted - 2006.01.11 01:55:00 -
[54]
The security column in the systems table confuses me. Why do some systems have nonsensical-seeming security values like -5755146957592.38 or 144366682.05? It doesn't seem to be just a decimal shift, as lots of 0.0-named systems have positive strange securities.
Further, what is the meaning of the security class column?
|
Nightblade
|
Posted - 2006.01.11 02:17:00 -
[55]
Originally by: Warner Caslet The security column in the systems table confuses me. Why do some systems have nonsensical-seeming security values like -5755146957592.38 or 144366682.05? It doesn't seem to be just a decimal shift, as lots of 0.0-named systems have positive strange securities.
This whole data pull is riddled with problems like this. I hope that they're fixed when the next version (with the updated agents) comes out, because in its current state this data is useless for most applications.
|
Somatic Neuron
|
Posted - 2006.01.11 12:57:00 -
[56]
Warp Disrupt Probe Blueprint info is missing from the Item Database, as is the graphic for both the Blueprint and the Probe itself. ---------- |
Jaabaa Prime
|
Posted - 2006.01.12 08:08:00 -
[57]
t20, I appreciate the effort made in releasing the data dump but could you please redo the excel sheet with the correct formatting so that it is useful.
Thanks. --
Mini Skill Planner |
elFarto
|
Posted - 2006.01.12 12:38:00 -
[58]
The dgmTypeAttributes.csv file is a bit odd too. Lots of values seem to have precision issues:
Originally by: dgmTypeAttributes.csv 22000,930,NULL,0.14999999999999999 24146,930,NULL,1.4999999999999999E-2 24145,930,NULL,1.2500000000000001E-2
Any chance of getting an export without these problems?
Regards elFarto
Stratego > 2005.10.22 14:15:17 combat Imperium Alliance petitions you, glancing off causing no real damage. |
Nightblade
|
Posted - 2006.01.12 17:09:00 -
[59]
Originally by: elFarto The dgmTypeAttributes.csv file is a bit odd too. Lots of values seem to have precision issues:
Originally by: dgmTypeAttributes.csv 22000,930,NULL,0.14999999999999999 24146,930,NULL,1.4999999999999999E-2 24145,930,NULL,1.2500000000000001E-2
Any chance of getting an export without these problems?
Regards elFarto
That's not a problem. That's just normal floating point precision, and when I checked them out those are the proper values for double-precision numbers.
What I mean is if you do: double x = 0.015; in C, what you get really is x = 1.4999999999999999E-2.
When you print out the numbers just restrict the number of decimal places you use.
|
Gigi Barbagrigia
|
Posted - 2006.01.13 14:36:00 -
[60]
Originally by: Jaabaa Prime t20, I appreciate the effort made in releasing the data dump but could you please redo the excel sheet with the correct formatting so that it is useful.
Acctually, I'd prefer each sheet as separate CSV file. ----- 42 |
|
jide
|
Posted - 2006.01.14 05:28:00 -
[61]
Is it me or in mapSolarSystems, the x,y,z coordinates are not in the right order ? I am under the impression that on a given line, the x y z don't belong to the solar system described on that line, but to another one. So if you display them all, without the jumps, it's going to look ok, but if you start displaying the jumps as well, it won't connect the right points. It's either that or I have a nasty bug in my code that is hidding really well.
|
Nightblade
|
Posted - 2006.01.14 22:56:00 -
[62]
Originally by: jide Is it me or in mapSolarSystems, the x,y,z coordinates are not in the right order ? I am under the impression that on a given line, the x y z don't belong to the solar system described on that line, but to another one. So if you display them all, without the jumps, it's going to look ok, but if you start displaying the jumps as well, it won't connect the right points. It's either that or I have a nasty bug in my code that is hidding really well.
You must have a nasty bug, because the jumps don't specify x,y,z coordinates, only which systems they connect.
Now, if you plot a map, and it doesn't look like the EVE map, there might be a problem.
Note that to get a 2D map that's the same as the flattened map you want to look at the X and Z coordinates, not X and Y. I haven't put the new data in yet because of the other problems, but this is the way it used to be.
|
jide
|
Posted - 2006.01.15 00:33:00 -
[63]
Originally by: Nightblade
Originally by: jide Is it me or in mapSolarSystems, the x,y,z coordinates are not in the right order ? I am under the impression that on a given line, the x y z don't belong to the solar system described on that line, but to another one. So if you display them all, without the jumps, it's going to look ok, but if you start displaying the jumps as well, it won't connect the right points. It's either that or I have a nasty bug in my code that is hidding really well.
You must have a nasty bug, because the jumps don't specify x,y,z coordinates, only which systems they connect.
Now, if you plot a map, and it doesn't look like the EVE map, there might be a problem.
Note that to get a 2D map that's the same as the flattened map you want to look at the X and Z coordinates, not X and Y. I haven't put the new data in yet because of the other problems, but this is the way it used to be.
You misunderstood what I meant.
I know the jump table only has indexes, and when u plot all the systems, they look ok too. But I believe the coordinates of a given system are not actually its coordinates but the ones of another system. As an example, you could have Luminaire with the coordinates of Yulai and vice versa.
|
Nightblade
|
Posted - 2006.01.15 14:01:00 -
[64]
Edited by: Nightblade on 15/01/2006 14:13:34
Originally by: jide I know the jump table only has indexes, and when u plot all the systems, they look ok too. But I believe the coordinates of a given system are not actually its coordinates but the ones of another system. As an example, you could have Luminaire with the coordinates of Yulai and vice versa.
I compared the data with the Cold War data dump that was here before, and it seems like they are in the right order.
When I was skimming it though I noticed some problems. All of the numbers seemed to have been scaled by 1e16 compared to their previous values. There are also several cells where the values are actually text instead of a floating point number. If you take off the apostrophe at the start of the number, the result is the correct number, but scaled as the original numbers were, or a factor of 1e16 too small.
If there's enough systems like this it might make your map look pretty strange, with a cluster of systems along the axes.
Edit: Actually this seems to be what's gone wrong with the data in the types table, as well. Any values that are actually in floating point format are 1e16 too big. This also seems to be true for the security statuses in the solar systems table.
|
Jaabaa Prime
|
Posted - 2006.01.15 22:23:00 -
[65]
I've sent an email to [email protected] asking about the "miscData_RMR.xls" file because it is basically unusable at the moment.
Hopefully I'll get an answer soon. --
Mini Skill Planner |
|
t20
|
Posted - 2006.01.24 16:47:00 -
[66]
updated with the new agents, changed the format a bit, hope this helps resolve all the problems most of you had.
|
|
elFarto
|
Posted - 2006.01.24 17:20:00 -
[67]
Originally by: t20 updated with the new agents, changed the format a bit, hope this helps resolve all the problems most of you had.
<3
Regards elFarto
npc.elfarto.com > Ingame NPC database |
Rasai
|
Posted - 2006.01.24 17:34:00 -
[68]
I am unable to find where I download this. Can someone give me the link?
|
|
t20
|
Posted - 2006.01.24 17:48:00 -
[69]
Originally by: Rasai I am unable to find where I download this. Can someone give me the link?
Forumposts 101, read the first response in a thread to get more info, thus giving you:
Originally by: t20 This devblog gives you the updated type info, construction requirements, TL2 construction details, universe-wide info, station details and much more ... happy fiddling
Post requests here if you have any (that are related to this subject)
|
|
Zoon
|
Posted - 2006.01.24 18:37:00 -
[70]
Edited by: Zoon on 24/01/2006 18:46:35 t20, not wishing to alienate the other devs, but I think you're my fave
You gimme all this really useful information for me to swish up my website! Thankyou
The only problem I now have is that I use MySql
*gets to work* __________________________________ Are you a mission runner? Have you tried Zoon's Agent Tool? You should! |
|
TornSoul
|
Posted - 2006.01.24 18:47:00 -
[71]
/me hugs t20 long time
Thanks for the new sql files. Havent had time to look at them yet, but if they are what I think/hope they are - YARRRt20BBQ!!!!
(and I just spend the entire weekend, extracting the data from the messed up csv set - Impecable timing t20 - lol)
BIG Lottery
[u |
Gigi Barbagrigia
|
Posted - 2006.01.24 19:32:00 -
[72]
*drolls* Thanks so much for csv
Originally by: Zoon The only problem I now have is that I use MySql
This+This=your friend ----- 42 |
Zoon
|
Posted - 2006.01.24 19:37:00 -
[73]
Originally by: Gigi Barbagrigia *drolls* Thanks so much for csv
Originally by: Zoon The only problem I now have is that I use MySql
This+This=your friend
Not when the files are in TSQL __________________________________ Are you a mission runner? Have you tried Zoon's Agent Tool? You should! |
FireFoxx80
|
Posted - 2006.01.24 21:35:00 -
[74]
Edited by: FireFoxx80 on 24/01/2006 21:38:05 TSQL :) t20 I wub j00! It's beautiful, simply beautiful!
For all the people talking about the SQL format, it should be fairly easy to do a find/replace to change the SQL syntax. Besides, you should only realy need to change the table definition and the COMMIT commands.
Else, import them into MSDE, and use the widely available tools to migrate them into mySQL.
23? # Missile Tool # ex: P-TMC : USAC |
Emily Spankratchet
|
Posted - 2006.01.25 11:58:00 -
[75]
Can I join the queue of people wanting to have t20's babies?
One quick question: I can't see anything about (non T2) item build requirements in the SQL files. Am I being stupid, or is it not included?
|
FireFoxx80
|
Posted - 2006.01.25 12:00:00 -
[76]
Non T2 build requirements are minerals only, I would imagine they are in the blueprint tables? I've never investigated blueprint stuff, so I cannot be certain.
23? # Missile Tool # ex: P-TMC : USAC |
Emily Spankratchet
|
Posted - 2006.01.25 12:09:00 -
[77]
Originally by: FireFoxx80 Non T2 build requirements are minerals only, I would imagine they are in the blueprint tables? I've never investigated blueprint stuff, so I cannot be certain.
dbo_invBlueprintTypes.sql has stuff that I'd expect in the attributes part of a blueprint description, like ResearchCopyTime and so on. It doesn't appear to have bill of materials-style information.
dbo_InvTypes has blueprints, but only as items. Mind you, it does have
'Buffy' Vampire Slayer I','Kills Vampires Dead'
|
Gigi Barbagrigia
|
Posted - 2006.01.25 12:14:00 -
[78]
materialsforactivity or however it's now called ----- 42 |
Iron Wraith
|
Posted - 2006.01.25 12:45:00 -
[79]
woop! new agent locations
time to find a new empire home
thanks t20, you make us nerds very happy Because sometimes you just have to go back to your roots: [2005.02.20 01:08:03] (combat) Your Civilian Light Electron Blaster perfectly strikes Serpentis Smuggler, wrecking for 20.3 damage. |
FireFoxx80
|
Posted - 2006.01.25 13:59:00 -
[80]
Originally by: Iron Wraith thanks t20, you make us nerds very happy
I think we prefer to be called application developers.
23? # Missile Tool # ex: P-TMC : USAC |
|
Emily Spankratchet
|
Posted - 2006.01.25 14:57:00 -
[81]
Originally by: Gigi Barbagrigia materialsforactivity or however it's now called
I can see TL2MaterialsForTypeWithActivity as a table in the SQL data burp, but as far as I can tell this deals with T2 manufacturing and RAM usage. I'm probably being stupid but I can't see any other material-related fields in the other SQL tables.
|
Zacha Nioto
|
Posted - 2006.01.25 15:03:00 -
[82]
/me <3 t20 looong time. ;)
|
Vessper
|
Posted - 2006.01.25 15:41:00 -
[83]
Originally by: Emily Spankratchet
Originally by: Gigi Barbagrigia materialsforactivity or however it's now called
I can see TL2MaterialsForTypeWithActivity as a table in the SQL data burp, but as far as I can tell this deals with T2 manufacturing and RAM usage. I'm probably being stupid but I can't see any other material-related fields in the other SQL tables.
The dbo_TL2MaterialsForTypeWithActivity table does include all the data for T1 manufacturing as well as T2. Look for the 6 SQL statements in that table with a typeID of 683 and you will find all the necessary minerals for building a bantam
The data for manufacturing is actually tied to the blueprint and not the item iteslf, which I believe goes for both T1 and T2 items. In addition to manufacturing, the table also tells you what materials/skills/R.DBs you need for T2 blueprint copying and research.
|
Emily Spankratchet
|
Posted - 2006.01.25 15:51:00 -
[84]
Originally by: Vessper The dbo_TL2MaterialsForTypeWithActivity table does include all the data for T1 manufacturing as well as T2. Look for the 6 SQL statements in that table with a typeID of 683 and you will find all the necessary minerals for building a bantam
Thank you, thank you, thank you. As I originally suspected, I am an idiot.
My only excuse is that I'm doing this at work and keep having to alt-tab to another window.
|
DaRuLe
|
Posted - 2006.01.25 17:57:00 -
[85]
perhaps this is an incredibly stupid question, but where are the names of the agents in the exports? I can't find them
__________________________________________________________________________
|
Bedrox
|
Posted - 2006.01.25 18:35:00 -
[86]
Originally by: DaRuLe perhaps this is an incredibly stupid question, but where are the names of the agents in the exports? I can't find them
hehe that and the corporations name, I can't find those two either. Frustrated |
Zoon
|
Posted - 2006.01.25 21:11:00 -
[87]
Originally by: Bedrox
Originally by: DaRuLe perhaps this is an incredibly stupid question, but where are the names of the agents in the exports? I can't find them
hehe that and the corporations name, I can't find those two either.
Heh ... I noticed that too ... good job I got my previous agent data to work from!! __________________________________ Are you a mission runner? Have you tried Zoon's Agent Tool? You should! |
Pouah
|
Posted - 2006.01.26 12:45:00 -
[88]
I know I'll look like a total newb but, what are we suppose to do with those files?
|
Histracko
|
Posted - 2006.01.26 15:56:00 -
[89]
any chance we can get a list of BP's and the mins required to build their respective items? --------------------------- !!Bookmarking Master!! If you need a route or system bookmarked just EVE-mail or convo me and we'll work something out |
Jack Tau
|
Posted - 2006.01.26 17:07:00 -
[90]
The new SQL feed kicks ass, thank you very much T20.
*Throws out all his import scripts*
P.S. for peeps asking where data is, and if they can have extra data. Everything you need is in the feed, you just need to read through it and figure out how it all links together. Agents, bps, min requirements, module reqs., etc, etc. Its all in there. Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
|
Iron Wraith
|
Posted - 2006.01.26 18:55:00 -
[91]
Originally by: FireFoxx80
Originally by: Iron Wraith thanks t20, you make us nerds very happy
I think we prefer to be called application developers.
lol, thats what we put on official forms. but i'm far enough through my therapy to admit the truth Because sometimes you just have to go back to your roots: [2005.02.20 01:08:03] (combat) Your Civilian Light Electron Blaster perfectly strikes Serpentis Smuggler, wrecking for 20.3 damage. |
Zoon
|
Posted - 2006.01.26 19:32:00 -
[92]
Originally by: Pouah I know I'll look like a total newb but, what are we suppose to do with those files?
If ya hafta ask, then you have no need for it __________________________________ Are you a mission runner? Have you tried Zoon's Agent Tool? You should! |
Skyran
|
Posted - 2006.01.26 19:58:00 -
[93]
Originally by: Jack Tau The new SQL feed kicks ass, thank you very much T20.
*Throws out all his import scripts*
P.S. for peeps asking where data is, and if they can have extra data. Everything you need is in the feed, you just need to read through it and figure out how it all links together. Agents, bps, min requirements, module reqs., etc, etc. Its all in there.
I'm sure that it is, but after running the TSQL batches into MSDE, applying relationships, and sifting through the data to the best of my ability, I am unable to determine where the data that says if a module is a Hislot, Midslot, or Lowslot... I would expect it to be linked in the invTypes->dgmTypeAttributes<-dgmAttributeTypes links, but I'm just not seeing it. Maybe I'm just a sub-standard nerd... err... Application Developer
|
Jack Tau
|
Posted - 2006.01.27 00:20:00 -
[94]
Edited by: Jack Tau on 27/01/2006 00:22:44
Originally by: Skyran Edited by: Skyran on 26/01/2006 22:13:49
Originally by: Jack Tau The new SQL feed kicks ass, thank you very much T20.
*Throws out all his import scripts*
P.S. for peeps asking where data is, and if they can have extra data. Everything you need is in the feed, you just need to read through it and figure out how it all links together. Agents, bps, min requirements, module reqs., etc, etc. Its all in there.
I'm sure that it is, but after running the TSQL batches into MSDE, applying relationships, and sifting through the data to the best of my ability, I am unable to determine where the data that says if a module is a Hislot, Midslot, or Lowslot... I would expect it to be linked in the invTypes->dgmTypeAttributes<-dgmAttributeTypes links or maybe even the invGroups->invTypes link, but I'm just not seeing it. Maybe I'm just a sub-standard nerd... err... Application Developer
[Edited for clarity]
Well App developers aren't suppose to understand complicated database structures, thats for us SQL geeks ;) (Allthough you're not far wrong, so no offense ment) I've got all the data linked up now, and tomorrow at work I'll put it all into a lovely diagram and post the MDF & a JPG of it on my website to download.
{edit} Ohh and there is some T-SQL to go with it as well, as the data sometimes dictates the structure too(/edit) Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
Brad Stone
|
Posted - 2006.01.27 11:32:00 -
[95]
Got the CSV files downloaded and I'm looking at the agents stuff (dbo_agtAgents.csv, dbo_agtAgentTypes.csv and dbo_agtConfig.csv)
Where are the agent's names? I can't find any of the csv files that list their names, only the id's
|
Skyran
|
Posted - 2006.01.27 15:40:00 -
[96]
Originally by: Brad Stone Got the CSV files downloaded and I'm looking at the agents stuff (dbo_agtAgents.csv, dbo_agtAgentTypes.csv and dbo_agtConfig.csv)
Where are the agent's names? I can't find any of the csv files that list their names, only the id's
I've been unable to find that information as well. In addition, I've been unable to find the NPCCorporation names as well as what fitting type a given module is. If anyone else knows where this infomation can be found within either the CSV or SQL files, letting us know would be greatly appreciated.
|
Jack Tau
|
Posted - 2006.01.27 15:40:00 -
[97]
I haven't had time to do all I planned, but I have got a diagram ready for items database(Missing the simple stuff such as factions and races), and some code to get out the atributes of any object(Using the typeID from the invTypes table).
DataDiagram GetAttributes.sql
As for the bloke asking about agents, I'm afraid the names were missed out of the data feed. T20, you listenin'? Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
jide
|
Posted - 2006.01.27 15:55:00 -
[98]
Originally by: Skyran Edited by: Skyran on 26/01/2006 22:13:49
Originally by: Jack Tau The new SQL feed kicks ass, thank you very much T20.
*Throws out all his import scripts*
P.S. for peeps asking where data is, and if they can have extra data. Everything you need is in the feed, you just need to read through it and figure out how it all links together. Agents, bps, min requirements, module reqs., etc, etc. Its all in there.
I'm sure that it is, but after running the TSQL batches into MSDE, applying relationships, and sifting through the data to the best of my ability, I am unable to determine where the data that says if a module is a Hislot, Midslot, or Lowslot... I would expect it to be linked in the invTypes->dgmTypeAttributes<-dgmAttributeTypes links or maybe even the invGroups->invTypes link, but I'm just not seeing it. Maybe I'm just a sub-standard nerd... err... Application Developer
[Edited for clarity]
The slot type is an effect, not an attribute. And dbo_dgmTypeEffects is missing.
|
Skyran
|
Posted - 2006.01.27 18:15:00 -
[99]
Originally by: jide
Originally by: Skyran Edited by: Skyran on 26/01/2006 22:13:49
Originally by: Jack Tau The new SQL feed kicks ass, thank you very much T20.
*Throws out all his import scripts*
P.S. for peeps asking where data is, and if they can have extra data. Everything you need is in the feed, you just need to read through it and figure out how it all links together. Agents, bps, min requirements, module reqs., etc, etc. Its all in there.
I'm sure that it is, but after running the TSQL batches into MSDE, applying relationships, and sifting through the data to the best of my ability, I am unable to determine where the data that says if a module is a Hislot, Midslot, or Lowslot... I would expect it to be linked in the invTypes->dgmTypeAttributes<-dgmAttributeTypes links or maybe even the invGroups->invTypes link, but I'm just not seeing it. Maybe I'm just a sub-standard nerd... err... Application Developer
[Edited for clarity]
The slot type is an effect, not an attribute. And dbo_dgmTypeEffects is missing.
Ah-HAAAaaa! So the data IS missing as opposed to my data mining skills being inadequate. Thanks for the heads up so I can stop beating my head against the wall trying to figure out why I can't find the info.
|
Jack Tau
|
Posted - 2006.01.28 00:37:00 -
[100]
Originally by: Skyran Ah-HAAAaaa! So the data IS missing as opposed to my data mining skills being inadequate. Thanks for the heads up so I can stop beating my head against the wall trying to figure out why I can't find the info.
There not completely missing, just well hidden as always ;) In the CSV export, the file is present and contains the new data.
The agent data is unfortunately flawed in both feeds though :(
Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
|
jide
|
Posted - 2006.01.28 04:29:00 -
[101]
Originally by: Jack Tau
Originally by: Skyran Ah-HAAAaaa! So the data IS missing as opposed to my data mining skills being inadequate. Thanks for the heads up so I can stop beating my head against the wall trying to figure out why I can't find the info.
There not completely missing, just well hidden as always ;) In the CSV export, the file is present and contains the new data.
The agent data is unfortunately flawed in both feeds though :(
The slot type is given by dgmtypeeffects. effectID 11 is for a low power slot, 12 for a high power slot and 13 for a medium. This is not to be confused with the attributeID of 11, 12 and 13 that list the number of low, high and med slots of a ship.
Are you saying that the slot type of a module is in data_misc_csv.rar ? It doesn't look that way to me. Feel free to prove me wrong though.
|
Jack Tau
|
Posted - 2006.01.28 09:59:00 -
[102]
Originally by: jide
Originally by: Jack Tau
Originally by: Skyran Ah-HAAAaaa! So the data IS missing as opposed to my data mining skills being inadequate. Thanks for the heads up so I can stop beating my head against the wall trying to figure out why I can't find the info.
There not completely missing, just well hidden as always ;) In the CSV export, the file is present and contains the new data.
The agent data is unfortunately flawed in both feeds though :(
The slot type is given by dgmtypeeffects. effectID 11 is for a low power slot, 12 for a high power slot and 13 for a medium. This is not to be confused with the attributeID of 11, 12 and 13 that list the number of low, high and med slots of a ship.
Are you saying that the slot type of a module is in data_misc_csv.rar ? It doesn't look that way to me. Feel free to prove me wrong though.
Yup, thats what Im saying. Got the CSV file dbo_dgmEffects.csv open right now, and I can see those effects.
Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
Vessper
|
Posted - 2006.01.28 11:26:00 -
[103]
Originally by: Jack Tau Yup, thats what Im saying. Got the CSV file dbo_dgmEffects.csv open right now, and I can see those effects.
I have to agree with Jide here, I can't find any file with the above name or any field in the other .csv or .sql files that indicates the slot type of a module.
Any chance of sharing that file?
|
Arx Nemesis
|
Posted - 2006.01.28 20:02:00 -
[104]
you are my hero t20
----------------------------------------- The price of freedom is eternal vigilance |
jide
|
Posted - 2006.01.28 20:07:00 -
[105]
Originally by: Jack Tau
Yup, thats what Im saying. Got the CSV file dbo_dgmEffects.csv open right now, and I can see those effects.
Oh, I downloaded the rar files again and dbo_dgmEffects is in there now. It wasn't before.
|
jide
|
Posted - 2006.01.28 20:09:00 -
[106]
dbo_eveNames has been added too. And it has the names for the agents.
|
Jack Tau
|
Posted - 2006.01.29 11:22:00 -
[107]
Originally by: jide
Originally by: Jack Tau
Yup, thats what Im saying. Got the CSV file dbo_dgmEffects.csv open right now, and I can see those effects.
Oh, I downloaded the rar files again and dbo_dgmEffects is in there now. It wasn't before.
That would explain it! I only bother with the construction part of the download, so I only looked for effects after it was found to be missing.. Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
fahman dude
|
Posted - 2006.01.29 11:43:00 -
[108]
Thanks a bazillion dudes
|
Iavia
|
Posted - 2006.01.29 13:54:00 -
[109]
I'em teh SQL nub, so pardon the questions.
I've not had any problems getting the files in to MySql beyond some CHARs that where > 255 and they where easy enough to fix. And one table that had .csv in it's name
I was curious if any one had noticed if what the NPC corps where buying/selling is hiding in here some where I'm not seeing it.
Also I'm having trouble finding any good information on building good indexes. I've built some, and they've helped the speed of many of my selects by many orders of magnitude, but I think I could do better. Can anyone point me at something to read?
|
Sulfiro Domonas
|
Posted - 2006.01.29 15:41:00 -
[110]
totally off-topic: t20 are you who I think you are? (ex (maybe still) FL.be - FL.net crew member )
|
|
Gal'tashec
|
Posted - 2006.01.29 17:47:00 -
[111]
select * Just curious.. I can't seem to find the capacity of the cargo bay on a ship.. the drone bay capacity is there but not cargo. Very simple test query
from dbo.dbo_dgmTypeAttributes join dbo.dbo_dgmAttributeTypes on dbo.dbo_dgmAttributeTypes.attributeID = dbo.dbo_dgmTypeAttributes.attributeId join dbo.dbo_eveUnits on dbo.dbo_eveUnits.unitId = dbo_dgmAttributeTypes.unitId where typeId in ( select typeid from dbo.dbo_invTypes where typeName = 'vexor' )
isn't it exported or am I missing something?
|
Skyran
|
Posted - 2006.01.29 18:20:00 -
[112]
Originally by: jide
Originally by: Jack Tau
Yup, thats what Im saying. Got the CSV file dbo_dgmEffects.csv open right now, and I can see those effects.
Oh, I downloaded the rar files again and dbo_dgmEffects is in there now. It wasn't before.
Just to confirm, the data is located in the files as Jide has said. Just need to redownload. Thanks T20! -------------------------------------- Nope... no sig here... move along. |
|
t20
|
Posted - 2006.01.29 19:30:00 -
[113]
Originally by: Sulfiro Domonas totally off-topic: t20 are you who I think you are? (ex (maybe still) FL.be - FL.net crew member )
the very same
|
|
|
t20
|
Posted - 2006.01.29 19:32:00 -
[114]
Originally by: jide Oh, I downloaded the rar files again and dbo_dgmEffects is in there now. It wasn't before.
Originally by: jide dbo_eveNames has been added too. And it has the names for the agents.
my ad for not mentioning this before, but these two files have been added now in both the csv amd sql packages. have fun with the goodies
|
|
Zoon
|
Posted - 2006.01.29 22:48:00 -
[115]
Now that I've imported all the original zip and the two newly added tables, I am quite gobsmacked at just what can be done with the data.
If I can find the time, I'm going to do everything!! Expand my agent tool, ice belt searches, NPC database, ship fittings maybe?
It's making me dizzy just thinking __________________________________ Are you a mission runner? Have you tried our Agent Tool and Mission Guides? You should! |
Ayla Vanir
|
Posted - 2006.01.30 04:19:00 -
[116]
Been having a problem updating a mysql db with the new dbo_dgmEffects.sql file. At this point, I think the file is corrupted with a non-printing character somewhere between the start of the file and the start of the 2nd record.
Haven't really got the experience to confirm, so I've entered in the table definition and first couple of records manually. For my own sanity though, I'm curious if anyone else was having trouble with this dbo_dgmEffects.sql file.
Escrow Market Revamp
|
Gal'tashec
|
Posted - 2006.01.30 09:35:00 -
[117]
Ayla Vanir,
I imported that table into a SQL Server 2000 database last night without any problems. Now to find out where I can find the cargo capacity of a ship
|
|
t20
|
Posted - 2006.01.30 10:53:00 -
[118]
Originally by: Gal'tashec Ayla Vanir,
I imported that table into a SQL Server 2000 database last night without any problems. Now to find out where I can find the cargo capacity of a ship
dbo_invTypes > capacity
|
|
Jack Tau
|
Posted - 2006.01.30 12:02:00 -
[119]
I've updated my diagram with the new tables, so it should all be there now. I've excluded the names table because its another simple join, and one of the links has a label on it, because its an "IF NOT NULL" that you'll need to code around.
Linking Diagram Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
Jack Tau
|
Posted - 2006.01.30 12:09:00 -
[120]
Originally by: Iavia I'em teh SQL nub, so pardon the questions.
I've not had any problems getting the files in to MySql beyond some CHARs that where > 255 and they where easy enough to fix. And one table that had .csv in it's name
I was curious if any one had noticed if what the NPC corps where buying/selling is hiding in here some where I'm not seeing it.
Also I'm having trouble finding any good information on building good indexes. I've built some, and they've helped the speed of many of my selects by many orders of magnitude, but I think I could do better. Can anyone point me at something to read?
Is this in MySQL? Indexes work slightly differently in all databases, so it would have to be specific advice. Generally you should try to keep the indexes as small as possible, and run an execution plan(Can you do that in mySQL? If not get a tool to do it) to spot where your queries are slowing down and alter your indexes to help.
Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
|
FireFoxx80
|
Posted - 2006.01.30 12:43:00 -
[121]
Maybe a SQL techie can help this:
I run the SQL import scripts via Query Analyser, and they go in fine. Well all except the scripts that are over ~2MB, where I get an 'insufficient memory' error.
Query Analyser is being run on a different system to the SQL Server.
23? # Missile Tool # ex: P-TMC : USAC |
Gal'tashec
|
Posted - 2006.01.30 12:56:00 -
[122]
Originally by: FireFoxx80 Maybe a SQL techie can help this:
I run the SQL import scripts via Query Analyser, and they go in fine. Well all except the scripts that are over ~2MB, where I get an 'insufficient memory' error.
Query Analyser is being run on a different system to the SQL Server.
Use the Import Data feature of the Enterprise Manager instead. I had the same problem as you but was able to import it without any problems
|
Gal'tashec
|
Posted - 2006.01.30 12:58:00 -
[123]
Originally by: t20
Originally by: Gal'tashec Ayla Vanir,
I imported that table into a SQL Server 2000 database last night without any problems. Now to find out where I can find the cargo capacity of a ship
dbo_invTypes > capacity
t20 - thanks! A bit puzzled as to why it wasnt included in with the other attributes and instead placed directly with the type itself?
|
FireFoxx80
|
Posted - 2006.01.30 16:58:00 -
[124]
Originally by: Gal'tashec
Originally by: FireFoxx80 Maybe a SQL techie can help this:
I run the SQL import scripts via Query Analyser, and they go in fine. Well all except the scripts that are over ~2MB, where I get an 'insufficient memory' error.
Query Analyser is being run on a different system to the SQL Server.
Use the Import Data feature of the Enterprise Manager instead. I had the same problem as you but was able to import it without any problems
Do you just import the CSV values into tables created with the CREATE TABLE defs in the SQL scripts?
23? # Missile Tool # ex: P-TMC : USAC |
Gigi Barbagrigia
|
Posted - 2006.01.31 04:58:00 -
[125]
Indexes: Since data will be mostly (exclusively more likely) read only, you need not to hold back on their creation. First I would suggest identifing all fields you'll be using in JOINs. Afaik all are of integer type so not very disk space hungry. Next, try to draft your displays of data. Which columns will you use for sorting? And lastly, which char fields will be searchable. ----- 42 |
Gal'tashec
|
Posted - 2006.01.31 08:16:00 -
[126]
Originally by: FireFoxx80 Do you just import the CSV values into tables created with the CREATE TABLE defs in the SQL scripts?
In Enterprise Manager
[1] Create a new database [2] Right-click it and select "All Tasks" [3] Select "Import Data" [4] Use the wizard to complete the import (one table at a time)
be sure to check the "First row has column names" and the seperator is semicolon.
Hope it helps
|
Jack Tau
|
Posted - 2006.01.31 09:17:00 -
[127]
Originally by: Gal'tashec
Originally by: FireFoxx80 Do you just import the CSV values into tables created with the CREATE TABLE defs in the SQL scripts?
In Enterprise Manager
[1] Create a new database [2] Right-click it and select "All Tasks" [3] Select "Import Data" [4] Use the wizard to complete the import (one table at a time)
be sure to check the "First row has column names" and the seperator is semicolon.
Hope it helps
This is of course if your using the CSV export.. For the SQL Import, either get a better tool than QA(It's a bit old now :P) or if you insist on using it, replace all the blank lines with "GO" commands, and QA will batch it up for you. Assuming you didnt alter the default connection options in you QA settings. Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
Skyran
|
Posted - 2006.01.31 21:18:00 -
[128]
Originally by: Jack Tau For the SQL Import, either get a better tool than QA(It's a bit old now :P)
Just out of curiosity, what would you recommend other than QA? It's served me well over the years, but if there's something better, I'd love to take a look at it. :) -------------------------------------- Nope... no sig here... move along. |
Bedrock
|
Posted - 2006.01.31 21:19:00 -
[129]
just out of curiousity, besides the ones already mentioned, what other programs/databases are you people using for all this data? Thanks.
|
Jack Tau
|
Posted - 2006.02.01 00:04:00 -
[130]
Originally by: Bedrock just out of curiousity, besides the ones already mentioned, what other programs/databases are you people using for all this data? Thanks.
Im using SQL Server 2005 and ASP.NET at the moment, as I'm re-building my site, but I was using MSSQL2000 and plain ASP. My website link is below, and its based on the data(Login with test:test) Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
|
Jack Tau
|
Posted - 2006.02.01 09:18:00 -
[131]
Originally by: Skyran
Originally by: Jack Tau For the SQL Import, either get a better tool than QA(It's a bit old now :P)
Just out of curiosity, what would you recommend other than QA? It's served me well over the years, but if there's something better, I'd love to take a look at it. :)
Well I am currently using SpeedSQLIde Pro, but they were just bought out by Quest, who are now stopping all development :| So its a great little tool, but probably not good if you intend to use it for years. I've also just bought a license for SQL Manager 2005 by EMS, which is a slightly better tool(Allthough a lot more costly), but it does have MSSQL2005 support which I need now.
Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
FireFoxx80
|
Posted - 2006.02.01 11:20:00 -
[132]
Yeah, could parse and batch the SQL using VB.NET I suppose, never thought of that.
23? # Missile Tool # ex: P-TMC : USAC |
Sulfiro Domonas
|
Posted - 2006.02.01 14:55:00 -
[133]
Originally by: t20
Originally by: Sulfiro Domonas totally off-topic: t20 are you who I think you are? (ex (maybe still) FL.be - FL.net crew member )
the very same
I'm Watcher (ex FL.be) it's thank to you I started playing (that and speed :p) this game :)
|
Kaladr
|
Posted - 2006.02.02 00:35:00 -
[134]
Originally by: Bedrock just out of curiousity, besides the ones already mentioned, what other programs/databases are you people using for all this data? Thanks.
PostgreSQL and Python of course. ---- EVE-Central.com Coss-Region Market Browser | Obsidian Technologies - Manufacturing and Logistics |
FireFoxx80
|
Posted - 2006.02.02 11:08:00 -
[135]
Originally by: Bedrock just out of curiousity, besides the ones already mentioned, what other programs/databases are you people using for all this data? Thanks.
I use MS SQL 2003 server, with ASP/ASP.NET/PHP to use it.
23? # Missile Tool # ex: P-TMC : USAC |
Iavia
|
Posted - 2006.02.02 16:13:00 -
[136]
Thanks for the pointers.
I've used MySQl Browser (can't say enough good things about it) to index the primary and foreign keys.
One query that was 90 sec. unindexed is now just under a half of a sec.
I have one query with 5 joins, a Group by/count(distinct), 5 conditions, and 3 sorts, that also hits that monster mapDenormalize (360k+ rows) table, that comes back in 10 sec. on P4 2.6 gHz.
|
Ser Julian
|
Posted - 2006.02.03 00:01:00 -
[137]
I was looking to dbo_mapSolarsystems, and I wonder to what the fields 'hub', 'corridor', 'fringe', and 'border' refer. Is it for a pathfinding algorithm ? Or is it something more trivial ? ^^
|
Bermag
|
Posted - 2006.02.03 13:49:00 -
[138]
Is the activity type description posted in the blog correct? When I look in materialsFor Activity tab it looks like activity id 6 and 7 is manufacturing and recycle.
|
Zoon
|
Posted - 2006.02.05 11:20:00 -
[139]
Originally by: Bedrock just out of curiousity, besides the ones already mentioned, what other programs/databases are you people using for all this data? Thanks.
At the moment I'm using MySql (hey I can't afford MSSQL and I wouldn't dare run a Windows webserver, I've done that before, and its a nightmare) and ASP.Net ... although I am using ASP.Net via Mono and Apache 2 which is proving a little troublesome.
I've got a PHP book somewhere so I'll be going PHP/MySql as soon as I get some practice with it. __________________________________ Are you a mission runner? Have you tried our Agent Tool and Mission Guides? You should! |
Jack Tau
|
Posted - 2006.02.05 11:57:00 -
[140]
Originally by: Zoon
Originally by: Bedrock just out of curiousity, besides the ones already mentioned, what other programs/databases are you people using for all this data? Thanks.
At the moment I'm using MySql (hey I can't afford MSSQL and I wouldn't dare run a Windows webserver, I've done that before, and its a nightmare) and ASP.Net ... although I am using ASP.Net via Mono and Apache 2 which is proving a little troublesome.
I've got a PHP book somewhere so I'll be going PHP/MySql as soon as I get some practice with it.
MSSQL is free :P The MSDE for 2000, or the express version for 2005. Ye there cut-down, but there still far superior to mySql. Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
|
Gal'tashec
|
Posted - 2006.02.05 13:54:00 -
[141]
Originally by: FireFoxx80
Originally by: Bedrock just out of curiousity, besides the ones already mentioned, what other programs/databases are you people using for all this data? Thanks.
I use MS SQL 2003 server, with ASP/ASP.NET/PHP to use it.
You must be the only one in the entire world thats running MS SQL Server 2003, hehe the new version is called 2005 and the previous 2000.
|
Jack Tau
|
Posted - 2006.02.06 09:20:00 -
[142]
Originally by: Gal'tashec
Originally by: FireFoxx80
Originally by: Bedrock just out of curiousity, besides the ones already mentioned, what other programs/databases are you people using for all this data? Thanks.
I use MS SQL 2003 server, with ASP/ASP.NET/PHP to use it.
You must be the only one in the entire world thats running MS SQL Server 2003, hehe the new version is called 2005 and the previous 2000.
Probably because theres no such thing as MSSQL2003 :P Its just 2000 installed on windows 2003 with a new logo. Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
Narusegawa Naru
|
Posted - 2006.02.10 10:30:00 -
[143]
Unfortunately these SQL exports are designed around MS-SQL (T-SQL) which is a shame. However I've imported mine to MySQL 4.11 by running a search and replace on "dbo." (the table owner shouldn't be prefixed anyway), and also on ".csv" as table names shouldn't contain special characters. And lastly there are 2 CREATE TABLE statements that have a value on UNKNOWN
CREATE TABLE dbo.dgmAttributeTypes( attributeID UNKNOWN,
Change these to INTEGER and things work fine. Albeit MySQL can be VERY slow when using joins in your SQL so it's best to remember to create INDEX's on the ID columns using normal indexing logic, which if your even bothering to use these exports you should atleast know basic database administration and optimization.
|
res0nance
|
Posted - 2006.02.10 13:26:00 -
[144]
Holy **** this stuff takes a long time to add via a php interface / http socket . Had to select bite sized chunks of 1200 records.
|
mikic
|
Posted - 2006.02.12 14:37:00 -
[145]
Hi, in data_misc_sql.rar i'm wondering about the database schemes you use the dbo_eveNames.sql script should that really be:
CREATE TABLE dbo_eveNames( ... )
or did you mean
CREATE TABLE dbo.eveNames( ... )
and in dbo_invTypes.csv.sql:
CREATE TABLE dbo_invTypes.csv( ... )
i guess that should be
CREATE TABLE dbo.invTypes( ... )
HavPhun - Mikic
|
Takigama
|
Posted - 2006.02.12 17:05:00 -
[146]
Originally by: Bedrock just out of curiousity, besides the ones already mentioned, what other programs/databases are you people using for all this data? Thanks.
i've been using it mostly with php/j2ee and postgress/mysql/oracle (btw, converting from mssql's rather evil and not very sql standards compliant types back to other dbs is quite horrid)
btw CCP, thank you from the bottom of my heart for doing an sql export!!! :D :D :D
|
Gal'tashec
|
Posted - 2006.02.13 13:57:00 -
[147]
Is CCP experimenting with NOS counter messures ? I was looking at some of the export data and came across this by pure chanse
TEST garlic Small Nosferatu I Blueprint Alucard I Kills Vampires Dead Garlic I 1 Blueprint 'Helsing' Anti-Vampire I Kills Vampires Dead Garlic I 2 Blueprint 'Blade' Vampire Hunter I Kills Vampires Dead Garlic I 3 Blueprint 'Buffy' Vampire Slayer I Kills Vampires Dead Garlic I 4 Blueprint
|
Hanns
|
Posted - 2006.02.15 05:35:00 -
[148]
Originally by: Gal'tashec Is CCP experimenting with NOS counter messures ? I was looking at some of the export data and came across this by pure chanse
TEST garlic Small Nosferatu I Blueprint Alucard I Kills Vampires Dead Garlic I 1 Blueprint 'Helsing' Anti-Vampire I Kills Vampires Dead Garlic I 2 Blueprint 'Blade' Vampire Hunter I Kills Vampires Dead Garlic I 3 Blueprint 'Buffy' Vampire Slayer I Kills Vampires Dead Garlic I 4 Blueprint
ROFL gotta love the DEV's sense of humor
Jacques 4tw - Hanns I watched Hanns beat up Chuck Norris yesterday -zhuge liang
|
Gaiden Estoval
|
Posted - 2006.02.16 12:17:00 -
[149]
Sorry to be a pain, but can someone point me in the right place to look in the tables for the appropriate skills for an item?
|
Turiel Demon
|
Posted - 2006.02.16 12:52:00 -
[150]
Originally by: Hanns
Originally by: Gal'tashec Is CCP experimenting with NOS counter messures ? I was looking at some of the export data and came across this by pure chanse
TEST garlic Small Nosferatu I Blueprint Alucard I Kills Vampires Dead Garlic I 1 Blueprint 'Helsing' Anti-Vampire I Kills Vampires Dead Garlic I 2 Blueprint 'Blade' Vampire Hunter I Kills Vampires Dead Garlic I 3 Blueprint 'Buffy' Vampire Slayer I Kills Vampires Dead Garlic I 4 Blueprint
ROFL gotta love the DEV's sense of humor
I think that may just be Gal'tashec's sense of humour ----
nothing to see here, move along nicely now, is that a pink dread out there. aaww you just missed it -eris It's not an Eidolon with 5 Basic Miner's on it, that's for certain.(FF04) ~kieron No love for me? :'( - Wrangler If you can't beat Eris, join her, hmmm that sounded so much better in my head - Cortes Cuddles Eeyore. He's soooo cute and doesn't play EVE. perfect -eris Eve-online Forum mods arn't Pokemon, you don't need to collect them all - Ductoris Here's my autograph - now do I get some groupie lub? Jacques' Don't be greedy :P -Capsicum |
|
Iavia
|
Posted - 2006.02.16 14:17:00 -
[151]
Originally by: Narusegawa Naru Unfortunately these SQL exports are designed around MS-SQL (T-SQL) which is a shame. However I've imported mine to MySQL 4.11 by running a search and replace on "dbo." (the table owner shouldn't be prefixed anyway), and also on ".csv" as table names shouldn't contain special characters. And lastly there are 2 CREATE TABLE statements that have a value on UNKNOWN
CREATE TABLE dbo.dgmAttributeTypes( attributeID UNKNOWN,
Change these to INTEGER and things work fine. Albeit MySQL can be VERY slow when using joins in your SQL so it's best to remember to create INDEX's on the ID columns using normal indexing logic, which if your even bothering to use these exports you should atleast know basic database administration and optimization.
With 5 I had no trouble with the UNKNOWN. I just created a DB called dbo to aviod the cut and paste. The .csv thing I handled the same.
I've had almost no slow downs with sick amounts of joins once I had indexes, and figured out that myiasm tables are way faster than innobd ones
With MySQL and the objective C api ... can't really see why I'd ever want to look crosswise at TSQL.
|
whjz
|
Posted - 2006.02.23 16:23:00 -
[152]
Has anyone else noticed there is NPC data missing from this feed? Example : Try searching for "Lesser strain mother"
She is no-where to be found.
|
Narusegawa Naru
|
Posted - 2006.02.24 11:39:00 -
[153]
Iavia: Using MyISAM type aswell here. utf8_general_ci collation aswell, I use this throughout my server. I really should upgrade from 4.1.11 to 5 at some point but I need to make sure all my other applications (including mail servers) use the new headers aswell. It's a big step upgrading a live mail server database while maintaining the 100% uptime.
|
QSquared
|
Posted - 2006.02.26 08:01:00 -
[154]
Okay, I'm vNew to SQL here, andf well I have a few questions:
I am using SQL 2005 Express, are there any problems with the SQL exports as to why they woudl not work with SQL2005 Express?
I ask this because I keep getting erros on importing saying that I can't set this or that to "false" or "true" this this context. what am I doing wrong?
Is there a way to create these tables en-batch?
Are there any unique ID guide-lines? i was tryign to create the DB Diagram off the few tables that WOULD import but t says I need unique IDs - just pick one?
Does anyone have a good mapping of how I shoudl set up the relations betwene tables?
Maybe it's in one of the tables that I did not get to attach, but I seem to be missing the tables which woudl give items, blueprints and the like meaningful names like "Megathron BPO" or Tritanium.
Again am I misseding DB Tables or did T20 not provide an export of Item build costs and Refine outputs (Base info of course - I obviously expect to have to create the calculations to figure everythign out)
The reason I am doing this, is I have been trackign my BPOs for some time and my refineing for some time as well, so that I woudl always know what I coudl refine somethign for at perfect refine with 0 take. and manufacture somethign for at whatever ME ansd PE I put the PBO in at. I started to try and update the Excel sheet to be able to work with a dynamically assigned ME and PE, and realised I really needed to add alot of BPOs because I just got a T2 BPO.
I decided it might be easier if I coudl get a full BPO listing with all the base mineral requirements from CCP directly, and then just create an app that ran off that, and dso the same thing for Refining as long as I am at it. I plan to do imports of the region's prices to get cost of build or income from refines.
Please help me I am a true NEWB to SQL!!! I woudl appreciate any help anyone can give me! thanks! Please Email me at [email protected] if you woudl like. A Nod is as good as a wink to a blind bat! ;-) ~Q (http://www.TheKnightsTemplar.us) |
Farlox
|
Posted - 2006.02.27 17:19:00 -
[155]
Originally by: Gaiden Estoval Sorry to be a pain, but can someone point me in the right place to look in the tables for the appropriate skills for an item?
I'm looking for the same thing, can't seem to find skills anywhere.
|
Xailia
|
Posted - 2006.03.03 03:00:00 -
[156]
Edited by: Xailia on 03/03/2006 03:01:02 In dgmTypeAttributes under the type, Primary is attributeID 182, Secondary 183, Tertiary 184 - Levels are 277, 278, and 279 respectively
Most information is in dgmTypeAttributes, dgmAttributeTypes has all the attribute data associated with their ID, and the invTypes table has a few things like volume, mass, capacity, etc. that are not in dTA.
Hope that helps.
"The sky above the port was the color of a television, tuned to a dead channel." |
Iavia
|
Posted - 2006.03.03 03:41:00 -
[157]
Originally by: Narusegawa Naru Iavia: Using MyISAM type aswell here. utf8_general_ci collation aswell, I use this throughout my server. I really should upgrade from 4.1.11 to 5 at some point but I need to make sure all my other applications (including mail servers) use the new headers aswell. It's a big step upgrading a live mail server database while maintaining the 100% uptime.
Hehe makes me feel lucky. I justs run the DB on my desk top.
Don't feel bad about not upgrading, most of my for fun programing was on NeXTSTEP 486 untill about 6 months ago
|
The Chef
|
Posted - 2006.03.07 20:11:00 -
[158]
Thanks t20, I'm sure this will be a great help to all the budding developers out there!
I personally imported it into a MySQL 4.1 database. Took a while to do, but for browsing around it seems fast enough. Just started adding keys and index's to speed things up! ==================================== EVEkill (Founder, ex-developer) Visit our homepage |
babo
|
Posted - 2006.03.09 03:14:00 -
[159]
Edited by: babo on 09/03/2006 03:15:17 Edited by: babo on 09/03/2006 03:14:36 I posted in another topic, but will do so here as this does not seem to be a dead topic atm.. I am trying to find out some info on the xyz and min/max coordinates. First: I notice negative values, so I assume this a left-handed coordinate system Second: Are we to still use the z-values instad of the "y" values? Third: noticed that the old data had Constellation xmin/xmax etc values, but the new data seems to only have xyz (I will double check this)
Basically, I am trying to work out a way to take a system and plot text or a small graphic to the spot where it resides on one of the region graphics, obviously this is possible as the game does it on the F11 map.
Using normal techniques here, coordinate subtraction and normalizing the data to the size of the image seems to not produce the results I was looking for and I was wondering if there is something I might be missing.
thanks..
|
Jkat Nosaj
|
Posted - 2006.03.09 20:59:00 -
[160]
I have 2 quick questions:
1.) Can someone briefly explain the "Activity" field in the TL2MaterialsForTypesWithActivity table
2.) When looking up materials in that table for blueprints, I want to look based on the invBlueprints.blueprinttypeid = TL2MaterialsForTypesWithActivity.typeid correct (and not the actual product) - but will that give me the material costs for creating a new blueprint, or the actual item the blueprint is for?
Thanks!
|
|
Ashido
|
Posted - 2006.03.10 12:01:00 -
[161]
Hi
Does anyone know when the img's and data will be updated to fall in with the new patches ?
|
Mortimus
|
Posted - 2006.03.13 08:43:00 -
[162]
Question: Is the ore data / recycling data in this export? if so - where. if not - where should i get it from?
|
radon8
|
Posted - 2006.03.24 18:22:00 -
[163]
Originally by: Mortimus Question: Is the ore data / recycling data in this export? if so - where. if not - where should i get it from?
I'm not seeing the ore data in there either.
|
Andargor theWise
|
Posted - 2006.03.24 19:08:00 -
[164]
Originally by: Mortimus Question: Is the ore data / recycling data in this export? if so - where. if not - where should i get it from?
dbo_TL2MaterialsForTypeWithActivity
Both build and recycle (which seems to be the same) for all typeIDs.
Andargor
|
PENNING
|
Posted - 2006.03.28 06:57:00 -
[165]
how should i get the eve data of chinese edition? i wanna build a chinese fansite base on it.
thx
|
Tieri
|
Posted - 2006.03.28 16:12:00 -
[166]
Edited by: Tieri on 28/03/2006 16:13:59 file dbo_mapSolarSystemJumps.csv contain wrong jump data for example
not included jumps 30002508Trytedald <-> 30002524Ivar 30002510Rens <-> 30002526Frarn 30002507Abudban<-> 30002530Avesber 30002507Abudban<->30002509Odatrik
contain not available ingame jumps 30002510Rens<->30002568Onga
Can you update it pls?
|
Trak Cranker
|
Posted - 2006.03.28 16:54:00 -
[167]
Yeah, we haven't had a Blood update. And I think t20 knows this.
But no reason not to push a little for it. :) Please resize your signature so that it is within the forum rule size limits - Jacques |
Darul Naki
|
Posted - 2006.03.29 19:20:00 -
[168]
Originally by: whjz Has anyone else noticed there is NPC data missing from this feed? Example : Try searching for "Lesser strain mother"
Yep, I've seen that some NPCs are missing. It could be interesting to have an updated SQL export. __________ Speak in the Touffe - Octet Sunrise corporation board |
Wulfstan
|
Posted - 2006.03.31 10:50:00 -
[169]
Edited by: Wulfstan on 31/03/2006 10:49:50 I'd just like to express my appreciation to T20 for providing the data in the first place. There aren't many games developers who'd open the data up in this fashion to their players. Much obliged to you.
.. and many thanks to Jack Tau for the database schema. I only want to play about with NPC rats, so you saved me a lot of messing about. Much kudos to you too mate.
|
Crato
|
Posted - 2006.03.31 11:14:00 -
[170]
Originally by: Wulfstan Edited by: Wulfstan on 31/03/2006 10:49:50 I'd just like to express my appreciation to T20 for providing the data in the first place. There aren't many games developers who'd open the data up in this fashion to their players. Much obliged to you.
.. and many thanks to Jack Tau for the database schema. I only want to play about with NPC rats, so you saved me a lot of messing about. Much kudos to you too mate.
signed
|
|
KuranesGrey
|
Posted - 2006.04.01 22:49:00 -
[171]
It is majorly cool that the devs release this data. I hope they are rewarded with lots of great third party tools like the ones Grismar has built!
Here's a quicky Python script to convert the SQL dump to a format MySQL 5.0.18 can import. I've converted leading whitespace to periods so that it makes it through. On a Unix box just do "cat *.sql | rewriteToMySQL.py | mysql eve" to load all the data.
#!/usr/bin/python import sys, re
charField = re.compile(r"CHAR\((\d+)\)") charRewrite = re.compile(r"^(.*)CHAR\((\d+)\)(.*)$")
for l in sys.stdin: ....out = l
....# Replace long char fields with text ....if charField.search(l): ........m = charField.search(l) ........size = m.group(1) ........if int(size) < 255: ............out = l ........else: ............out = charRewrite.sub(r"\1text\3", l)
....# Replace UNKNOWN fields with INTEGER (2 id fields have this) ....out = out.replace("UNKNOWN", "integer")
....# Rewrite the table names; we don't need the dbo. prefix ....out = out.replace("dbo.", "")
....# Rewrite the table names; .csv ended up in a couple of table names ....out = out.replace(".csv", "")
....print out,
|
KuranesGrey
|
Posted - 2006.04.02 04:13:00 -
[172]
Has anyone worked out the various foreign key relationships in the schema? I found the data diagram at http://eve.enkidu.cx/datafeeds/datadiagram.jpg but what I really want is to put the foreign keys in the schema to build indices and make it easier to know how to join.
|
Krtisitna
|
Posted - 2006.04.05 11:33:00 -
[173]
How to use this sql files ?
|
Razalea
|
Posted - 2006.04.05 13:13:00 -
[174]
Edited by: Razalea on 05/04/2006 13:13:21 Does anybody happen to have a dump of the renormalized form of dpo_mapDenormalize? If not, can anybody give me a hint as to how to renormalize it? Im thinking a SELECT query based on the NULL terms and then another SELECT to pull out the moons into another table seperate from the planets.
|
General Lilost
|
Posted - 2006.04.09 04:37:00 -
[175]
Originally by: Jkat Nosaj I have 2 quick questions:
1.) Can someone briefly explain the "Activity" field in the TL2MaterialsForTypesWithActivity table
[....]
Thanks!
I have same question. Anybody figured out the "Activity" field? It seems like all manufacturable items have a value of 6 or 7, but I haven't noticed a pattern that would indicate what they mean. I am not that experienced with manufacturing so maybe I'm missing something simple.
"Activity" field = ???
|
Mortimus
|
Posted - 2006.04.09 07:24:00 -
[176]
Edited by: Mortimus on 09/04/2006 07:29:12 "0";"None" "1";"Manufacturing" "2";"Researching Technology" "3";"Researching Time Productivity" "4";"Researching Material Productivity" "5";"Copying" "6";"Duplicating" "7";"Reverse Engineering"
Or so i managed to figure out... I think in the original blog t20 said what these number were.
|
Mortimus
|
Posted - 2006.04.09 07:27:00 -
[177]
Originally by: Andargor theWise
Originally by: Mortimus Question: Is the ore data / recycling data in this export? if so - where. if not - where should i get it from?
dbo_TL2MaterialsForTypeWithActivity
Both build and recycle (which seems to be the same) for all typeIDs.
Andargor
I'm not seeing the ore data in there? or is there some relation that i'm not seeing?
|
The Chef
|
Posted - 2006.04.09 11:43:00 -
[178]
The build/recycle costs are linked to the blueprint ID of the item you want. So, if you want to know the costs for a merlin, find the ID for the merlin and then look that ID up in the T2L... table ==================================== EVEkill (Founder, ex-developer) Visit our homepage |
|
Chribba
|
Posted - 2006.04.09 13:42:00 -
[179]
Anyone happen to have a copy of data_misc_sql.rar since it can't be downloaded any longer?
EVE-Files | EVE-Search | Monitor this Thread |
|
Mitsunari Ishida
|
Posted - 2006.04.11 20:03:00 -
[180]
Anyone know where I can find .rar files relating to ship attributes: number of slots, resistances etc... also if there is a similar .rar file relating to modules. This would be great.
|
|
PreTender
|
Posted - 2006.04.11 20:23:00 -
[181]
Originally by: Chribba Anyone happen to have a copy of data_misc_sql.rar since it can't be downloaded any longer?
nope sorry
but i hope this means we get a new one soon :) __________________________ http://www.eve-extra.com |
Jack Tau
|
Posted - 2006.04.11 22:53:00 -
[182]
I'm no longer playing eve due to RL, so I'm not watching here. But if anyone needs a hand please drop me a line tony AT enkidu DOT cx, and I'll do what I can. Enkidu Production Manager
If you dont understand this sig, you need to get out less ;) |
BonBo
|
Posted - 2006.04.15 10:30:00 -
[183]
I have noticed that not all the jumps in EVE seem to be on this list. At least I think that is the case. Can anyone confirm that this data is not fully up to date and furthermore, if this is true - which I am almost certain it is, can we please have an updated list of data. Great data though!
|
Eswidrol
|
Posted - 2006.04.15 19:18:00 -
[184]
Edited by: Eswidrol on 15/04/2006 19:18:01 btw, 5 files were updated on april 13th.
|
KaReL Lightyear
|
Posted - 2006.04.15 21:43:00 -
[185]
Watch out... The new layout uses '.' to seperate thousands (within the cvs). It confused my program here ;).
Also... In the Denormalized csv, the "security" is not filled in for solarsystems (and also the REAL security is not filled in anymore I see).
Is it possible to export the security as the real security? Not the one we see ingame?
Thanks!
|
Zoon
|
Posted - 2006.04.16 00:06:00 -
[186]
Originally by: KaReL Lightyear Watch out... The new layout uses '.' to seperate thousands (within the cvs). It confused my program here ;).
Also... In the Denormalized csv, the "security" is not filled in for solarsystems (and also the REAL security is not filled in anymore I see).
Is it possible to export the security as the real security? Not the one we see ingame?
Thanks!
Check mapsolarsystems. I haven't downloaded the new data yet, but the data you seek was in there on the last export.
I used a double JOIN SQL query to generate the data for my True Security tool, so you should be able to also. ----- Are you a mission runner? Try our Agent Tool and Mission Guides! True System Security |
KaReL Lightyear
|
Posted - 2006.04.16 05:21:00 -
[187]
Not anymore I am afraid (csv speaking). It is still in the SQL-files, I just discovered that ;).
|
Zoon
|
Posted - 2006.04.16 09:55:00 -
[188]
Originally by: KaReL Lightyear Not anymore I am afraid (csv speaking). It is still in the SQL-files, I just discovered that ;).
MySql is free and can import all the files almost directly - just hafta change the UNKNOWN type declaration to INT and CHAR(5000) to TEXT within the SQL files. You can do SQL queries at the command line and just copy and paste into Excel, assuming you don't know a bit of PHP / ASP ----- Are you a mission runner? Try our Agent Tool and Mission Guides! True System Security |
Mortecai
|
Posted - 2006.04.18 20:41:00 -
[189]
Question, how can I find the item icon relation from database.
Say I got a Nosferatu icon with the name icon01_03
I can get the 01 from the dbo.invTypes table graphicID column, but where do I find the 03? Or am I deriving the image name totally wrong way? How can I link the image icon with correct item? -- Mortecai |
TheBelgarion
|
Posted - 2006.04.19 22:12:00 -
[190]
dammm!¦!!
i just saw that some data was updated ( as i found out that e.g. Ship Crew wasnt in the data) and redownloaded the new files from 13.april 2006
SQL format of some of the export files are "BROKEN".
most errors i have seens so far is the missing "create table" block at the beginning ( coz my parser complained *bfg*)
e.g.: dbo_staStations.sql
can u plz fix that so that all files include the create block !!
thx a lot for the good Data support for the community ! --------------------------------------------------------- a Challenge System for Eve |
|
Enaxtiomarus
|
Posted - 2006.04.20 02:57:00 -
[191]
SQL Server Express is free too and works great for those used to Microsoft's tools. Books Online and the Management Studio Express are separate downloads, but also free.
Works for me!
|
TheBelgarion
|
Posted - 2006.04.20 06:22:00 -
[192]
Edited by: TheBelgarion on 20/04/2006 06:23:39 yes than importing that into MYSQL ( older version) I had to replace the true/False with 1/0 and also found the Problem with the missing NULL value and added that on the import routine ... at least this could be worked around. But missing Create Table set is kinda very bad.
I do have a little php routine which converts Database,Table Names and values on import. --------------------------------------------------------- a Challenge System for Eve |
Darul Naki
|
Posted - 2006.04.21 16:34:00 -
[193]
Originally by: Eswidrol Edited by: Eswidrol on 15/04/2006 19:18:01 btw, 5 files were updated on april 13th.
SQL: "published" column value for some entities is wrong, previous export was better (fe. missiles, hellhound f.o.f. heavy missile). Still missing some NPC vessels (fe. Convoy Guard Captain).
But that's great anyway! __________ Speak in the Touffe - Octet Sunrise corporation board (IGB, Solaris-like) |
TheBelgarion
|
Posted - 2006.04.22 08:21:00 -
[194]
Originally by: Darul Naki
Originally by: Eswidrol Edited by: Eswidrol on 15/04/2006 19:18:01 btw, 5 files were updated on april 13th.
SQL: "published" column value for some entities is wrong, previous export was better (fe. missiles, hellhound f.o.f. heavy missile). Still missing some NPC vessels (fe. Convoy Guard Captain).
But that's great anyway!
the ONLY think that is wrong [ guess u used the phrase rom ur importer] is that NULL fields are exported as empty fields instead of NULL as value ...
--------------------------------------------------------- a Challenge System for Eve |
Darul Naki
|
Posted - 2006.04.22 09:53:00 -
[195]
Originally by: TheBelgarion the ONLY think that is wrong [ guess u used the phrase rom ur importer] is that NULL fields are exported as empty fields instead of NULL as value ...
This one isn't a big deal, you have just to mass replace every ",," and ",);" by ",NULL," and ",NULL);". Try Textpad or UltraEdit.
But for the "published" field, this is more problematic because it doesn't correspond to what the Tranquility pilots can see or use. One of my tools needs the list of available missiles on the market, it was easy with the previous export, but with this new one I must do it by hand... __________ Speak in the Touffe - Octet Sunrise corporation board (IGB, Solaris-like) |
TheBelgarion
|
Posted - 2006.04.23 20:11:00 -
[196]
i said i had an php import sniplet that does exacly that ..and u forgot "(," => "(NULL," .. :-)
--------------------------------------------------------- a Challenge System for Eve |
TheBelgarion
|
Posted - 2006.04.26 11:25:00 -
[197]
does that export contain informations about MOD`s Skill requirements anythere !?!? --------------------------------------------------------- a Challenge System for Eve |
Rells
|
Posted - 2006.04.26 11:33:00 -
[198]
Originally by: t20 This devblog gives you the updated type info, construction requirements, TL2 construction details, universe-wide info, station details and much more ... happy fiddling
Post requests here if you have any (that are related to this subject)
Anyone find it interesting that they use RAR as their compression engine?
◄ PvP University: Isnt it time you learned how to fight back? |
Herra B
|
Posted - 2006.04.27 13:27:00 -
[199]
These six following files do not contain any table defenitions. Am I missing something or are these just update files for previous releases?
dbo_staOperations.sql dbo_staOperationServices.sql dbo_staServices.sql dbo_staStations.sql dbo_staStationTypes.sql dbo_TL2MaterialsForTypeWithActivity.sql
|
Ching Ling
|
Posted - 2006.04.29 18:08:00 -
[200]
Edited by: Ching Ling on 29/04/2006 18:08:47 Hi, I imported the SQL scripts to MS SQL 2000, it was fine except...
Some table defs are missing as stated in the previous post I had to replace 'true' to '1' and 'false' to '0' I had to specify some nullable fields
Otherwise it's fine, not bad for a EvE newbie! ---------- EvE Ship Classes now in poster format |
|
elFarto
|
Posted - 2006.04.29 20:32:00 -
[201]
There appears to be something very wrong with the data export.
From an old SQL files release (not sure which one, thanks to BarmaLINI):
Quote: INSERT INTO dbo.dgmTypeAttributes (typeID,attributeID,valueInt,valueFloat) VALUES(10299,114,null,16);
INSERT INTO dbo.dgmTypeAttributes (typeID,attributeID,valueInt,valueFloat) VALUES(10299,116,null,0);
INSERT INTO dbo.dgmTypeAttributes (typeID,attributeID,valueInt,valueFloat) VALUES(10299,117,null,0);
INSERT INTO dbo.dgmTypeAttributes (typeID,attributeID,valueInt,valueFloat) VALUES(10299,118,null,12);
From the latest ones I've just downloaded:
Quote: INSERT INTO dbo.dgmTypeAttributes (typeID,attributeID,valueInt,valueFloat) VALUES(10299,114,,0);
INSERT INTO dbo.dgmTypeAttributes (typeID,attributeID,valueInt,valueFloat) VALUES(10299,116,,32);
INSERT INTO dbo.dgmTypeAttributes (typeID,attributeID,valueInt,valueFloat) VALUES(10299,117,,8);
INSERT INTO dbo.dgmTypeAttributes (typeID,attributeID,valueInt,valueFloat) VALUES(10299,118,,0);
As you can see, this NPC (Drone Controller) has changed its damage types completely.
t20, any chance of a non-bree influenced data export...?
Or is this an export of a to-be released version of EVE?
Thanks & Regards elFarto npc.elfarto.com > Ingame NPC database Zoe: Do you really think any of us are going to get through this? Jayne: I might! |
Quutar
|
Posted - 2006.05.02 18:19:00 -
[202]
Originally by: Herra B Edited by: Herra B on 27/04/2006 13:43:05 These six following files do not contain any table defenitions. Am I missing something or are these just update files for previous releases?
dbo_staOperations.sql dbo_staOperationServices.sql dbo_staServices.sql dbo_staStations.sql dbo_staStationTypes.sql dbo_TL2MaterialsForTypeWithActivity.sql
Could someone confirm that this is close to beging right?
CREATE TABLE staOperations (activityID INTEGER,operationID INTEGER,operationName CHAR(255),description VARCHAR(1000), fringe INTEGER,corridor INTEGER,hub INTEGER,border INTEGER,ratio INTEGER,caldariStationTypeID INTEGER, minmatarStationTypeID INTEGER,amarrStationTypeID INTEGER,gallenteStationTypeID INTEGER, joveStationTypeID INTEGER);
CREATE TABLE staServices (serviceID INTEGER,serviceName CHAR(255),description VARCHAR(1000));
CREATE TABLE staOperationServices (operationID INTEGER,serviceID INTEGER);
CREATE TALBE staStations (stationID INTEGER,security INTEGER,dockingCostPerVolume INTEGER,maxShipVolumeDockable INTEGER, officeRentalCost INTEGER,operationID INTEGER,stationTypeID INTEGER,corporationID INTEGER, solarSystemID INTEGER,constellationID INTEGER,regionID INTEGER,stationName char(255),x DOUBLE PRECISION, y DOUBLE PRECISION,z DOUBLE PRECISION,reprocessingEfficiency DOUBLE,reprocessingStationsTake DOUBLE, reprocessingHangarFlag INTEGER);
CREATE TABLE staStationTypes (stationTypeID INTEGER,dockingBayGraphicID INTEGER,hangarGraphicID INTEGER,dockEntryX INTEGER, dockEntryY INTEGER,dockEntryZ INTEGER,dockOrientationX INTEGER,dockOrientationY INTEGER, dockOrientationZ INTEGER,operationID INTEGER,officeSlots INTEGER,reprocessingEfficiency DOUBLE, conquerable BOOL);
CREATE TABLE TL2MaterialsForTypeWithActivity (typeID INTEGER,activity INTEGER,requiredTypeID INTEGER,quantity INTEGER,damagePerJob DOUBLE PRECISION);
The one I downloaded yesterday had TL2MaterialsForTypeWithActivity defined...
CREATE TABLE TL2MaterialsForTypeWithActivity( typeID INTEGER, activity INTEGER, requiredTypeID INTEGER, quantity INTEGER, damagePerJob DOUBLE PRECISION);
was at the header of the file... but yes... you are right about the others being missing.
sonofabeachballbouncingmarymotherfiretrucker |
Marquedios
|
Posted - 2006.05.07 16:21:00 -
[203]
Perhaps I'm nuts - but some of the fields have negative values for the materials; an example is the "Eagle" (typeID 12012). Now obviously a quit glance at the ITEM database reveals that this is not so.
Any takers? ---------------------------------------- If it moves, shoot it; If it doesn't move, shoot it anyway -- it might move later. |
Nechtan
|
Posted - 2006.05.07 19:20:00 -
[204]
Hey
I'm trying to link item names to the icons found in the img_icons_black.rar file, but have run into a dead end it seems...
I've linked the tables eveGraphics and invTypes, so I can search for the item name in invTypes, column typename, and look up the appropriate icon in the icon column in eveGraphics. Problem is that for some items, ie. the Thorax, the icon column in eveGraphics is empty?
Am I doing this wrong, or does anyone have a solution to this problem?
|
Quutar
|
Posted - 2006.05.08 16:00:00 -
[205]
ok... i have since gone through and imported the entire database into MySQL... create primary keys on each table... and created the foreign keys also (hopefully)... I have run across a couple of things not covered yet.
I also had to create a table for the corporation and station activity types. 1=Agriculture 2=Construction 3=Mining 4=Chemical 5=Military 6=Biotech 7=Hi-Tech 8=Entertainment 9=Shipyard 10=Warehouse 11=Retail 12=Trading 13=Bureaucratic 14=Political 15=Legal 17=Financial 18=Education 19=Manufacture 20=UNKNOWN There was no value of 16 used anywhere in the database... and the value of 20 were used for stations only... not for corps... so i could not simply access the website to find its value.
in the dgmAttributeTypes table... what does attributeCategory access... is it an internal only data value... does it index to a table that I am to blind to see or is missing?
also... in that same table... attributeIdx ... there is only 11 values of it... and they are unique to one row each... is this an internal code link? it might seam so.
in the dgmEffects table... the effectCategory collumn... again... is this pointing to a table I am not seeing... one that is missing... or is this totally internal?
in the dgmEffects table again there is two entries that seam kind of wierd... preExpression and postExpression... what are these for?
I had to insert two values into the dgmAttributeTypes table... since values 0 and 1 were missing... they were used in the dgmEffects table, referenced by the falloffAttributeID collumn.
in mapDenormalize the itemID value does not match fully to the eveNames table... there are entries in the mapDenormalize that are not in eveNames... not a big deal since it has its own name field
mapLandmarks does not have any values what so ever for locationID
mapSolarSystems has no values what so ever for allianceID... i assume this is for player controlled alliances
staStations was wierd... it has some strange stations in it... which linked to some corps that where not in the crpNPCCorporations table... for instance.. 1000173 is polaris... I had to insert this into the crpNPCCorporations table to make it work... also had to insert 9 other values to make the key work
i am going to double check all of my keys before i post the sql... but that is what i found so far.
sonofabeachballbouncingmarymotherfiretrucker |
Quutar
|
Posted - 2006.05.08 17:15:00 -
[206]
is there any way in the data that the skills/level of the R&D agents can be exported?
we can now search for all the agents in a region/system/station or in corps... or in both... but we can't search for all Rocket Science R&D agents for instance.
sonofabeachballbouncingmarymotherfiretrucker |
Dr Omnitentaculion
|
Posted - 2006.05.09 14:53:00 -
[207]
Edited by: Dr Omnitentaculion on 09/05/2006 14:54:06
Originally by: Quutar is there any way in the data that the skills/level of the R&D agents can be exported?
/signed!
xls would be great :D
|
Quutar
|
Posted - 2006.05.09 17:11:00 -
[208]
ok... I tested my scripts (I wiped out my experimental DB and started over just in case)
EVE-SQL To MySQL. It is a text file saying what I did to massage the eve sql files to fit inside of MySQL... and a sql file with primary keys and foreign keys... I think I got all of them.
I also have a file with just the keys and not that annoying text file. Anybody with a sql database should be able to import these two files and see the relational structure of the DB. Can anybody vet these for me... see if I missed anything...
ISSUES/CHANGES: 0) Added the Material Activity Type based on the value of the dev blog 1) The missing table definitions (we think they are right) for stations 2) The two "UNKNOWN" data types... were they really integers? 3) Added the NPC Corporation Activity Types based on the values scrapped from the website npc corps. 4) In the dgmAttributeTypes table... what does attributeCategory index to? 5) In the dgmAttributeTypes table... what does attributeIdx index to? 6) In the dgmEffects table... what does effectCategory index to? 7) In the dgmEffects table... what do preExpression and postExpression mean? 8) Added two values to dgmAttributeTypes for the foreign key falloffAttributeID in the table dgmEffects. (0 and 1 were used, but did not exist in the attribute table) 9) Not all entities in mapDenormalize have values in the eveNames. This is not a problem, since it includes a name field. 10) In the mapLandmarks table... locationID has no values 11) In the mapSolarSystems table... allianceID has no values 12) Added 10 values to crpNPCCorporations to make the staStations foreign key corporationID work (Added Polaris and a couple other test corps it seams)
sonofabeachballbouncingmarymotherfiretrucker |
PJ Fox
|
Posted - 2006.05.09 20:03:00 -
[209]
Regarding the flags in the dbo_mapSolarSystems file:
(from my obervations)
- Border = Borders another Region or Constellation
Fringe = 1 connection to this system Corridor = 2 connections to this system Hub = 3+ connections to this system International = Regional = Constellation = Borders another constellation Security = If it is positive, rounding to nearest 1/10th gives the in-game security level. 0 or lower are 0.0 in-game. I don't know if a -1 system is worse than a 0 system.
The Fringe flag would certainly be useful for pathfinding. If an adjacent system is Fringe, then unless it is the destination you are looking for, there is no use in going down that path. I suppose with a Corridor system you could automatically skip to the next system along the corridor. Hubs would require more complex decision making. Here is an interesting article on pathfinding for anyone interested.
I have yet to figure out the significance of the other flags.
|
Somahai Visidious
|
Posted - 2006.05.12 07:45:00 -
[210]
Originally by: Quutar EVE-SQL To MySQL. It is a text file saying what I did to massage the eve sql files to fit inside of MySQL... and a sql file with primary keys and foreign keys... I think I got all of them.
The first thing needed on this new file to do is convert all of the empty commas pairs into nulls... do a global replace of: ",," to ",null"
Should be: ",," to ",null,"
Apart from that, I haven't had any other issues (yet!). Great stuff. That "annoying text file" was appreciated (certainly saved some time on my end). :)
|
|
Quutar
|
Posted - 2006.05.12 15:31:00 -
[211]
Originally by: Somahai Visidious
Originally by: Quutar EVE-SQL To MySQL. It is a text file saying what I did to massage the eve sql files to fit inside of MySQL... and a sql file with primary keys and foreign keys... I think I got all of them.
The first thing needed on this new file to do is convert all of the empty commas pairs into nulls... do a global replace of: ",," to ",null"
Should be: ",," to ",null,"
Apart from that, I haven't had any other issues (yet!). Great stuff. That "annoying text file" was appreciated (certainly saved some time on my end). :)
Thanks... I fixed that typo and have since uploaded a fixed .zip file.
sonofabeachballbouncingmarymotherfiretrucker |
Quutar
|
Posted - 2006.05.15 22:21:00 -
[212]
I have been pxloring more of the data... I found that there is some unlinked names in the eveNames table...
Here is the list of the names. The firs three are obviously some test corps that are used internally or something... but the rest seam to be NPC names... that don't show up in the Agents table... sonofabeachballbouncingmarymotherfiretrucker |
Saldun Zexu
|
Posted - 2006.05.17 16:02:00 -
[213]
I've downloaded last updates. seems CCP forgot to put CREATE TABLE (); in files: staOperations, staOperationsServices, staServices, staStations, and staStationTypes.
I'm using MySQL 5.0.21 and I imported all files successful but I don't know how to set p.key and/or f.key. I saw diagram in here but not enough.
thanks
|
Quutar
|
Posted - 2006.05.17 18:50:00 -
[214]
Originally by: Saldun Zexu I've downloaded last updates. seems CCP forgot to put CREATE TABLE (); in files: staOperations, staOperationsServices, staServices, staStations, and staStationTypes.
I'm using MySQL 5.0.21 and I imported all files successful but I don't know how to set p.key and/or f.key. I saw diagram in here but not enough.
thanks
http://utena.otakuvideo.com/~quutar/uploads/Main/EVE-SQL_To_MySQL.zip
I guess its still a work inprogress... but i posted maybe 4-5 links above you what i did to convert it to mysql sonofabeachballbouncingmarymotherfiretrucker |
Saldun Zexu
|
Posted - 2006.05.17 20:27:00 -
[215]
thanks alot :)
|
Mortecai
|
Posted - 2006.06.06 08:27:00 -
[216]
I noticed that the dbo_invTypes.sql has loads of missing baseprices for items. is it because of a buggy export or are the prices stored in another table?
|
DaOpa
|
Posted - 2006.06.06 20:21:00 -
[217]
Hmmm can anyone provide the relationships between the tables ?
Theres way to many .. and my head went boom just importing basic csv into a mdb :(
Static Corp Website |
Juno Perez
|
Posted - 2006.07.05 16:55:00 -
[218]
Edited by: Juno Perez on 05/07/2006 16:55:26
Originally by: DaOpa Hmmm can anyone provide the relationships between the tables ?
Theres way to many .. and my head went boom just importing basic csv into a mdb :(
LOL MS Access. (translation: rtft)
|
Jezra Olmerga
|
Posted - 2006.07.05 17:42:00 -
[219]
When will we get the lastest changes for agents location? Thx |
Spathi
|
Posted - 2006.07.06 05:33:00 -
[220]
Yes lots of the base prices are missing especially from items which previously had them in the old xls spreadsheet releases. I checked the battlecruisers specifically against the csv and sql releases and the previous xls I had.
|
|
Narusegawa Naru
|
Posted - 2006.07.06 11:59:00 -
[221]
Iteron productID = 650
My SQL query (this is from mySQL but is pretty generic SQL anyway). chrMinerals is a table containing my minerals, using the same typeID as minerals.
Quote:
SELECT ( SELECT typeName FROM invTypes WHERE typeID = T.requiredTypeID ) "typeName", ROUND( T.quantity * 1.10 ) "required", C.typeQuantity "gathered" FROM TL2MaterialsForTypeWithActivity T LEFT OUTER JOIN chrMinerals C ON ( T.requiredTypeID = C.typeID ) AND ( C.charID = '243976002' ) JOIN invTypes iT ON iT.typeID = T.requiredTypeID WHERE T.typeID = '650' AND T.activity = 6 ORDER BY iT.typeID;
If I use activity = 1 I get nothing.
Activity 6
Quote:
Tritanium Pyerite Mexallon Isogen Nocxium Zydrine Megacyte Industrial Construction Terran Molecular Sequencer R.A.M.- Cruiser Tech
Activity 7
Quote:
Tritanium Pyerite Mexallon Isogen Nocxium Zydrine Megacyte Criminal Connections Hacker Deck - Hermes Hyper Net Uplink
Why would 2 skill books be in there as constuction components? I'm just trying to get a list of manufacturing components of whats required to build a product.
|
Bombasy
|
Posted - 2006.07.07 19:06:00 -
[222]
Edited by: Bombasy on 07/07/2006 19:07:11
Originally by: Quutar http://utena.otakuvideo.com/~quutar/uploads/Main/EVE-SQL_To_MySQL.zip
I guess its still a work inprogress... but i posted maybe 4-5 links above you what i did to convert it to mysql
Hey Quu, here's a few sed commands for your howto: 's/CHAR([0-9]*[03-9][0-9][0-9])/TEXT/g' 's/dbo[.]//g' 's/UNKNOWN/INTEGER/g' 's/\([,(]\)[[:space:]]*\([,)]\)/\1null\2/g' -e 's/\([,(]\)[[:space:]]*\([,)]\)/\1null\2/g'
(the last one has to be done twice (thus the -e) to prevent having to fiddle around with the hold/pattern buffer and overly complicating the damn thing just to take care of 2x blank fields in a row.)
These work for translating the CHAR parts and removing the "dbo." from the tables, if CCP decides to make a 256-299 char field then the regex will have to change, but until then it works. It also converts the empties to nulls and allows for some spacing flexibility, just in case.
|
Quutar
|
Posted - 2006.07.07 20:23:00 -
[223]
you rock... thanks (i never did learn regular expressions)
I am working on a pure web based data explorer... something that won't directly compeate with the item database here on the site, nore with other specialized ones such as elfarto and the like...
just for people who are mining ice to play with during the 10 minute cycle time... to explore relationsips in the data, to see how things link.
not really "usable" but entertaining and educational in an eve sence... now i need to convince curse-gaming to host it... lucky for me I sleep with one of thier staff.
sonofabeachballbouncingmarymotherfiretrucker |
Bombasy
|
Posted - 2006.07.07 20:49:00 -
[224]
why not just upload it into a DB and custom configure a pma (phpmyadmin) install to let people just browse the data?
|
Quutar
|
Posted - 2006.07.07 20:57:00 -
[225]
i am already doing that for my self... but i wanted ti to be formated a bit easier... with the relationships between the entries more obvious...
for instance... when you click a agent, the agent page will bring up links to the corp, quality, level, faction, station, etc... each of wich would allow you to explore that relationship
when you click on a module... if you click one of the attributes, it will bring up that attribute, which as a list of all the modules that have that attribute, so you could start with a cap recharger, click the cap recharge atribute, and see a list of modules that do that, sort it, pick a cap power relay from the list, go into that view, see a linked blue print, go into that view, click a mineral, see all the bpos that use that minerals... etc
basically a relationship explorer... something for learning... not for "quick answers"
sonofabeachballbouncingmarymotherfiretrucker |
Juno Perez
|
Posted - 2006.07.07 21:06:00 -
[226]
Originally by: Quutar i am already doing that for my self... but i wanted ti to be formated a bit easier... with the relationships between the entries more obvious...
for instance... when you click a agent, the agent page will bring up links to the corp, quality, level, faction, station, etc... each of wich would allow you to explore that relationship
when you click on a module... if you click one of the attributes, it will bring up that attribute, which as a list of all the modules that have that attribute, so you could start with a cap recharger, click the cap recharge atribute, and see a list of modules that do that, sort it, pick a cap power relay from the list, go into that view, see a linked blue print, go into that view, click a mineral, see all the bpos that use that minerals... etc
basically a relationship explorer... something for learning... not for "quick answers"
O. I know a stupid easy way to do that. RoR scaffolding.
Behold, the power of cheese (the red kind): http://www.rubyonrails.org/screencasts (check out the first one (the weblog one)) You'll need: http://wiki.rubyonrails.com/rails/pages/HowToUseLegacySchemas
Basically just create the models for each of the tables, adjust the settings for the legacy schema, add the active_record key mappings and you'll have a CRUD system.
Then just override all the C/U/D methods to do diddly squat and voila (it's a lot less work than it sounds like, really).
|
Bombasy
|
Posted - 2006.07.07 21:07:00 -
[227]
mother, that was me, stupid alts.
|
Pwett
|
Posted - 2006.07.07 23:27:00 -
[228]
Originally by: Narusegawa Naru Iteron productID = 650
My SQL query (this is from mySQL but is pretty generic SQL anyway). chrMinerals is a table containing my minerals, using the same typeID as minerals.
Quote:
SELECT ( SELECT typeName FROM invTypes WHERE typeID = T.requiredTypeID ) "typeName", ROUND( T.quantity * 1.10 ) "required", C.typeQuantity "gathered" FROM TL2MaterialsForTypeWithActivity T LEFT OUTER JOIN chrMinerals C ON ( T.requiredTypeID = C.typeID ) AND ( C.charID = '243976002' ) JOIN invTypes iT ON iT.typeID = T.requiredTypeID WHERE T.typeID = '650' AND T.activity = 6 ORDER BY iT.typeID;
If I use activity = 1 I get nothing.
Activity 6
Quote:
Tritanium Pyerite Mexallon Isogen Nocxium Zydrine Megacyte Industrial Construction Terran Molecular Sequencer R.A.M.- Cruiser Tech
Activity 7
Quote:
Tritanium Pyerite Mexallon Isogen Nocxium Zydrine Megacyte Criminal Connections Hacker Deck - Hermes Hyper Net Uplink
Why would 2 skill books be in there as constuction components? I'm just trying to get a list of manufacturing components of whats required to build a product.
Naru - If the Activity ID descriptions are correct, 6 being duplicating and 7 being Reverse Engineering, then those would be the skills required to do those activites.
As far as mineral requirements, from just browsing through the tables, tech 1 items have the same numbers listed for activity 6 and 7 and they line up with expected values. I only see Activity 1 used for manufacturing (some) tech 2 items.
I guess, and this is just conjecture here, that if Activity 1 does not exist than we should just use the mineral values from Activity 6.
Is this assumption correct, or am I missing something in the tables?
|
Kuroshiro
|
Posted - 2006.07.08 05:33:00 -
[229]
Originally by: Quutar
http://utena.otakuvideo.com/~quutar/uploads/Main/EVE-SQL_To_MySQL.zip
I guess its still a work inprogress... but i posted maybe 4-5 links above you what i did to convert it to mysql
I've tried running this under mysql 4.1.20, and everything works except the foreign key creation. I keep getting this error:
ERROR 1005 (HY000) at line 65: Can't create table './adam/#sql-500b_21c2.frm' (errno: 150)
And for the life of me can't figure out what's wrong. I've set the default collation to latin1_bin after googling the relevant components of that error and still no luck. :(
Any thoughts?
|
Kuroshiro
|
Posted - 2006.07.08 05:55:00 -
[230]
Figured it out. My default storage engine is MyISAM and I had edited the huge sql file to include
SET SESSION storage_engine = InnoDB;
but didn't realize that the other two sql files to create the keys also created tables, so those were being made into MyISAM tables, which don't support foreign keys. So just an FYI for people who are using this, make sure you're using InnoDB instead of MyISAM for your storage engine. :)
|
|
Bombasy
|
Posted - 2006.07.08 14:02:00 -
[231]
I use MyISAM perfectly fine, MySQL should not choke on the foreign key constraints, it just ignores them for MyISAM. My VPS has very little memory so I actually skip-innodb, it saves me a good chunk of memory.
|
Inanna Sumer
|
Posted - 2006.07.10 11:36:00 -
[232]
Edited by: Inanna Sumer on 10/07/2006 11:38:31
Originally by: Bombasy Edited by: Bombasy on 07/07/2006 19:07:11
Originally by: Quutar http://utena.otakuvideo.com/~quutar/uploads/Main/EVE-SQL_To_MySQL.zip
I guess its still a work inprogress... but i posted maybe 4-5 links above you what i did to convert it to mysql
Hey Quu, here's a few sed commands for your howto: 's/CHAR([0-9]*[03-9][0-9][0-9])/TEXT/g' 's/dbo[.]//g' 's/UNKNOWN/INTEGER/g' 's/\([,(]\)[[:space:]]*\([,)]\)/\1null\2/g' -e 's/\([,(]\)[[:space:]]*\([,)]\)/\1null\2/g'
(the last one has to be done twice (thus the -e) to prevent having to fiddle around with the hold/pattern buffer and overly complicating the damn thing just to take care of 2x blank fields in a row.)
These work for translating the CHAR parts and removing the "dbo." from the tables, if CCP decides to make a 256-299 char field then the regex will have to change, but until then it works. It also converts the empties to nulls and allows for some spacing flexibility, just in case.
To fully "MySQLize" the CHAR's you may want to add 's/CHAR([0-9]\{1,3\})/TINYTEXT/g'
to the list of sed patterns. might also reduce storage size a bit (since text/tinytext use varchar).
edit: forgot to escape the curly braces.
|
Juno Perez
|
Posted - 2006.07.10 12:57:00 -
[233]
Originally by: Inanna Sumer Edited by: Inanna Sumer on 10/07/2006 11:38:31
Originally by: Bombasy Edited by: Bombasy on 07/07/2006 19:07:11
Originally by: Quutar http://utena.otakuvideo.com/~quutar/uploads/Main/EVE-SQL_To_MySQL.zip
I guess its still a work inprogress... but i posted maybe 4-5 links above you what i did to convert it to mysql
Hey Quu, here's a few sed commands for your howto: 's/CHAR([0-9]*[03-9][0-9][0-9])/TEXT/g' 's/dbo[.]//g' 's/UNKNOWN/INTEGER/g' 's/\([,(]\)[[:space:]]*\([,)]\)/\1null\2/g' -e 's/\([,(]\)[[:space:]]*\([,)]\)/\1null\2/g'
(the last one has to be done twice (thus the -e) to prevent having to fiddle around with the hold/pattern buffer and overly complicating the damn thing just to take care of 2x blank fields in a row.)
These work for translating the CHAR parts and removing the "dbo." from the tables, if CCP decides to make a 256-299 char field then the regex will have to change, but until then it works. It also converts the empties to nulls and allows for some spacing flexibility, just in case.
To fully "MySQLize" the CHAR's you may want to add 's/CHAR([0-9]\{1,3\})/TINYTEXT/g'
to the list of sed patterns. might also reduce storage size a bit (since text/tinytext use varchar).
edit: forgot to escape the curly braces.
I had so forgotten about escaping the curlies, that's why I went with 2x [0-9]'s instead of [0-9]{2}.
|
Larshus Magrus
|
Posted - 2006.07.10 14:27:00 -
[234]
I just had to manage the data into mysql for a project im tinkering with.
I completely forgot how craptastic M$Sql is. What a fing mess. It violates so many ansi conventions.. well lets just put it this way... I'm sure the only thing holding that db running over there is ducktape and twine at this point.
|
Bombasy
|
Posted - 2006.07.10 18:56:00 -
[235]
Originally by: Larshus Magrus I just had to manage the data into mysql for a project im tinkering with.
I completely forgot how craptastic M$Sql is. What a fing mess. It violates so many ansi conventions.. well lets just put it this way... I'm sure the only thing holding that db running over there is ducktape and twine at this point.
Unfounded and plain wrong anti-MS zealotry is just silly my friend.
They're both different they both follow the standard rather closely, they both break the ANSI standard. Have a nice day.
And omg they both pass the ACID test.
This is my source: http://troels.arvin.dk/db/rdbms/ .
And (if it isn't obvious enough from my previous post) I am most definitely not a pro-MS zealot.
Mods feel free to mod me and the post above, we deserve it. =P
|
Meccano
|
Posted - 2006.07.11 19:00:00 -
[236]
I've been banging my head against these csv file for a few days now... can any recomend a program that will actually open it without all the descriptions messing up the rows?
Or can give some clue (other then find and replace is my friend... find and replace is not my friend.. it hates me) as to how to open these properly in excel?
|
Zarksis
|
Posted - 2006.07.12 04:57:00 -
[237]
I'm a professional (i.e. I get paid to do this work) database developer for SQL Server. Doesn't seem to be such a difficult task, except for possibly mis-construed data.
I can build all the relationships too; and then provide the .mdf and .ldf (for SQL Server). All one would have to do is in SQL Server Express (free) and attach the database files. Done.
The rest is up to you, but build UDFs (Functions) that can calculate the total materials for BPOs, etc.
Or has someone beaten me to it? :P
|
Roffer
|
Posted - 2006.07.12 05:36:00 -
[238]
Edited by: Roffer on 12/07/2006 05:37:09
Originally by: Meccano I've been banging my head against these csv file for a few days now... can any recomend a program that will actually open it without all the descriptions messing up the rows?
Change the csv file extension to ".txt", then open that file as a text file in Excel. In the import wizard, choose "Delimited", then Next, set the Delimiter to semicolon (only), then Next, then click the Advanced button, and set the decimal separator to "," and the thousands separator to "."
Then hit Finish, and the data should load properly.
|
Femaref
Caldari
|
Posted - 2006.07.23 14:32:00 -
[239]
Can it be that the Mineralrequiments (chrMinerals.sql) are missing? I can't find them in the rar.
|
Eewec Ourbyni
Caldari
|
Posted - 2006.07.23 18:16:00 -
[240]
Quote: CREATE TABLE dbo.agtConfig( agentID INTEGER, k CHAR(50), v CHAR(4000));
Err, correct me if I'm wrong but shouldn't that be:
Quote: CREATE TABLE dbo.agtConfig( agentID INTEGER, k CHAR(50), v CHAR(4));
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
|
Eewec Ourbyni
Caldari
|
Posted - 2006.07.24 20:40:00 -
[241]
Edited by: Eewec Ourbyni on 24/07/2006 20:41:47
Originally by: Quutar I have been pxloring more of the data... I found that there is some unlinked names in the eveNames table...
Here is the list of the names. The firs three are obviously some test corps that are used internally or something... but the rest seam to be NPC names... that don't show up in the Agents table...
I'd bet that lot contains at least some of the leaders that should have been linked in crpNPCCorporationDivisions, but got overruled by their best agent instead.... Question is who feels like goinging through the crpNPCCorporationDivisions table and checking/correcting that lot?
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
Femaref
Caldari
|
Posted - 2006.07.26 16:13:00 -
[242]
could you give me a wink where the Mineralprices for the bpos are?
|
Lufio II
Amarr
|
Posted - 2006.07.26 16:30:00 -
[243]
The mineral needs for BPOs are in data_misc I think, but you'll have to do a bit of importing into a database and fire some sort of SQL-Statement that joins all the necessary data together...
|
Isip
|
Posted - 2006.07.26 16:47:00 -
[244]
Originally by: Narusegawa Naru Iteron productID = 650
My SQL query (this is from mySQL but is pretty generic SQL anyway). chrMinerals is a table containing my minerals, using the same typeID as minerals.
Quote:
SELECT ( SELECT typeName FROM invTypes WHERE typeID = T.requiredTypeID ) "typeName", ROUND( T.quantity * 1.10 ) "required", C.typeQuantity "gathered" FROM TL2MaterialsForTypeWithActivity T LEFT OUTER JOIN chrMinerals C ON ( T.requiredTypeID = C.typeID ) AND ( C.charID = '243976002' ) JOIN invTypes iT ON iT.typeID = T.requiredTypeID WHERE T.typeID = '650' AND T.activity = 6 ORDER BY iT.typeID;
If I use activity = 1 I get nothing.
Activity 6
Quote:
Tritanium Pyerite Mexallon Isogen Nocxium Zydrine Megacyte Industrial Construction Terran Molecular Sequencer R.A.M.- Cruiser Tech
Activity 7
Quote:
Tritanium Pyerite Mexallon Isogen Nocxium Zydrine Megacyte Criminal Connections Hacker Deck - Hermes Hyper Net Uplink
Why would 2 skill books be in there as constuction components? I'm just trying to get a list of manufacturing components of whats required to build a product.
The trick is to look at the Iteron BPO not the Iteron itself. If you pull up activity 1 on the Iteron BPO it should give you the contruction requirements.
|
Femaref
Caldari
|
Posted - 2006.07.26 16:55:00 -
[245]
Edited by: Femaref on 26/07/2006 17:01:04 Lufio, thats allready done. I mean in which table ;). I Can't find them.
EDIT: Whoops, oh ok. I think I figured it out now :)
|
Lufio II
Amarr
|
Posted - 2006.07.26 17:00:00 -
[246]
Would have to look into that, I'm not really up to date with the RMR Data Export, sadly (something I will change pretty soon, tho). But the quote above you looks good :)
|
Femaref
Caldari
|
Posted - 2006.07.26 17:02:00 -
[247]
To quote myself:
Originally by: Femaref
EDIT: Whoops, oh ok. I think I figured it out now :)
|
Eewec Ourbyni
Caldari
|
Posted - 2006.07.27 18:48:00 -
[248]
Edited by: Eewec Ourbyni on 27/07/2006 18:49:08
Originally by: Lufio II Would have to look into that, I'm not really up to date with the RMR Data Export, sadly (something I will change pretty soon, tho). But the quote above you looks good :)
Heh... don't sweat it... the RMR data isn't really all that accurate anywho. To many patches and stuff since it was dropped without any corresponding updates to the data there.
Having almost finished making all the tables and stuff on my SQL server, I'm actually going wait for the next dump (please....pwetty peas ) or if there is no news of that happening (a hint if/when your likely to do another t20?) then we need to get orgainsed and do a data clean so that anything we use this stuff for can be accurate.
...pity the person who gets 'dgmTypeAttributes' and 'eveNames' to clean...
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
Caedicus
|
Posted - 2006.07.28 16:52:00 -
[249]
Are the base amounts of processed minerals produced by each type of unrefined ore stored in one of these files? I'm having trouble finding it.
"An eye for an eye makes the whole world blind." -Ghandi |
Eewec Ourbyni
Caldari
|
Posted - 2006.07.30 10:29:00 -
[250]
Edited by: Eewec Ourbyni on 30/07/2006 10:33:02 OK, so here's my .png image of the relationships in the EVE RMR files.
It's missing the map tables, so the following are not linked in:
chrFactions.solarSystemID crpNPCCorporations.solarSystemID staStations.solarSystemID staStations.constellationID staStations.regionID
some foreign keys that also aren't linked
chrFactions.raceIDs = bit mask NOT index. crpNPCCorporations.size = H/L/M/S/T ...which means? crpNPCCorporations.extent = G/N/R/C/L ...which means? dgmAttributeTypes.attributeCategory dgmAttributeTypes.attributeidx dgmEffects.effectCategory dgmEffects.preExpression dgmEffects.postExpression dgmTypeAttributes.typeID// <----- two words for you: "Company Shares" dgmTypeAttributes.valueFloat // <----- contains some Large Integer numbers dgmTypeEffects.typeID// <----- see above for TypeAttributes eveGraphics.explosionID
Keep a look out for null value foreign keys... there are lots about.
If anyone finds anything on there that needs correcting, please post here, once I've got the map tables key'd and indexed I'll put up a new version with them on, and then I'll set about getting some sort of create table sql thing up that'll make index and link all the various tables so all that's left is adding the actual data to it (after parsing the dl'd files anywho.)
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
|
Eewec Ourbyni
Caldari
|
Posted - 2006.07.31 17:01:00 -
[251]
Edited by: Eewec Ourbyni on 31/07/2006 17:05:19 Went through and did some checking:
CharID,Character Name (CEO),Corp Name,CorpID, 3003869,Pamoo Meninri,Amarr Certified News,1000073, 3003873,Badji Bihabnir,Amarr Civil Service,1000079, 3003877,Saronu Seevath,Imperial Constructions,1000063, 3003881,Kezti Sundara,Imperial Navy,1000084, 3003885,Evian Talmash,Imperial Trade Registry,1000083, 3003889,Yonis Ardishapur,Ardishapur Family,1000090, 3003893,Tarai Nakid,Carthum Conglomerate,1000064, 3003897,Hasin Sokra,Civic Court,1000092, 3003901,Dochuta Karsoth,Court Chamerlain,1000085, 3003905,Sasih Ghamak,Ducia Foundry,1000069, 3003909,Doriam KorAzor,Emperor Family,1000086, 3003913,Zon Mada,Further Foodstuffs,1000076, 3003917,Resaphu Ziostoo,HZO Refinery,1000070, 3003921,Enam Sahdop,Hedion University,1000165, 3003925,Mierisi Ratmoh,Imperial Academy,1000166, 3003929,Kefsooda Arkih,Imperial Armaments,1000065, 3003933,Serude Sakekoo,Imperial Chancellor,1000078, 3003937,Nasub Iphanas,Imperial Shipment,1000072, 3003941,Hafa Zambana,Inherent Implants,1000071, 3003945,Mimian Mimian,Joint Harvesting,1000074, 3003949,Uriam Kador,Kador Family,1000087, 3003953,Articio KorAzor,Kor-Azor Family,1000089, 3003957,Uadelah Hadizes,Ministry of Assessment,1000081, 3003961,Sin Callor,Ministry of Internal Order,1000082, 3003965,Perimum Amyn,Ministry of War,1000080, 3003969,Sadmur Cirshan,Noble Appliances,1000068, 3003973,Murata Farorad,Nurtura,1000075, 3003977,Yihihnin Ethour,Royal Amarr Institute,1000077, 3003981,Jamyl Sarum,Sarum Family,1000088, 3003985,Catiz TashMurkon,Tash-Murkon Family,1000091, 3003989,Mervan Moritok,Theology Council,1000093, 3003993,Arer Bazargal,Viziam,1000066, 3003997,Ardamad Zoar,Zoar & Sons,1000067, 3004001,Anfrid Uptemulf,Ammatar Consulate,1000126, 3004005,Einkur Aro,Ammatar Fleet,1000123, 3004009,Adarlur Annuger,Nefantar Mining Association,1000154, 3004013,Tabe Rajus,Archangels,1000124, 3004017,Trald Vukenda,Dominations,1000138, 3004021,Khaitetha Meramad,Guardian Angels,1000136, 3004025,Avelor Odareque,Salvation Angels,1000133, 3004029,Omir Sarikusa,Blood Raiders,1000134, 3004033,Panaja Paukonsuo,Concord,1000125, 3004037,Kjersidur Elladall,DED,1000137, 3004041,Irhes Angireh,Innercircle,1000143, 3004045,Eman Autrech,Secure Commerce Commission,1000132,
(This is only some of the data needed...)
Anyway... it's dawned on me that the division leader isn't the CEO... neither in all cases is it the best agent in that field. Also I've discovered that the divisions as listed in the data drop are not accurate. Looking at corp 1000073 for example there are five listed, none of which is 'security' but corp 1000073 does actually have a security agent. Anywho, now I've started on this I'll finish making the Corp CEO links... It'll need a new table as I don't really like adding new fields to the dump data and this isn't in anywhere (should of been in the 'crpNPCCorporations' table as something like 'ceoID') I'll just make a new table and post up an sql file for the relevant data and links.
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
Nomispanco
Minmatar
|
Posted - 2006.08.01 22:03:00 -
[252]
Hi all. I'd like to ask if anyone of you managed to get the urls to the bitmaps, like in the itemdatabase on E-O, out of this data? i've seen that some entries in the invTypes table do have an icon property but i cannot find them for the Tempest or any other ship. And if i could find it i wouldnt know if the pic is in the black or shiptypes folders. Did someone find the trick?
thx and regards Nomi
|
Shawn Miller
|
Posted - 2006.08.02 09:12:00 -
[253]
I just downloaded all this data. I would like to use some of it to build a website. How do I know what goes where. I'm new to sql. I understand that this is probably a big task for someone like me to tackle but still I would like to give it a try. Take for instance all the images used are named with numbers. How is it that I use the data to figure out what is what?
|
Eewec Ourbyni
Caldari
|
Posted - 2006.08.02 12:08:00 -
[254]
Originally by: Nomispanco Hi all. I'd like to ask if anyone of you managed to get the urls to the bitmaps, like in the itemdatabase on E-O, out of this data? i've seen that some entries in the invTypes table do have an icon property but i cannot find them for the Tempest or any other ship. And if i could find it i wouldnt know if the pic is in the black or shiptypes folders. Did someone find the trick?
thx and regards Nomi
Originally by: Shawn Miller I just downloaded all this data. I would like to use some of it to build a website. How do I know what goes where. I'm new to sql. I understand that this is probably a big task for someone like me to tackle but still I would like to give it a try. Take for instance all the images used are named with numbers. How is it that I use the data to figure out what is what?
First to your common query, I have as yet to take a good look at the eveGraphics table (probably why I didn't notice 'explosionID' is a self reference to 'graphicID') but have got it on my 'things to look at' list as one of my aims with getting all this data up in an SQL database was to get the ship and module icons linked up to the relevant ships and modules.
On to your query Shawn... most of us have taken an educated guess as to what links where. I have linked up a few pics above, and once I've got mapDenormalise all linked up I'll post a fresh '.png' along with some text about what isn't there and probably a table schema for all the links and stuff.
Always good to populate (stick all the info in) your tables before making the links on the tables as some of the tables are self referencing and need to have data added in the right order if the indexs and links are already there. I discovered this the hard way.
Also, before making the database, have a good look at this thread and also at the '.sql' files you have, you'll be getting to know some of them rather well but it pays to know what your looking at before deciding what your going to do with it.
Some of the sql files are rather... long to put it mildly. This can cause issues. I had to break some of the files down to 100000 line chunks, some you can make bigger, some you can't. My advice is save the sections with relevant names so you can check what's what if something goes wrong.
Anyway, hope this helps and happy database fiddling.
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
Packet Loss
Minmatar Rampage Eternal
|
Posted - 2006.08.06 22:08:00 -
[255]
Hey guys/gals,
I have a couple of questions relating to the data export which I'm hoping some of my fellow pod pilots can assist with. I apologise if these questions are repeated but I have tried to find previous postings on them without success.
1. Missing drone images
I'm working on a killboard that parses the killmail and searches for the item name in invTypes, the graphicID field is being JOIN'd to the applicable record in eveGraphics and then I'm getting back the appropriate iconXX_YY.png filename to display for that item.
Unfortunately it appears none of the drones have a value in the icon field and thus I am unable to identify the correct iconXX_YY (or are these images even included in the latest icon librarys). There's the obvious manual fix for this but I'm hoping there's something I am missing?
I notice that this is even broken on the EVE-O Item Database in that when you display the T1 drone it's T2 variant's image is also broken, it produce exactly the same a href line my code does since it's unable to identify the icon number.
2. Generating EVE unvierse maps highlighting systems.
I've noticed a couple of killboards using some java script to generate an image of the EVE universe map highlighting systems in which the kill's were made.
I'd like to use this mechanism for some of my tools but have been unable to find any pointers on how this can be done, any help much appreciated.
Thanks in advance, Packet
|
Raquel Smith
Freedom-Technologies
|
Posted - 2006.08.06 23:10:00 -
[256]
Is there an interest in a Postgres (8.1.x) migration guide or even just a mammoth .sql file to \i from psql? I've been working on one based on Quutar's comments in post #205 on page seven. Right now the .sql file is 18 MB gzipped.
I'm hoping this SQL set could make a good Rails learner.
|
Ynno
|
Posted - 2006.08.07 00:48:00 -
[257]
Originally by: Packet Loss 1. Missing drone images
I'm working on a killboard that parses the killmail and searches for the item name in invTypes, the graphicID field is being JOIN'd to the applicable record in eveGraphics and then I'm getting back the appropriate iconXX_YY.png filename to display for that item.
Unfortunately it appears none of the drones have a value in the icon field and thus I am unable to identify the correct iconXX_YY (or are these images even included in the latest icon librarys). There's the obvious manual fix for this but I'm hoping there's something I am missing?
Drone images are is a seperate archive called img_dronetypes.rar, and the image names are just <typeID>.png, so it's even less work than other items. Same thing for ships as img_shiptypes.rar.
Originally by: Packet Loss 2. Generating EVE unvierse maps highlighting systems.
I've noticed a couple of killboards using some java script to generate an image of the EVE universe map highlighting systems in which the kill's were made.
I'd like to use this mechanism for some of my tools but have been unable to find any pointers on how this can be done, any help much appreciated.
Are you sure they were using javascript? The ones I have seen do it and the way I am doing it is to plot the entire map server-side including highlighting.
|
Renfrew Shrufan
Minmatar Republic Military School
|
Posted - 2006.08.07 02:11:00 -
[258]
Originally by: Packet Loss
2. Generating EVE unvierse maps highlighting systems.
I've noticed a couple of killboards using some java script to generate an image of the EVE universe map highlighting systems in which the kill's were made.
I'd like to use this mechanism for some of my tools but have been unable to find any pointers on how this can be done, any help much appreciated.
Ew, not JavaScript (I hope), but you will need at least a table or two from the database to auto parse the kill mails. See the IGB Commands. Specifically the ones for the 'Eve Map'ping part.
|
Packet Loss
Minmatar Rampage Eternal
|
Posted - 2006.08.07 07:09:00 -
[259]
Ok thanks for the feedback!
Ynno, I knew I was missing something and now have my drone images based on the invTypes.typeID. I then of course had a similar issue with blueprints and without a simple way to identify the true type of the object (drone/bp/etc.) I dumped all the BP images (only available in 64x64) into the same folder as the drone images and used the same typeID method.
NOTE: The EVE-O team still need to fix this in the Item Database here :)
Ok I'm new to rendering images and am very happy if I don't have to touch Java (washing mouth out with soap).
I understand I will need to render this image server side (it's not for the IGB remember) and will look into the tables today to figure out that would be done based on that data but any tips in the meantime would be much appreciated.
|
Ynno
|
Posted - 2006.08.07 10:48:00 -
[260]
Edited by: Ynno on 07/08/2006 10:49:26 Edited by: Ynno on 07/08/2006 10:48:26
Originally by: Packet Loss Ok I'm new to rendering images and am very happy if I don't have to touch Java (washing mouth out with soap).
I understand I will need to render this image server side (it's not for the IGB remember) and will look into the tables today to figure out that would be done based on that data but any tips in the meantime would be much appreciated.
Basically what you need to do is get the coordinates of all the systems from the constellation/region/universe (in this example constellation) with a query like:
select s.solarSystemName, s.x, s.z from mapSolarSystems as s, mapConstellations as c where s.constellationID = c.constellationID and c.constellationName = 'Ortner'
(In the database what were would think of as the y-axis is actually the z-axis)
That gives me: +-----------------+-----------------------+-----------------------+ | solarSystemName | x | z | +-----------------+-----------------------+-----------------------+ | Hulm | -8.68416973876787e+16 | -3.0503349623728e+15 | | Osoggur | -1.19198464346739e+17 | 183855711628938 | | Abudban | -1.07534933500286e+17 | -583532325443579 | | Trytedald | -9.42913103547792e+16 | 1.08455471398144e+16 | | Odatrik | -9.88716571550024e+16 | 1.40362956832075e+16 | | Rens | -9.91223410909671e+16 | 2.86772881958385e+15 | | Ameinaka | -8.56875728236928e+16 | -7.47763282842871e+15 | +-----------------+-----------------------+-----------------------+
Then you need to find the lowest and greatest values for x and z, so you can work out the width and height of the area covered (I think this is also probably in xMin, xMax, zMin and zMax in the database, but I don't use them). With these values the width and height are -8.56875728236928e+16 - -1.19198464346739e+17 and 1.40362956832075e+16 - -7.47763282842871e+15 respectively which give 33510891523046200 and 21513928511636210.
With those you can work out the scale of the image by dividing the width of the image by the width of the constellation and the height of the image by the height of the constellation. Although it's a good idea to have an area around the enge of the map in which you don't draw otherwise it looks strange, so it is the width/height of the image - border size * 2. Which ever number is lower (which will obviously be the number resulting from dividing by the greater of width and height) should be the scale of the image if you want to maintain the correct aspect ratio (otherwise you can have a separate scale for width and height). In this case it will be a 250x250 pixel image with a 10px border and the scale comes out at 0.00000000000000686344.
Now it's a simple matter of drawing the image. The position of each system in pixel is scale * (system_x - lowest_x) + border on the x-axis and scale * (system_z - lowest_z) + border on the y-axis.
So, for example, Abudban at -1.07534933500286e+17, -583532325443579 will be placed on the image at 90, 57 after rounding the numbers off.
On my killboard I use PHP and do this with the GD library (http://www.php.net/manual/en/ref.image.php) if you want to read more, but this method is pretty generic and so should work for whatever language you are using. Obviously to do highlighting all you have to do is draw the highlighted systems in a different colour. In addition if you are maintaining aspect ration on dimension of the constellation/region/universe will probably be less the the other, so you might want to change the positions on that axis to centre the map.
|
|
Biltic Creen
|
Posted - 2006.08.07 11:13:00 -
[261]
Anybody got a dataexport where most of the T1 baseprices aren't missing? If so i'd be happy to get a copy. ______________________________
This post is not my personal opinion. It does represent the standpoint of every single eve-player. |
Packet Loss
Minmatar Rampage Eternal
|
Posted - 2006.08.07 11:26:00 -
[262]
Ynno, thanks again.
I've been looking at this all morning and have reached the same conclusions you posted so its nice to get confirmation.
I am overlaying the dots onto the universe image from the data_map archive at the moment. I too am using PHP and GD, so far I've got the basics working but I'm struggling a bit with the maths.
So far so good ...
|
Rikkard Strofeldt
Gallente SniggWaffe
|
Posted - 2006.08.07 12:05:00 -
[263]
I have the SQL for PostgreSQL. Had to mess around with it a bit, I'm using a UTF-8 system, and I'm assuming the dump was made in Win1252. Also had to screw with the reserved words as column names, and some of the field types.
I might create a project on a sourceforge-style site and upload my dump there. Was going to do this ages ago, but I was always playing when I wasn't sharing the net connection. Oh well. I'll either update this post with a URL, or add another reply. --
Descending into madness. |
Packet Loss
Minmatar Rampage Eternal
|
Posted - 2006.08.07 12:22:00 -
[264]
Ynno, ok now I'm really losing my mind on this.
It doesn't matter what I do I just can't seem to get the scaling to work properly. I'm using your scaling (250x250 with 10px border) but I can't seem to get the same values you posted.
Is there any chance you could post your PHP code for the float to x/y conversion?
|
Ynno
|
Posted - 2006.08.07 13:01:00 -
[265]
Well you don't need to convert the floating point numbers to integers with PHP and GD, I just mentioned rounding because I didn't know what platform you were working with at the time. I don't know exactly where you are having a problem, does
echo 0.00000000000000686344 * ( -1.07534933500286e+17 - -1.19198464346739e+17 ) + 10;
not print 90.051944152779441310485708527266979217529296875 for you?
The exact code I am using to plot a system in a constellation is: imagefilledellipse ( $im, $scale * ( $coords[0] - $xmin ) + $border + $xoffset, $scale * ( $coords[1] - $ymin ) + $border + $yoffset, 4, 4, $name == $highlight ? $white : $grey );
The $xoffset and $yoffset are for centring the narrowest axis as I mentioned at the bottom of my last post. $coords[0] and $coords[1] contain the x and z values unaltered from the database (that is still in exponential notation for most numbers). $xmin and $ymin contain the smallest values of x and z also in the same format as they are stored in the DB.
|
Packet Loss
Minmatar Rampage Eternal
|
Posted - 2006.08.07 13:53:00 -
[266]
Edited by: Packet Loss on 07/08/2006 13:53:11
Originally by: Ynno Well you don't need to convert the floating point numbers to integers with PHP and GD, I just mentioned rounding because I didn't know what platform you were working with at the time. I don't know exactly where you are having a problem, does
My first issue was I was converting the integers and not only losing precision but confusing myself in the process.
Originally by: Ynno
echo 0.00000000000000686344 * ( -1.07534933500286e+17 - -1.19198464346739e+17 ) + 10;
not print 90.051944152779441310485708527266979217529296875 for you?
It does print the same value.
Originally by: Ynno
The exact code I am using to plot a system in a constellation is: imagefilledellipse ( $im, $scale * ( $coords[0] - $xmin ) + $border + $xoffset, $scale * ( $coords[1] - $ymin ) + $border + $yoffset, 4, 4, $name == $highlight ? $white : $grey );
The $xoffset and $yoffset are for centring the narrowest axis as I mentioned at the bottom of my last post. $coords[0] and $coords[1] contain the x and z values unaltered from the database (that is still in exponential notation for most numbers). $xmin and $ymin contain the smallest values of x and z also in the same format as they are stored in the DB.
My problem seems to be the xmin/ymin values, how are you calculating these values exactly?
|
Ynno
|
Posted - 2006.08.07 14:06:00 -
[267]
Edited by: Ynno on 07/08/2006 14:07:31 $xmin and $ymin are the smallest values of the x and z values of all the systems.
For example if I have 3 systems at the made up coordinates (23, 31), (13, 63), (54, 9) then xmin will be 13 (as it is the smallest x value) and ymin will be 9 (as it is the smallest z value - although I called it ymin as I find it less confusing that way).
|
Packet Loss
Minmatar Rampage Eternal
|
Posted - 2006.08.07 16:04:00 -
[268]
Edited by: Packet Loss on 07/08/2006 16:09:12
Originally by: Ynno Edited by: Ynno on 07/08/2006 14:07:31 $xmin and $ymin are the smallest values of the x and z values of all the systems.
For example if I have 3 systems at the made up coordinates (23, 31), (13, 63), (54, 9) then xmin will be 13 (as it is the smallest x value) and ymin will be 9 (as it is the smallest z value - although I called it ymin as I find it less confusing that way).
Ok I'm getting different figures then because your only drawing a constellation and I'm trying to do the entire eve universe.
$xmin = (SELECT * FROM `mapSolarSystems` ORDER BY `x` ASC LIMIT 0,1) $ymin = (SELECT * FROM `mapSolarSystems` ORDER BY `z` ASC LIMIT 0,1)
Thus my values are much higher in both directions, let me try this out and come back to you.
|
Ynno
|
Posted - 2006.08.07 16:53:00 -
[269]
The method works with any number of systems. I use it for drawing constellations, regions and the entire universe. Remember you'll also need the maximum x and z values as well to calculate the scale.
|
Packet Loss
Minmatar Rampage Eternal
|
Posted - 2006.08.07 19:23:00 -
[270]
It never ceases to amaze me that something so simple appears so complicated upon first glance :)
I have everything working perfectly now and am generating perfect overlays, many thanks for your assistance.
|
|
Raquel Smith
Freedom-Technologies
|
Posted - 2006.08.09 12:54:00 -
[271]
Originally by: Rikkard Strofeldt Edited by: Rikkard Strofeldt on 07/08/2006 12:20:03 I have the SQL for PostgreSQL. Had to mess around with it a bit, I'm using a UTF-8 system, and I'm assuming the dump was made in Win1252. Also had to screw with the reserved words as column names, and some of the field types.
I created a project on a berlios.de site and will upload my dump there after it is approved. Was going to do this ages ago, but I was always playing when I wasn't sharing the net connection. Oh well. I'll either update this post with a URL, or add another reply.
If anyone is interested in putting their dumps up here as well, join up, and when its there I can add you to the project. You don't need to join if you're just going to download the dumps.
Was your project approved?
|
Cail Fortestan
M. Corp Lotka Volterra
|
Posted - 2006.08.11 21:14:00 -
[272]
I have the mapDenormalize data loaded, and have split out the stations into another table.
I have added new lines to the table for the new outposts based on the similar data taken from the plent they orbit, but of course I don't have the itemID. Any ideas how to find this out ? -- M. Corp.
|
Eewec Ourbyni
Caldari
|
Posted - 2006.08.13 20:27:00 -
[273]
Edited by: Eewec Ourbyni on 13/08/2006 20:27:27
Originally by: Cail Fortestan I have the mapDenormalize data loaded, and have split out the stations into another table.
I have added new lines to the table for the new outposts based on the similar data taken from the plent they orbit, but of course I don't have the itemID. Any ideas how to find this out ?
If they are not already in the mapDenormalize table or the staStations table then so long as your consistent then your only worry is sorting out the ensueing mess when t20 does a new datadump if you give them unique id's all your own. This said, looking at this dump, we'll probably need to do a fairly major cleanup op when any new datadump is done anyway due to the inital teething issues with this dump and how they were fixed.
Also, further to past posts:
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
Yeggstry
Syncore Ascendant Frontier
|
Posted - 2006.08.18 12:55:00 -
[274]
Can someone explain to me how to diferentiate between the blueprints that are seeded and the ones that aren't? I'm trying to figure out which are seeded but the published and marketGroupID columns in the invTypes table aren't consistent (I've browsed it in phpMyAdmin and didn't find anything useful).
Thanks in advance.
|
Biltic Creen
|
Posted - 2006.08.18 15:35:00 -
[275]
FINALY i'm able to plot the system ;)
Now could somebody please give me a hint how you draw the "connection", meaning the routes between the systems ?
This post is not my personal opinion. It does represent the standpoint of every single player ! |
Zie Nyesa
Splintered Shards of Europe
|
Posted - 2006.08.18 19:07:00 -
[276]
Edited by: Zie Nyesa on 18/08/2006 19:09:36 Im trying to import the data to MySQL 5.0
Someone linked to MySQL and the LOAD DATA INFILE command. My problem is that the LOAD DATA INFILE command generates alot of warnings:
mysql> SHOW WARNINGS; +---------+------+-----------------------------------------------------------+ | Level | Code | Message | +---------+------+-----------------------------------------------------------+ | Warning | 1264 | Out of range value adjusted for column 'typeID' at row 1 | | Warning | 1261 | Row 1 doesn't contain data for all columns | | Warning | 1261 | Row 1 doesn't contain data for all columns | | Warning | 1261 | Row 1 doesn't contain data for all columns | | Warning | 1264 | Out of range value adjusted for column 'typeID' at row 2 | | Warning | 1261 | Row 2 doesn't contain data for all columns | | Warning | 1261 | Row 2 doesn't contain data for all columns | | Warning | 1261 | Row 2 doesn't contain data for all columns |
When I use the usual INSERT everything works fine with the same .sql-file. The reason I want to use LOAD DATA INFILE and not the usual INSERT is the speed, it would take several hours using INSERT.
So why do I get a huge amount of warnings and a table filled with zeros and NULL's when using LOAD DATA INFILE and no problems at all when using regular INSERT?
I just got an idea, maybe Im not supposed to send the sql-files to the LOAD DATA INFILE command, if not, what file format should I be sending?
|
Adam Coyle
|
Posted - 2006.08.19 14:12:00 -
[277]
Hello
I could use some help with a query I am writing. I need to list all planets that are habitable and have stations orbiting them.
I have already started a thread about this here: http://oldforums.eveonline.com/?a=topic&threadID=381149
I need this for an idea I have how to change the npc market ordering generation.
|
Bluecrab M1
|
Posted - 2006.08.20 19:24:00 -
[278]
Originally by: Zie Nyesa Edited by: Zie Nyesa on 18/08/2006 19:17:43 Edited by: Zie Nyesa on 18/08/2006 19:09:36 Im trying to import the data to MySQL 5.0
Someone linked to MySQL and the LOAD DATA INFILE command. My problem is that the LOAD DATA INFILE command generates alot of warnings:
mysql> SHOW WARNINGS; +---------+------+-----------------------------------------------------------+ | Level | Code | Message | +---------+------+-----------------------------------------------------------+ | Warning | 1264 | Out of range value adjusted for column 'typeID' at row 1 | | Warning | 1261 | Row 1 doesn't contain data for all columns | | Warning | 1261 | Row 1 doesn't contain data for all columns | | Warning | 1261 | Row 1 doesn't contain data for all columns | | Warning | 1264 | Out of range value adjusted for column 'typeID' at row 2 | | Warning | 1261 | Row 2 doesn't contain data for all columns | | Warning | 1261 | Row 2 doesn't contain data for all columns | | Warning | 1261 | Row 2 doesn't contain data for all columns |
When I use the usual INSERT everything works fine with the same .sql-file. The reason I want to use LOAD DATA INFILE and not the usual INSERT is the speed, it would take several hours using INSERT.
So why do I get a huge amount of warnings and a table filled with zeros and NULL's when using LOAD DATA INFILE and no problems at all when using regular INSERT?
I just got an idea, maybe Im not supposed to send the sql-files to the LOAD DATA INFILE command, if not, what file format should I be sending?
EDIT: I just found this:
Quote:
Warnings occur under the same circumstances as when values are inserted via the INSERT statement (see Section 13.2.4, ôINSERT Syntaxö), except that LOAD DATA INFILE also generates warnings when there are too few or too many fields in the input row.
But what does it mean? I started with MySQL one week ago and this is advanced...
|
Ynno
|
Posted - 2006.08.20 21:14:00 -
[279]
Edited by: Ynno on 20/08/2006 21:14:45
Originally by: Biltic Creen FINALY i'm able to plot the system ;)
Now could somebody please give me a hint how you draw the "connection", meaning the routes between the systems ?
You just need to get the list of routes from mapSolarSystemJumps or whatever and get the coordinates for the two systems in each jump, then draw a line between them. If you are using PHP/GD it would be something like:
imageline ( $image, $system1_x, $system1_z, $system2_x, $system2_z, $color );
If you read my previous posts then using the way of plotting I was talking about previously it's something like:
imageline ( $im, $scale * ( $systems[$jump[0]][0] - $xmin ) + $border + $xoffset, $scale * ( $systems[$jump[0]][1] - $ymin ) + $border + $yoffset, $scale * ( $systems[$jump[1]][0] - $xmin ) + $border + $xoffset, $scale * ( $systems[$jump[1]][1] - $ymin ) + $border + $yoffset, $blue );
|
Narusegawa Naru
Gallente The Underground
|
Posted - 2006.08.21 14:28:00 -
[280]
Has anyone got a MSSQL 2000 export of this? I've tried to import it but get a ton of errors.
Loads of ,) in there, and ,,. Not to mention DOUBLE which isnt support, and PRECISION.
I've got this imported into MySQL but would like to get it into MSSQL as well.
|
|
Raquel Smith
Freedom-Technologies
|
Posted - 2006.08.23 09:52:00 -
[281]
With this latest patch I wonder if there will be another dump for us. I seem to recall the devs had to rearrange the database and it would be nice to have a sane dump.
|
Cybu
Caldari Wasteland Industries Chimaera Pact
|
Posted - 2006.08.24 16:11:00 -
[282]
How come close to every single item type have a "basePrice" of 0? I've seen others fetching the basePrice from the export.
|
Isip
|
Posted - 2006.08.25 02:55:00 -
[283]
So when do we get a new data dump that includes the new solar system information introduced with the Dragon code patch?
|
Torlack
|
Posted - 2006.08.25 12:53:00 -
[284]
Bump.
I would also love to have a new dump when T20 has time. :)
|
Dal Rath
|
Posted - 2006.08.25 18:40:00 -
[285]
mysql> select count(distinct typeID) from TL2MaterialsForTypeWithActivity where quantity < 0; +------------------------+ | count(distinct typeID) | +------------------------+ | 115 | +------------------------+ 1 row in set (0.04 sec)
Blueprints that allow you to build stuff with negative quantities of materials ftw. Or maybe it's just a problem with the data export?
Dal.
P.S. a download with the recycling quantities would be nice too, although for the most part you can just use the duplicating or reverse engineering activity to figure out what you get when you recycle an item that has no corresponding blueprint?
|
Raquel Smith
Caldari Provisions
|
Posted - 2006.08.30 21:02:00 -
[286]
Edited by: Raquel Smith on 30/08/2006 21:03:19 To "Postgresilise" the data this shell script function can be called:
postgresilise() { cmd="-e 's:,,:,null,:g' \ -e 's:,):,null):g' \ -e 's:(,:(null,:g' \ -e 's:CHAR(400):TEXT:g' \ -e 's:CHAR(1000):TEXT:g' \ -e 's:CHAR(3000):TEXT:g' \ -e 's:CHAR(4000):TEXT:g' \ -e 's:CHAR(6000):TEXT:g' \ -e 's:UNKNOWN:INTEGER:g' \ -e 's:xMin:x_Min:g' \ -e 's:yMin:y_Min:g' \ -e 's:yMin:z_Min:g' \ -e 's:xMax:x_Max:g' \ -e 's:yMax:y_Max:g' \ -e 's:zMax:z_Max:g' \ -e 's:dbo.::g'"
attribs="published stackable highIsGood scattered isOffensive isAssistance \ disallowAutoRepeat published isWarpSave electronicChance propulsionChance \ isDefault obsolete useBasePrice allowManufacture allowRecycler anchored \ anchorable *****bleNonSingleton hasTypes border fringe corridor hub \ international regional constellation scattered"
for col in $attribs do cmd="${cmd} -e '/${col}/s/INTEGER/BOOLEAN/'" done cmd="sed -i $cmd *.sql" eval $cmd }
Substitue the asterisks (a Scandinavian curse word) for fit and ta.
I'm trying to gather item data from the mess for a Ruby on Rails project. So far I've imported systems, constellations, regions, most names (into 1 table), dimensions, coordinates, jumps, stargates, planets, moons, asteroid belts, factions, NPC corporations, stations, market groups and some items.
The issue I'm having now is trying to figure out the bloody tl2materialsfortypewithactivity table so I can figure out what is needed to make something!
edit: Sorry for messing up the width of anyone's browser.
|
Raquel Smith
Caldari Provisions
|
Posted - 2006.09.03 18:57:00 -
[287]
I came across a troubling issue.
I've been examining some market exports and there are systems that are not in the stastations table.
So far in The Forge I've come across: 60015002 Aokannitoh VII - Moon 2 - School of Applied Knowledge 60015025 Hentogaira I - Moon 11 - Science and Trade Institute 60015026 Uchosi XI - Moon 14 - School of Applied Knowledge 60015027 Ishiomo VIII - Moon 11 - State War Academy School
There are doubtlessly others! Where are these systems??
|
Natalie McNeal
|
Posted - 2006.09.03 21:52:00 -
[288]
Hi, hope this thread is still on someone's watchlist...
When making my Blueprint calculator thing, I was looking for a swift methode to figure out what blueprints that produce 100 items per run and those who only produce 1. I didn't find a way to do this... Help?
Also, I've noticed that some blueprints in the dump has a waste factor of 0.05 while in-game they are 0.1. Is this a update in-game that hasn't been dumped yet? (Looking at Thorn Rocket Blueprint as an example)
Thanks for taking the time to do these dumps... :)
|
Dirk Swizzler
|
Posted - 2006.09.05 21:26:00 -
[289]
Is there an update to this? New systems were added and I'd like to update my tools.
|
Utoxin
Kydance Radiant Industries
|
Posted - 2006.09.07 16:05:00 -
[290]
I was looking through my database last night, and realized I don't have base price data for a lot of the common items. Like say... a Caracal. Did I fubar my data on import, or is this not in the RMR export files?
And if it's not, where are people getting it?
|
|
Amarr Menza
Amarr Viziam
|
Posted - 2006.09.10 03:52:00 -
[291]
1. Has anybody got CreateTable syntax for use with Mysql 5? Would be very nice if someone could export this so we can all use. I am working on this but if already done then will save me and others plenty of time.
2. The stations SQL file does not have the CreateTable syntax within it, in the downloads.
3. I have started a game Data Wiki here - http://wiki.triangle-solutions.com/index.php/EVE_Online Any contributions within the realms of PHP5 and MySQL 5 programming will be a help - ie has anyone written any OOP for the RMR files? Are there any other resources around for compiling tools with the RMR data?
Look forward to hearing from you all, this is my first venture into these files so see what happens
|
Vertigel Symorain
Gallente
|
Posted - 2006.09.10 18:15:00 -
[292]
I can't find ship cargo capacity!! I recon it should be dgmtypeattributes->attributeID=38 but there are not a single entry for attributeID=38 any of the 278,899 records in dgmtypeattributes.
I find this rather odd. Is it hiding somewhere else, or is it just missing? -VS- |
Vertigel Symorain
Gallente
|
Posted - 2006.09.10 23:44:00 -
[293]
Silly me... I found it. It's in the invtype table itself. But now, I ran into a new problem.... Where can I find what kind of slot (if any) the items would occupy, and if it uses a launcher/turret hardpoint? -VS- |
Amarr Menza
Amarr Viziam
|
Posted - 2006.09.11 14:30:00 -
[294]
IDS are done as follows:
3.008.416 in most cases
However the first file agtAgents the ID is done as 3008416
Can someone please tell me what the correct format should be - seems to me that the former is not a good way to identify Keys - as in MySQL we cannot identify this as an INT field type.
Anyway looking forward to figuring out all these quirks. ------ EVE Online Devs Wiki Triangle Solutions ------ |
Crumplecorn
Gallente Aerial Boundaries Inc. Interstellar Starbase Syndicate
|
Posted - 2006.09.11 14:35:00 -
[295]
Originally by: Natalie McNeal I was looking for a swift methode to figure out what blueprints that produce 100 items per run and those who only produce 1. I didn't find a way to do this... Help?
portionsize in invItems ----------
|
jide
|
Posted - 2006.09.11 22:59:00 -
[296]
Originally by: Vertigel Symorain Silly me... I found it. It's in the invtype table itself. But now, I ran into a new problem.... Where can I find what kind of slot (if any) the items would occupy, and if it uses a launcher/turret hardpoint?
It's in the effects table.
|
Amarr Menza
Amarr Viziam
|
Posted - 2006.09.12 02:16:00 -
[297]
T20
Can we have our own Forum - Called 'Game Data Developers' or something.
This thread seems to contain hundreds of posts that can be answered by people correctly if they were properly organised.
This way I can also find the posts by yourself within this mess. ------ EVE Online Devs Wiki Triangle Solutions ------ |
Utoxin
Kydance Radiant Industries Interstellar Starbase Syndicate
|
Posted - 2006.09.13 17:15:00 -
[298]
After careful inspection of the currently available CSV and SQL data files, it appears that some data was either intentionally or accidentally removed when they were last updated.
The base price data for MANY modules and ships is 0 ISK. After speaking a bit with the EVEmon developer on their forums, it appears that they originally got their data /from/ the RMR data exports, but it is definately not present in the files now. Can anyone else confirm the removal of this information?
|
Matalino
Gallente
|
Posted - 2006.09.13 17:41:00 -
[299]
Originally by: Amarr Menza Can we have our own Forum - Called 'Game Data Developers' or something.
Many people that are trying to develop stuff for eve will post in this forum.
|
Aragonis
|
Posted - 2006.09.19 12:00:00 -
[300]
I've played with the SQL files and have found a simple way to import the data into a MySQL database.
I'm assuming that you have the [url=http://www.mysql.com/products/tools/query-browser/]MySQL Query Browser[/url] installed for this.
Create a new schema (database) on your MySQL server called "dbo". You can do this using the right hand pane. You can rename this schema later if you wish. To load an SQL file, go to File->Open Script. Choose the SQL file that you wish to import into your database. Execute the script and watch for errors at the bottom. If one occurs, halt the execution, refresh the schema, drop the table and investigate the error. Most errors are caused by NULL values being inserted. Find which column is causing the problem.
For example, in the agtAgents script, several INSERT statments contain no value for the quality column:
INSERT INTO dbo.agtAgents (agentID,divisionID,corporationID,stationID,level,quality,agentTypeID) VALUES(3008440,2,1000002,60000163,3,,2);
Notice there is no value for quality under the values section of this statement. You can fix this by altering the table creation part of the script:
CREATE TABLE dbo.agtAgents( agentID INTEGER, divisionID INTEGER, corporationID INTEGER, stationID INTEGER, level INTEGER, quality INTEGER DEFAULT 0, agentTypeID INTEGER);
Notice I have added "DEFAULT 0" to my script. This means that whenever the variable isn't passed, I simply revert to the default value. NULL cannot be stored in an INTEGER data type, so we replace it with 0.
If the column was a VARCHAR, you could set DEFAULT '' to say that the default value is a zero-length string (technically it's one byte long and contains an \x00 char, but we'll ignore that).
Just for simplicity in this particular file, I also did a search and replace to change ,, to ,0, - however, this may not work correctly in other SQL scripts where this occurs as well as VARCHAR, TEXT or BLOB values are being set with ,,
Certain scripts also contain things like VARCHAR(4000). VARCHAR in MySQL cannot be longer than 255, so we can replace this with TEXT.
I may add to this little tutorial later, when I've played with the SQL a bit more.
|
|
Amarr Menza
Amarr Viziam
|
Posted - 2006.09.20 03:11:00 -
[301]
Hi
What you have written has already been covered earlier.
It is better if you use something like : mysql < dbo.sql this will batch import in the SQL in the fastest possible way, do this through command line and skip any tools.
Though it is better to actually do through the CSV as you will still get MySQL errors if the values are not present in the SQL data.
Check out my Wiki as I am doing exports of the database in MySQL 5 format that should provoke some debate at lease on how the indexing and field types should be set up.
------ EVE Online Devs Wiki Triangle Solutions ------ |
Amarr Menza
Amarr Viziam
|
Posted - 2006.09.20 03:13:00 -
[302]
Originally by: Matalino
Originally by: Amarr Menza Can we have our own Forum - Called 'Game Data Developers' or something.
Many people that are trying to develop stuff for eve will post in this forum.
"A forum for threads with words like: deterministic, continuations, generators, extrapolation, vertex shader, bi-directional reflectance distribution, etc."
Would be nice if we had our own specific forum shouldnt take long to set up that deals with the Data dumps exclusively. ------ EVE Online Devs Wiki Triangle Solutions ------ |
|
Eldo Davip
Forum Moderator Interstellar Services Department
|
Posted - 2006.09.24 17:32:00 -
[303]
Originally by: Amarr Menza T20
Can we have our own Forum - Called 'Game Data Developers' or something.
This thread seems to contain hundreds of posts that can be answered by people correctly if they were properly organised.
This way I can also find the posts by yourself within this mess.
THere is one. Its called the Eve Technology Lab
|
|
Amarr Menza
Amarr Freelance Co Op
|
Posted - 2006.09.26 06:44:00 -
[304]
Hi,
The EVE data wiki is now coming on great quite a few of the Tables have been optimised and outputted in MySQL 5, I am now adding optimised CSV downloads and will add XML and SQL very soon. Plus a decent schema of the DB. Looking for support on this so if anyone wants to help out click below log in and get stuck in.
EVE Data Help
Cheers
Amarr ------ EVE Online Devs Wiki Triangle Solutions ------ |
Raquel Smith
Caldari Ferengi Commerce Authority
|
Posted - 2006.09.26 08:41:00 -
[305]
Originally by: Amarr Menza Hi,
The EVE data wiki is now coming on great quite a few of the Tables have been optimised and outputted in MySQL 5, I am now adding optimised CSV downloads and will add XML and SQL very soon. Plus a decent schema of the DB. Looking for support on this so if anyone wants to help out click below log in and get stuck in.
EVE Data Help
Cheers
Amarr
Not really sure what the goal of the project is. There is already a guide to migrating the TSQL to MySQL and Postgres.
|
Amarr Menza
Amarr Freelance Co Op
|
Posted - 2006.09.26 09:30:00 -
[306]
Hi
Ok show me a link to this guide please.
The goal is to not provide a 'Guide' but to provide updated optimised MySQL / Postgres / any DB schemas and data exports.
As you can see from
EVE MySQL Exports
This is starting to happen now, I find the SQL generated by CCP is not indexed correctly, the fields types are obviously all a miss - so I am simply correcting all these importing in the CSV and then exporting this out again in an optimised fashion.
------ EVE Online Devs Wiki Triangle Solutions ------ |
Raquel Smith
Caldari Ferengi Commerce Authority
|
Posted - 2006.09.26 09:35:00 -
[307]
Originally by: Amarr Menza Hi
Ok show me a link to this guide please.
The goal is to not provide a 'Guide' but to provide updated optimised MySQL / Postgres / any DB schemas and data exports.
As you can see from
EVE MySQL Exports
This is starting to happen now, I find the SQL generated by CCP is not indexed correctly, the fields types are obviously all a miss - so I am simply correcting all these importing in the CSV and then exporting this out again in an optimised fashion.
The guide exists in this thread!
I agree that CCP's schema is rubbish. I spent weeks optimising it for my own needs.
|
Amarr Menza
Amarr Freelance Co Op
|
Posted - 2006.09.26 14:51:00 -
[308]
And there lies the problem I have been through this thread with a fine tooth comb and a lot of the ideas are laborious and sometimes incorrect, they pay no attention to what makes a DB tick the indexing and field types, they just seem to care about getting the Data loaded up. I am sure there are dozens of DBs around that are very poorly created.
If you have done the porting do you want to share your schema? What DB do you use? MySQL?
The point of the collaboration is for everyone to find out the best way to do things, and to create some debate. Instead of everyone doing the same thing 50% lets try and work together and make it excellent, it will save a lot of peoples time and allow some really good tools to be developed faster. ------ EVE Online Devs Wiki Triangle Solutions ------ |
Jean Toroque
InterSec
|
Posted - 2006.09.30 21:31:00 -
[309]
I've seen the question asked a few times, but not answered yet: where's the data concerning the amount of each mineral yielded when refining ore?
I understand that you can get the requirements for manufacturing from TL2MaterialsForTypeWithActivity (winner: Academy Award for Worst Table Name in a Database), and that the requirements for manufacturing are normally the same as the output from reprocessing.
But that doesn't help with ore, because there is no blueprint type for any of the ores, and there is no data in TL2EtCetera for any of the ore types.
For example, Veldspar is typeid 1230, and there are no rows in TL2 where typeid = 1230, for any activity.
The information is shown in a perfectly intelligible format in the Item Database ... seems strange that it wouldn't be in the data dump.
Does anyone have The Clue on this one?
|
Pantheon Lea
Farmer Boyz
|
Posted - 2006.09.30 22:02:00 -
[310]
Edited by: Pantheon Lea on 30/09/2006 22:02:44 http://www.eve-online.com/itemdatabase/manufactureresearch/ore/default.asp
Pantheon Lea
|
|
Jean Toroque
InterSec
|
Posted - 2006.10.01 00:40:00 -
[311]
Pantheon Lea, I get that it's in the Item Database. Refer to my post above:
Originally by: "Jean Toroque" The information is shown in a perfectly intelligible format in the Item Database ... seems strange that it wouldn't be in the data dump.
My question is whether the info is in the data dump, and if it's not, how come?
|
Pantheon Lea
Farmer Boyz
|
Posted - 2006.10.12 22:22:00 -
[312]
Originally by: Jean Toroque My question is whether the info is in the data dump, and if it's not, how come?
It's not in the data dump, probably because it's not stored in the database, there is really no need to store it in the database because it's very static and also used very often, it's probably hard coded in the server, client or both.
Pantheon Lea
|
FlyBaby
|
Posted - 2006.10.16 22:38:00 -
[313]
Originally by: Utoxin After careful inspection of the currently available CSV and SQL data files, it appears that some data was either intentionally or accidentally removed when they were last updated.
The base price data for MANY modules and ships is 0 ISK. After speaking a bit with the EVEmon developer on their forums, it appears that they originally got their data /from/ the RMR data exports, but it is definately not present in the files now. Can anyone else confirm the removal of this information?
this is something that interrest me also. is there anybody at all that has an awnser on this? and if possible a solution?
note: I also think we need a separate forum section for application development. this thread is getting bigger and bigger, and harder to find awnsers/questions back without reading it all over again. and people start double posting question.
|
Tor Manx
|
Posted - 2006.10.27 03:19:00 -
[314]
Been playing with the data a bit today, and can't seem to find where I'd retrieve the "Mining Amount" total's for the mining lasers. Anyone know off hand how I'd go about pulling that information out?
|
Vessper
Indicium Technologies
|
Posted - 2006.10.27 12:58:00 -
[315]
Originally by: Tor Manx Been playing with the data a bit today, and can't seem to find where I'd retrieve the "Mining Amount" total's for the mining lasers. Anyone know off hand how I'd go about pulling that information out?
The "Mining Amount" is Attribute Type number 77. If you search for this in the "attributeID" column of the invTypeAttributes table, it will give you the item IDs and mining amount of all the items with this attribute, including mining lasers and mining drones.
|
Tor Manx
|
Posted - 2006.10.28 05:01:00 -
[316]
Originally by: Vessper
The "Mining Amount" is Attribute Type number 77. If you search for this in the "attributeID" column of the invTypeAttributes table, it will give you the item IDs and mining amount of all the items with this attribute, including mining lasers and mining drones.
Strangely enough, it turns out my query was correct and there are just more than one "near" identical rows for many of the items. For instance, with this query I get multiple listings for each object due to the fact there are often many items with the same type and attribute id's.
SELECT * FROM Dbo_invTypes it, Dbo_dgmTypeAttributes dta where it.typeID = dta.typeID and dta.attributeID = 77 and it.groupID = 54
So I ran this query hoping it would narrow it down, but still no luck.
SELECT * FROM Dbo_invTypes AS it, Dbo_dgmTypeAttributes AS dta WHERE it.typeID=dta.typeID AND it.typeID in (3,5,11,12,21,22,25,482,483) And dta.attributeID=77 and it.groupID = 54
Not really getting their data model 100% yet. But I'll keep working on it.
|
Vessper
Indicium Technologies
|
Posted - 2006.10.28 09:49:00 -
[317]
Originally by: Tor Manx Strangely enough, it turns out my query was correct and there are just more than one "near" identical rows for many of the items. For instance, with this query I get multiple listings for each object due to the fact there are often many items with the same type and attribute id's.
I use the following query and it seems to give me a list of all items with a mining amount (no duplications either):
SELECT invTypes.typeName, dgmTypeAttributes.valueInt FROM invTypes INNER JOIN (dgmAttributeTypes INNER JOIN dgmTypeAttributes ON dgmAttributeTypes.attributeID = dgmTypeAttributes.attributeID) ON invTypes.typeID = dgmTypeAttributes.typeID WHERE (((dgmAttributeTypes.attributeID)=77));
Unfortunately, I'm not very good with SQL so I don't know if this is the best way to do it...but it works.
|
Fubar
Amarr Eagle Eye Inc.
|
Posted - 2006.10.28 17:08:00 -
[318]
Originally by: Vessper
SELECT invTypes.typeName, dgmTypeAttributes.valueInt FROM invTypes INNER JOIN (dgmAttributeTypes INNER JOIN dgmTypeAttributes ON dgmAttributeTypes.attributeID = dgmTypeAttributes.attributeID) ON invTypes.typeID = dgmTypeAttributes.typeID WHERE (((dgmAttributeTypes.attributeID)=77));
Unfortunately, I'm not very good with SQL so I don't know if this is the best way to do it...but it works.
You can simplify the statement to..
SELECT invTypes.typeName, dgmTypeAttributes.valueInt FROM invTypes INNER JOIN dgmAttributeTypes ON invTypes.typeID = dgmTypeAttributes.typeID WHERE (((dgmAttributeTypes.attributeID)=77));
|
Vessper
Indicium Technologies
|
Posted - 2006.10.29 09:19:00 -
[319]
Originally by: Fubar
Originally by: Vessper
SELECT invTypes.typeName, dgmTypeAttributes.valueInt FROM invTypes INNER JOIN (dgmAttributeTypes INNER JOIN dgmTypeAttributes ON dgmAttributeTypes.attributeID = dgmTypeAttributes.attributeID) ON invTypes.typeID = dgmTypeAttributes.typeID WHERE (((dgmAttributeTypes.attributeID)=77));
Unfortunately, I'm not very good with SQL so I don't know if this is the best way to do it...but it works.
You can simplify the statement to..
SELECT invTypes.typeName, dgmTypeAttributes.valueInt FROM invTypes INNER JOIN dgmAttributeTypes ON invTypes.typeID = dgmTypeAttributes.typeID WHERE (((dgmAttributeTypes.attributeID)=77));
Much neater, thanks
|
Tor Manx
|
Posted - 2006.10.31 00:56:00 -
[320]
Thanks for your idea's. I kinda ran into a problem with the csv export though. It seems that some of the csv data has overrun their rows (or so it seems). In the most recent csv extract that I downloaded, around like 160 everyting goes to hell because a blank line and unformatted text follows it. I'll re-download and see if it's any better.
|
|
Tor Manx
|
Posted - 2006.10.31 01:07:00 -
[321]
Should state that the export file in question is the dbo_invTypes. Definitely looks like a bad export to me, but if someone else could check it would be appreciated.
|
Aelena Thraant
Shadows of the Dead Xelas Alliance
|
Posted - 2006.11.02 21:53:00 -
[322]
Is there a list of what resources a BP uses without any ME research? I couldn't find it in the RMR data export, but was wondering if I missed the info from somewhere.
|
Vessper
Indicium Technologies
|
Posted - 2006.11.03 00:38:00 -
[323]
Originally by: Aelena Thraant Is there a list of what resources a BP uses without any ME research? I couldn't find it in the RMR data export, but was wondering if I missed the info from somewhere.
Unfortunately not. You will have to use some math to calculate the wastage and add it on to the "perfect" production figures that are given in the file export.
|
Irongut
M'8'S
|
Posted - 2006.11.03 12:36:00 -
[324]
Originally by: Tor Manx Should state that the export file in question is the dbo_invTypes. Definitely looks like a bad export to me, but if someone else could check it would be appreciated.
Yeah that file is totally screwed. There are a few other files with the same problem but they're all small enough to manually fix them. I'm slowly working on fixing dbo_invTypes but since there are 16,000+ items it's going to take forever.
|
Vessper
Indicium Technologies
|
Posted - 2006.11.03 16:44:00 -
[325]
Originally by: Irongut
Originally by: Tor Manx Should state that the export file in question is the dbo_invTypes. Definitely looks like a bad export to me, but if someone else could check it would be appreciated.
Yeah that file is totally screwed. There are a few other files with the same problem but they're all small enough to manually fix them. I'm slowly working on fixing dbo_invTypes but since there are 16,000+ items it's going to take forever.
I couldn't get on with the original CSV files that CCP provided so I've reworked the SQL export files to produce a group of (what seems to be) decent CSV files. If anyone is interested, I'd be happy to share the whole collection. I've even added mineral/ore data into the TL2Materials file
|
Lufio II
Amarr Marangrio Space Services Inc.
|
Posted - 2006.11.03 18:15:00 -
[326]
Edited by: Lufio II on 03/11/2006 18:17:33
Originally by: Irongut
Originally by: Tor Manx Should state that the export file in question is the dbo_invTypes. Definitely looks like a bad export to me, but if someone else could check it would be appreciated.
Yeah that file is totally screwed. There are a few other files with the same problem but they're all small enough to manually fix them. I'm slowly working on fixing dbo_invTypes but since there are 16,000+ items it's going to take forever.
I used textpad and worked my way into regular expressions. I played around a bit and finally managed to cough a regexp up which eventually fixed all existing problems after doing a replace with it.
The problem is that some Item descriptions contain line breaks, and this breaks the CSV-Format for almost all of the freely available CSV-Imports, heck, even for most of the professional ones (they always assume that one record is one line, and if a description contains a line break, that usually ends a line prematurely and breaks that specific record ;) )
Sadly I don't remember the regular expression I was using right now else I'd share it with you...
|
Camladar
|
Posted - 2006.11.12 20:50:00 -
[327]
staStations is missing a lot of stations?
There definitely seems to be stations missing from the staStations table. I went as far as running the stationID's in my market logs through the table manually and and there's a lot that simply are not in there. Any workarounds, ideas, suggestions, or new data for this info?
|
|
t20
|
Posted - 2006.11.13 01:15:00 -
[328]
You'll all get the new data when Revelations (Kali) hits the deck.
|
|
Gigi Barbagrigia
Latent Appliance Fetishists
|
Posted - 2006.11.13 07:00:00 -
[329]
I seriously hope somebody remembered and got you a drink or three at FF.
|
Raquel Smith
Caldari Ferengi Commerce Authority
|
Posted - 2006.11.13 07:48:00 -
[330]
Originally by: t20 You'll all get the new data when Revelations (Kali) hits the deck.
You, sir, are my hero.
|
|
Camladar
|
Posted - 2006.11.14 06:15:00 -
[331]
Yes sir, that is great to hear. Hopefully we won't wait too incredibly long since the stations and such are already in the game and it would be nice to have it sooner rather that later.
Either way, it is wonderful we are going to get the data.
|
Girdan Keirge
eXceed Inc. Ascendant Frontier
|
Posted - 2006.11.18 02:15:00 -
[332]
Originally by: Aelena Thraant Is there a list of what resources a BP uses without any ME research? I couldn't find it in the RMR data export, but was wondering if I missed the info from somewhere.
There's a program called EVE Material Level Calculator that I found on the forums recently. You can set your level for P.E. and Metalurgy, save an owned BPOs list (or just search/pick from the whole list), and it will tell you how long to research between any two levels, what the wastage is, build cost with settable mineral cost, shows the 0 waste M.E. level for each mineral, graphs the break points for each increase in efficiency for each mineral, Station or POS option, and a couple other things. And more is planned, so I understand.
The thread is Here. There aren't any instructions included with the program but it's pretty self explanitory, though a couple things are not quite intuitive, but there've been many questions and answers in the thread itself if you can't figure something out.
I don't really do production, but it's a nice tool to have for estimating the minerals I'll need for a BYOM deal.
|
Sinlok
Southern Cross Incorporated Pure.
|
Posted - 2006.11.21 14:34:00 -
[333]
Edited by: Sinlok on 21/11/2006 14:35:04
|
Sinlok
Southern Cross Incorporated Pure.
|
Posted - 2006.11.21 14:34:00 -
[334]
I'm trying to setup my first SQL database with the blueprint info in it. Where do I locate the names that go with the blueprint IDs from dbo_invBluePtrintTypes.sql
|
PreTender
Amarr R0NIN Industrial THE R0NIN
|
Posted - 2006.11.21 14:35:00 -
[335]
invTypes table __________________________
http://www.eve-extra.com http://www.eve-wiki.net |
Ice Monkie
|
Posted - 2006.11.21 22:25:00 -
[336]
Crazy, I did a text search against all the sql files from the dump for Megathron and it came up with nothing. I assumed I was needing to download another file. Thx for pointer PreTender!
|
Itcharo Wu
Free-Space-Ranger Morsus Mihi
|
Posted - 2006.11.26 21:55:00 -
[337]
I have a question regarding the license to use the data and images. It says commercial use is not allowed, that's clear.
But what about non-profit websites - am I allowed to use the icons on said website? Or may I only use them for private purposes and not in (non-commerical) content open to the public?
|
Sunaria
|
Posted - 2006.11.27 02:04:00 -
[338]
is there an ETA on the revelations datadump ??? I would love to update my database when it's there so my apps won't have to be outdated to long. You got to get aboard the future you know ... :)
|
Eewec Ourbyni
Caldari
|
Posted - 2006.11.29 08:08:00 -
[339]
Originally by: Sunaria is there an ETA on the revelations datadump ??? I would love to update my database when it's there so my apps won't have to be outdated to long. You got to get aboard the future you know ... :)
I do here by second the most polite and earnest request for a new data dump for revelations. Need to get EVEMon updated...
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
|
t20
|
Posted - 2006.11.29 14:53:00 -
[340]
data dump delayed till we're 150% confident that everything's running smooth, we've changed some "static" data that would require me to do another data dump. ETA: sooner than soon.
so until then, just be on hold.
|
|
|
ToxicFire
Warlords Corp The Core Collective
|
Posted - 2006.11.29 23:38:00 -
[341]
Originally by: t20 data dump delayed till we're 150% confident that everything's running smooth, we've changed some "static" data that would require me to do another data dump. ETA: sooner than soon.
so until then, just be on hold.
*Hurls t20 a beer and some cookies*
Good work :) keep it up
Join the save Stargate SG1 Campaign Today! http://savestargatesg1.com/
|
Salvis Tallan
Gallente Team Condor
|
Posted - 2006.11.30 00:59:00 -
[342]
*chomps at the bit, twitching* ------
|
Mik Nostrebor
Minmatar ORKS
|
Posted - 2006.11.30 05:54:00 -
[343]
Ah HAH!
I found the right thread for info on the new data dump! :)
AUSSIE AND KIWI EVE Fansite |
BarmaLINI
Caldari PsiCorp
|
Posted - 2006.11.30 09:28:00 -
[344]
Originally by: t20 data dump delayed till we're 150% confident that everything's running smooth, we've changed some "static" data that would require me to do another data dump. ETA: sooner than soon.
so until then, just be on hold.
we waiting --------------------------------------- Welcome: HTTP://EVEINFO.COM Missions (3,4 level), Offers, Agents, Cosmos, Eve Universe Map, Refine and more |
Eewec Ourbyni
Caldari
|
Posted - 2006.11.30 11:04:00 -
[345]
Originally by: BarmaLINI
Originally by: t20 data dump delayed till we're 150% confident that everything's running smooth, we've changed some "static" data that would require me to do another data dump. ETA: sooner than soon.
so until then, just be on hold.
we waiting
Judging by the announcements made in various threads etc, the db dumps will probably be done after tuesdays update. This is a guess of course, but I for one would like to be using info that is actually accurate for more than 5 days, and a db drop now wouldn't include the changes coming on tuesday.
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
Raquel Smith
Caldari Ferengi Commerce Authority
|
Posted - 2006.11.30 14:57:00 -
[346]
Originally by: t20 data dump delayed till we're 150% confident that everything's running smooth, we've changed some "static" data that would require me to do another data dump. ETA: sooner than soon.
so until then, just be on hold.
*whine* But I'm impatient!
We'll wait and look forward to seeing more yellow (updated) tags on the blog entry.
|
Ilor Prophet
|
Posted - 2006.11.30 18:53:00 -
[347]
Originally by: t20 data dump delayed till we're 150% confident that everything's running smooth, we've changed some "static" data that would require me to do another data dump. ETA: sooner than soon.
t20, you're my hero. Do you have a PayPal account where we can deliver beer money?
|
Shar Tegral
|
Posted - 2006.12.04 17:23:00 -
[348]
Originally by: Ilor Prophet t20, you're my hero. Do you have a PayPal account where we can deliver beer money?
QFT
The Eve-Online forums may not have invented whining, but they sure have perfected it.
Arknox > shar with bad hair day >>> solution = suicide and spawn fresh clone :D |
Eewec Ourbyni
Caldari
|
Posted - 2006.12.04 18:45:00 -
[349]
OK, just been going through the market to make my own skills.xml file for use in EVEMon....
Just out of curiosity, why does Cruise Missile Specialisation have 2 pre-reqs... one of which is Missile Launcher op lvl 1 yet the other pre-req requires this same skill at lvl 5....??
Then you have Torpedo Specialisation that requires Missile Launcher op lvl 1 but it's other pre-req requires Missile Launcher op lvl 4
Just curious.
Shouldn't Cruise missiles have the pre-req Missile Launcher op lvl 4 and Cruise Missile Spec have Missile Launcher op lvl 5? Not sure about Torpedo Specialisation, but I'm wondering why they aren't worked in a similar way to Citadel Torps.
It just doesn't make much sense...
This is a sig...
-- You think this guys post is nuts.... you should see his bio --
... good, ain't it! |
Laendra
|
Posted - 2006.12.05 22:00:00 -
[350]
Originally by: t20 ETA: sooner than soon.
so until then, just be on hold.
So, sometime before the next ice age? ------------------- |
|
Sunaria
|
Posted - 2006.12.05 22:05:00 -
[351]
Originally by: Laendra
Originally by: t20 ETA: sooner than soon.
so until then, just be on hold.
So, sometime before the next ice age?
tsk tsk tsk patience kimosabe :p patience is a virtue
|
Dale Molokan
Caldari The Clearwater Society
|
Posted - 2006.12.06 03:35:00 -
[352]
is there some way to just get the typeID, stationID, regionID, and solarsytemID values somewhere? Those are the numbers that appear when you export from the market.
If I knew which items, stations, regions and solar systems those numbers were assigned to I would be in business.
I don't know crap about SQL... I can't read any of those files. HELP!! ------------------- JOIN THE FLEET!
|
Intelligent BlackMan
|
Posted - 2006.12.06 03:56:00 -
[353]
Edited by: Intelligent BlackMan on 06/12/2006 03:59:10 Edited by: Intelligent BlackMan on 06/12/2006 03:58:48 Here are some SQL queries that might be helpful to some people.
This one is a simple one that gives you some basic BPO information:
use EVE; selectit.typeName, productionTime, techLevel, researchProductivityTime, researchMaterialTime, researchCopyTime, researchTechTime, productivityModifier, materialModifier, wasteFactor, maxProductionLimit frominvTypes as it join invBlueprintTypes as ibt on it.typeID = ibt.blueprintTypeID join invTypes as it_prod on ibt.productTypeID = it_prod.typeID order by it.typeName
Here's a rather complex one that returns data for BPOs that only use minerals (no tech2, no capital ships, etc) and does it such that the mineral ammounts end up in their own columns:
use EVE; select * from ( selectit.typeName "Blueprint Name", it_prod.typeName Produces, max(it.basePrice) basePrice, max(ibt.productionTime) productionTime, max(ibt.techLevel) techLevel, max(ibt.researchProductivityTime) productivityTime, max(ibt.researchMaterialTime) materialTime, max(ibt.researchCopyTime) copyTime, SUM(case when it_mat.typeName = 'Tritanium' then t2.quantity else 0 end) as 'Tritanium', SUM(case when it_mat.typeName = 'Pyerite' then t2.quantity else 0 end) as 'Pyerite', SUM(case when it_mat.typeName = 'Mexallon' then t2.quantity else 0 end) as 'Mexallon', SUM(case when it_mat.typeName = 'Isogen' then t2.quantity else 0 end) as 'Isogen', SUM(case when it_mat.typeName = 'Nocxium' then t2.quantity else 0 end) as 'Nocxium', SUM(case when it_mat.typeName = 'Zydrine' then t2.quantity else 0 end) as 'Zydrine', SUM(case when it_mat.typeName = 'Megacyte' then t2.quantity else 0 end) as 'Megacyte', SUM(case when t2.requiredTypeID < 34 or t2.requiredTypeID > 40 then 1 else 0 end) as 'numNonBasicMaterials' frominvTypes as it join invBlueprintTypes as ibt on it.typeID = ibt.blueprintTypeID join invTypes as it_prod on ibt.productTypeID = it_prod.typeID, TL2MaterialsForTypeWithActivity as t2 join invTypes as it_mat on t2.requiredTypeID = it_mat.typeID whereit.marketGroupID is not null and t2.typeID = it.typeID and t2.quantity > 0 group by it.typeName, it_prod.typeName ) as data where numNonBasicMaterials = 0
These work for me in MS SQL Server Express but should be pretty standard. Change that "use EVE" to use your database name if you didn't import your data into a database named "EVE".
|
Intelligent BlackMan
|
Posted - 2006.12.06 03:57:00 -
[354]
Doh! Delete that "where waste_factor != 10"
(I was trying to figure out what this waste_factor stuff was all about.)
|
Anna Grahm
|
Posted - 2006.12.06 09:40:00 -
[355]
Originally by: Dale Molokan is there some way to just get the typeID, stationID, regionID, and solarsytemID values somewhere? Those are the numbers that appear when you export from the market.
If I knew which items, stations, regions and solar systems those numbers were assigned to I would be in business.
I don't know crap about SQL... I can't read any of those files. HELP!!
mapDenormalise table.
|
Dunedon
|
Posted - 2006.12.06 15:24:00 -
[356]
Originally by: t20 data dump delayed till we're 150% confident that everything's running smooth, we've changed some "static" data that would require me to do another data dump. ETA: sooner than soon.
so until then, just be on hold.
Is it soon yet :) ... Or at least a time period in which you can give a ballpark answer to when you think it will be available. Thanks in advance, know your busy so I understand the delay and am hoping for a status update :)
... 111% ... 112% ...
- Dunedon
|
|
t20
|
Posted - 2006.12.06 16:02:00 -
[357]
It's on the way, izz naajs
|
|
Raquel Smith
Caldari Freedom-Technologies Knights Of the Southerncross
|
Posted - 2006.12.06 16:35:00 -
[358]
Originally by: t20 It's on the way, izz naajs
My hero.
|
sandie
|
Posted - 2006.12.06 17:17:00 -
[359]
I know the data is due for replacement but have just been looking at the 14/03/2006 Blueprint data and the TL2MaterialsForTypeWithActivity the blog says activites 6 - 7 are.
- activityDuplicating = 6
- activityReverseEngineering = 7
Only the data would appear that these are build and reprocess amounts
The data for the Crucifier includes some of the Anathema requirements
I am sure there are more but only looked at a few BP's
Can you confirm that these things have been fixed before the next release of data
Sorry if this has been coverd somewhere else in this thread but I didn't find it. |
Deikan Frost
Amarr
|
Posted - 2006.12.06 20:07:00 -
[360]
Originally by: t20 This devblog gives you the updated type info, construction requirements, TL2 construction details, universe-wide info, station details and much more ... happy fiddling
Post requests here if you have any (that are related to this subject)
Is it me or the "Last modified dates" of all of the data files are still the old ones? Has everything been updated and you just forgot to change the last mod dates?
|
|
|
t20
|
Posted - 2006.12.06 21:49:00 -
[361]
nothing has been changed yet, everything is in a devblog waiting to be released.
|
|
Mik Nostrebor
Minmatar ORKS
|
Posted - 2006.12.06 22:28:00 -
[362]
Originally by: t20 nothing has been changed yet, everything is in a devblog waiting to be released.
And the crowds of eager info-heads crowd around the data-kiosk waiting for their next fix...the old data was good but it's not longer enough to feed the deep knawing NEED.
The desperate need to KNOW. Like a narcotic drug, data in this age has become not just a commodity, but a psychological and indeed physical essetial in life. Like breathing, a flow of good, fresh, clean living data means the difference between life and death in this universe.
In recent months an unprecedented massive wave of design changes has flowed through production of all 4 Nations' navies, almost as if some unseen hand from above reached down and tweaked reality. Nicknamed the 'Revelation' the changes happened so quickly and are changing the face of the galaxy... and the Concord Core Datatree is gathering, crunching and creating a new flow...
Meanwhile all the branches throughout every corner of space waits with baited breath. Every ship, every NAVdex, every tourist guide, every CADbot waits in anticipation. The need like a hard core of terror grows like a cancer inside. Vainly using the old data for reference but knowing it was no good. People making decisions using the oldest technology of all... rule of thumb... and they are dying because of it.
Information. We all need it. Desire it. Cry out for it in the cold depths of space. Die for it.
The rumour has it that the new flow will be available from the datatree today. We all hate concord but know that without it all would be anarchy like centuries past. We hate our drugs but we will never stop needing it. Concord give us the flow! GIVE US THE FLOW! We need the new flow now!
We gather. We wait. We wait for that which cannot be waited for. We wait for the ecstacy of being the first into the flow. To be filled with the glow of life and potential. To know that through us, the universe will live again, and our need can once again return to the background...until the next time...
Mik |
ProphetMalthus
Caldari Neogen Industries Serenity Fallen
|
Posted - 2006.12.06 23:17:00 -
[363]
Awesome roleplaying! But sure. Information is what we are ready to die for.
Keep up the good work! ---- tell user to write a signature. |
Salvis Tallan
Gallente Team Condor
|
Posted - 2006.12.07 00:16:00 -
[364]
Well said Mik!! ------
|
|
kieron
|
Posted - 2006.12.07 00:18:00 -
[365]
Per t20's request, I am locking this thread so the export discussion may start fresh with the new export coming in a few moments.
kieron Community Manager, EVE Online |
|
|
|
|
Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 .. 13 :: [one page] |