Pages: [1] 2 3 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 9 post(s) |
|
CCP Taera
|
Posted - 2008.07.30 14:29:00 -
[1]
The new Data Export has arrived, and its creator Prism X explains the process, implementation, and future of this powerful tool. Check out the blog here, or head straight to our Community area to download the Export.
Taera Associate Community Manager CCP Hf, EVE Online Email |
|
Vessper
Indicium Technologies
|
Posted - 2008.07.30 14:43:00 -
[2]
\o/
Thanks guys - - -
EveHQ Character App | Item Database |
Red Panda
VMF-214 Blacksheep
|
Posted - 2008.07.30 14:51:00 -
[3]
error in the link to MSSQL :
http://www.microsoft.com/sql/editions/express</a
link here : http://www.microsoft.com/sql/editions/express
--------- Red Panda ---------
()_() ( '_') (")(") I need Bamboo !! |
Salvis Tallan
Gallente The Shadow Order Vanguard.
|
Posted - 2008.07.30 14:55:00 -
[4]
rabble rabble rabble!!!
Thanks for getting it to us. More types of fiels beyond the MSSQL backup file will be done soon, keep checking the page and also http://wiki.eve-id.net ------
|
|
CCP Taera
|
Posted - 2008.07.30 15:09:00 -
[5]
Originally by: Red Panda error in the link to MSSQL :
http://www.microsoft.com/sql/editions/express</a
link here : http://www.microsoft.com/sql/editions/express
Fixed!
Taera Associate Community Manager CCP Hf, EVE Online Email |
|
Dal Rath
|
Posted - 2008.07.30 15:12:00 -
[6]
Quote: Along with the backup itself you will get a .SQL file called ebs_DATADUMP.sql
*cough*404*cough* |
|
CCP t20
|
Posted - 2008.07.30 15:15:00 -
[7]
ebs_DATADUMP.sql temporarily here.
|
|
Cesar Malari
Gunfleet Logistics
|
Posted - 2008.07.30 16:10:00 -
[8]
Quote: Removal of table crpNPCCorporationTrades.
Can someone at CCP say why this was done?
I was just in the process of putting the finishing touches on a tool that used this table from the trinity data dump to find the closest place that sold a given NPC-supplied item (skillbooks, T1 BPOs, POS parts), even if it wasn't in my region. It was very helpful in helping me find where some POS parts were being sold. |
Meissa Anunthiel
|
Posted - 2008.07.30 16:11:00 -
[9]
Anyone knows how to get the T2 BPC produced when using invention on T1 BPOs? I can't seem to find that information in the dump (there's a workaround with joining invBlueprintTypes and invTypes and checking techlevel 1 or 2, but that doesn't work for ammo)
|
Cesar Malari
Gunfleet Logistics
|
Posted - 2008.07.30 16:27:00 -
[10]
Originally by: Meissa Anunthiel Anyone knows how to get the T2 BPC produced when using invention on T1 BPOs? I can't seem to find that information in the dump (there's a workaround with joining invBlueprintTypes and invTypes and checking techlevel 1 or 2, but that doesn't work for ammo)
From the T1 BPC, get the item produced by it (invBluePrintTypes.productTypeID), then find the T2 item(s) by looking in invMetaTypes.typeID where metaGroupID=2 and parentTypeID=the T1 item typeid. Match the T2 item id to invBluePrintTypes.productTypeID, giving you the BP's item ID as blueprintTypeID.
Example for Null L: select * from invTypes where typename='Thorium Charge L Blueprint' select * from invBlueprintTypes where blueprintTypeID=1150 select * from invMetaTypes where parentTypeID=235 and metaGroupID=2 select * from invBlueprintTypes where productTypeID=12787 select * from invTypes where typeid=12788 |
|
Nekopyat
|
Posted - 2008.07.30 16:57:00 -
[11]
Cool ^_^
I was just wondering what it took to get a data dump so I could fiddle around with a utility app.
Though one question (less at the devs and more at others), can anyone suggest a quick way to get this data OUT of MSSQL without having to grab a copy from microsoft?
|
Chruker
|
Posted - 2008.07.30 17:04:00 -
[12]
congratulations of making such a bad choice on how to provide the dataexport \o/
seriously? just some bloody binary backup files that you cant do f.... with without havign a program installed on windows
At least the previous sql files could easily be morphed/read/transformed...
jezz ----- http://games.chruker.dk/eve_online ----- Top wishes: - No daily downtime - Faster training on sisi - Speedup IGB table rendering |
Cesar Malari
Gunfleet Logistics
|
Posted - 2008.07.30 17:07:00 -
[13]
Originally by: Nekopyat Though one question (less at the devs and more at others), can anyone suggest a quick way to get this data OUT of MSSQL without having to grab a copy from microsoft?
Be patient. Within a day or so, someone will have exported the data to a SQL script for MySQL, CSV files, and probably even an Access file and posted links to either this thread, or some one in "EVE Technology Lab" forum. They won't be "official" of course, but someone will probably do it if you can't be bothered to install SQL Server Express yourself.
If noone does a MySQL one by this weekend, I'll probably throw one together. |
Kale Hirshel
|
Posted - 2008.07.30 17:18:00 -
[14]
Thank you so much.
|
Dronte
Minmatar Quam Singulari
|
Posted - 2008.07.30 18:35:00 -
[15]
You can find SQL versions of the dumps on zofu's site: http://eve.no-ip.de/ea10/
|
Shar'ri Atal
|
Posted - 2008.07.30 19:32:00 -
[16]
Oh great, so now we require Windows and we require MSSQL.
Why not just script the thing into two plain text files, one for the schema and one for the data in pure SQL commands. While you're at it put comments in there to flag any of the non-ANSI-SQL data types that MSSQL uses so we can process the thing into something sensible.
MSSQL Express is annoyingly limited. Where as PostgreSQL for example isn't and is also free. If that's overkill then what about something that can be used by SQLite libraries. It's cross platform and can be linked into anything.
EVE might be tied into Microsoft's monstrosity of a database but it doesn't mean that everyone else wants to be.
|
iulixxi
EVE-RO
|
Posted - 2008.07.30 19:47:00 -
[17]
Will we have a data_map icons any time soon ?
Iuli
|
Meissa Anunthiel
|
Posted - 2008.07.30 19:48:00 -
[18]
Edited by: Meissa Anunthiel on 30/07/2008 19:49:41
Originally by: Chruker congratulations of making such a bad choice on how to provide the dataexport \o/
seriously? just some bloody binary backup files that you cant do f.... with without havign a program installed on windows
At least the previous sql files could easily be morphed/read/transformed...
jezz
I, on the other hand, thank them very much for making a 1+ hour operation with previous exports (inconsistencies, missing definitions, NULL data in non nullable fields, files to large for the desktop edition to work, etc.) now take 1 minute tops.
In the unlikely event the gamer you are doesn't also have a windows installation to put the free version of SQL server to do an SQL export yourself, you'll have to wait, what? 2 days for others to post exports? [Edit: actually they're already available as of 1 hour ago, see OP...]
Jeez
|
Burchov
Lyrus Associates
|
Posted - 2008.07.30 19:51:00 -
[19]
Originally by: Shar'ri Atal Oh great, so now we require Windows and we require MSSQL.
Why not just script the thing into two plain text files, one for the schema and one for the data in pure SQL commands. While you're at it put comments in there to flag any of the non-ANSI-SQL data types that MSSQL uses so we can process the thing into something sensible.
MSSQL Express is annoyingly limited. Where as PostgreSQL for example isn't and is also free. If that's overkill then what about something that can be used by SQLite libraries. It's cross platform and can be linked into anything.
EVE might be tied into Microsoft's monstrosity of a database but it doesn't mean that everyone else wants to be.
This. While I'm very happy that the new database dump is finally released, it is extremely... annoying that it was done in this way instead of f.e. the sql files like the previous dumps. ________ Invention profit calculator |
Ambo
Dirty Deeds Corp. Axiom Empire
|
Posted - 2008.07.30 21:32:00 -
[20]
Edited by: Ambo on 30/07/2008 21:32:59
Originally by: Meissa Anunthiel Edited by: Meissa Anunthiel on 30/07/2008 19:49:41
Originally by: Chruker congratulations of making such a bad choice on how to provide the dataexport \o/
seriously? just some bloody binary backup files that you cant do f.... with without havign a program installed on windows
At least the previous sql files could easily be morphed/read/transformed...
jezz
I, on the other hand, thank them very much for making a 1+ hour operation with previous exports (inconsistencies, missing definitions, NULL data in non nullable fields, files to large for the desktop edition to work, etc.) now take 1 minute tops.
In the unlikely event the gamer you are doesn't also have a windows installation to put the free version of SQL server to do an SQL export yourself, you'll have to wait, what? 2 days for others to post exports? [Edit: actually they're already available as of 1 hour ago, see OP...]
Jeez
Agreed, the new format is much easier for me.
Thank you. --------------------------------------
Trader? Investor? Just want to track your finances? Check out EMMA |
|
Kayn Otar
|
Posted - 2008.07.30 22:25:00 -
[21]
I love that CCP makes this data available. A thousand-times thank you.
But something doesn't smell right. If this is being done to promote the development of independent tools, then why are the data exports in a proprietary format? The SQL files could, at least, be converted to other formats.
Thank goodness for the Eve Development Network!
|
Azia Burgi
Caldari Science and Trade Institute
|
Posted - 2008.07.30 22:37:00 -
[22]
YAY! no more sleep for me for the next few days as I try to figure this mammoth out.
I nominate CCP Prism X for God.
Azia Burgi http://azia.geekandproud.co.uk BP Profit Calculator EVE Cemetery |
Batolemaeus
Caldari Free-Space-Ranger Morsus Mihi
|
Posted - 2008.07.30 22:40:00 -
[23]
Originally by: Azia Burgi
I nominate CCP Prism X for God.
Too late, he already won that title.
|
Chruker
|
Posted - 2008.07.30 23:35:00 -
[24]
Originally by: Batolemaeus
Originally by: Azia Burgi
I nominate CCP Prism X for God.
Too late, he already won that title.
nah, not since they decided to distribute binary files... ----- http://games.chruker.dk/eve_online ----- Top wishes: - No daily downtime - Faster training on sisi - Speedup IGB table rendering |
Batolemaeus
Caldari Free-Space-Ranger Morsus Mihi
|
Posted - 2008.07.31 01:13:00 -
[25]
Originally by: Chruker
nah, not since they decided to distribute binary files...
*pushes Chruker into the Pit™*
|
Eina Shadowlancer
Jovian Labs Jovian Enterprises
|
Posted - 2008.07.31 08:26:00 -
[26]
Hugs for Prism X and bunjiboy(s?)
|
Garia666
Amarr T.H.U.G L.I.F.E White Core
|
Posted - 2008.07.31 08:28:00 -
[27]
I think its very cool of CCP to give such info to the community.. thanks ccp.. www.garia.net |
|
CCP Prism X
Gallente C C P
|
Posted - 2008.07.31 10:54:00 -
[28]
Oh my me, we're still on page one. I must be slipping. At least I managed to include the good old OS wars discussion in this blog.
Anyways, I'm really sorry about those 404's there. I'm on vacation right now and wrote this up before leaving a couple of weeks ago. I'll be back in 100% capacity come next week and will find some opportunity to reply to other questions in here at that time. But there are two questions I'd like to answer now.
Why is crpNPCCorporationTrades missing? Well, it should really never have been included. This is basicaly meta-data and could allow people to get an advantage they couldn't otherwise get in game. Something like finding out what is being sold in regions they've never been in would be a good example. Finding the best possible trade routes through some datamining would be another. I'm sorry if the mismatch has wasted anyones time.
Why are you forcing me to use MS products! We're not really. Obviously some format had to be used and it has pros and cons for anyone involved. Using the same environment as our internal development environment makes everything very easy to maintain as well as offering us a very robust procedure to get this out with our expansions. My original idea was to include a non-official export as well but it became apparent that the robustness would suffer. If this format doesn't cut it for you in any way you can at least be glad that this data will now be released with expansions (I imagine it will be held back until we're sure we don't need to hotfix any live static data) and that still means you'll get your export from third parties a whole lot faster than.. a year. I see it as a win for everyone involved although people with no access to MS platforms might have to wait a tad longer than others. That being said I'd erally rather want to discuss the export and it's uses rather than go into the oldest discussion in the industry.
Take care, I'll drop by after the weekend, if not sooner.
~ Prism X EvE Database Developer Relocating your character to a cozy, secure container since 2006. Relocating your cozy, secure container to the EVE cemetery since 2008. |
|
Gilgamoth
Eldritch Storm The Matari Consortium
|
Posted - 2008.07.31 12:24:00 -
[29]
Thanks for all the hard work Prism X. Anything is better than nothing
Regards,
Gil
Live on Eden Underground Radio every Wednesday 19:00 - 21:00 GMT. |
Cesar Malari
Gunfleet Logistics
|
Posted - 2008.07.31 14:12:00 -
[30]
Originally by: CCP Prism X Why is crpNPCCorporationTrades missing? Well, it should really never have been included. This is basicaly meta-data and could allow people to get an advantage they couldn't otherwise get in game. Something like finding out what is being sold in regions they've never been in would be a good example. Finding the best possible trade routes through some datamining would be another. I'm sorry if the mismatch has wasted anyones time.
Well, I don't think it could help find "best possible trade routes", as it doesn't have the day-to-day pricing fluxuations, but I can see why you might be concerned. Any thoughts on adding something to the item database that at least uses that data to list the companies that sell a particular item? Sometimes when you're building a POS or need a specific skill, it's hard to remember where it is you have to go to pick it up. At least knowing a corp name, we could use existing tools. |
|
|
|
|
Pages: [1] 2 3 :: one page |
First page | Previous page | Next page | Last page |