EVE Search - LP Store in SQL format -- v0.1

All Channels

EVE Technology Lab

LP Store in SQL format -- v0.1

» Click here to find additional results for this topic using Google

Monitor this thread via RSS [?]

Pages: 1 2 3 4 :: [one page]
Author	Thread Statistics \| Show CCP posts - 0 post(s)
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 50	Posted - 2013.01.23 21:42:00 - [1] - Quote Hello thar fellow internet spaceship pilot! I have created 2 database tables that represent information regarding the LP store: the actual LP store offers and the required items for said store offers. Do with it what you please. I was looking for this for a project, couldn't find it, so I made one and am releasing it. ISK donations are welcome if you find the data useful. =) tl;dr: lpDatabase.zip v0.1 Changelog: v0.1 - initial release. Data might not be up to par. NEED TESTERS History Recently, I needed to be able to take LP Store offers and manipulate the data for a project I'm working on. So I went on a trek to find the database somewhere. CCP doesn't include this information in their dump, so I figured surely someone, somewhere would have made one and posted a SQL file. Alas, turns out I was wrong (or maybe my GoogleFu was not up to par). The only hits I got back were the likes of the LP Store Database (http://www.ellatha.com/eve/LP_Stores.asp) and, indirectly, http://games.chruker.dk/eve_online/default.php (I didn't find an LP store, but most LP items show their requirements on their respective item page) The problems with these sites was that they were not available in SQL format, and attempts to contact them for it did not work. I cannot work with webpage data - I need it in cold, hard SQL! I finally came across usable data, thanks to Zanto Snix and his Google Doc (link). It looked like a scrape from Ellatha's LP Store site, and seemed to be more or less complete. And I can download to a .csv file! Now I have real data, and a real file format to work with. But it can't end there The Google Doc (and indeed, most LP stores out there) was fairly outdated. Some of the LP store offers did not have typeIDs, you couldn't find some of the required items in the database, and then there were just plain typos and duplicates. The majority of the issues stems from the recent module name changes. Anyway, to correct these issues I set up a web app that would parse the CSV file and, if it ran into an issue (couldn't find item in database, possible typos/bad format, etc), it would let me know and present a form to correct it. Worked out pretty well, but still took quite a while. After I finally finished with that part, I tried to cross reference all LP store offers with chruker.dk/eve_online and then remove duplicate entries. Once that was done, it was a matter of parsing the file into MySQL. I'm sure there's some of you that would appreciate this data, so I'm making it available. However, I need help in 1) verifying the information is correct, and 2) keeping the database up to date. It's not often CCP adds or removes items in the database, however it could happen, so if you notice wrong information or items that need adding, post them here (with proof (image) preferably) and I'll correct it asap and post a new file.
Golden Gnu EVE University Ivy League 81	Posted - 2013.01.26 18:13:00 - [2] - Quote @Sable Blitzmann That is awesome! Thank you for creating it and releasing it to all of us! Even more so if you'll continue to maintain it... :) It's sad it's not included in the SDE, really. Download is the meaning of life, upload is the meaning of intelligent life http://eve.nikr.net - home of jEveAssets
Desmont McCallock 284	Posted - 2013.01.26 21:18:00 - [3] - Quote I just got me a copy of it. Hmmmm, I'm really tempted into adding an LP store browser in EVEMon. I'll scan the data and see what's possible. Maybe I'll even release an MSSQL version. Thanks anyways for the work done.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 51	Posted - 2013.01.26 23:49:00 - [4] - Quote Thanks! I already know of a few inaccuracies (mostly stuff like clothing that was not in the original data). Unfortunately, without help from others, I won't be able to keep it up to date. But please, if you find something wrong with it, let me know! It's easy to see what LP offers are happening when yo're docked. I may try to get a human-readable version online somewhere so that more people can check it. Hope you guy's can use the data!
Steve Ronuken Fuzzwork Enterprises 1110	Posted - 2013.01.31 04:00:00 - [5] - Quote Great data, thanks for making it available. I've played with it a bit, and worked it together with the pricing data I'm gathering (I think I need to work on the caching a little, to reduce the load and speed it up. But that's all behind the scenes stuff) to produce a calculator for working out what is worth buying. It falls down on the blueprints and similar items which aren't on the market. Or have components which aren't on the market. http://www.fuzzwork.co.uk/lpstore/ FuzzWork Enterprises http://www.fuzzwork.co.uk/ Blueprint calculator, invention chance calculator, isk/m3 Ore chart-á and other 'useful' utilities.As well as mysql and CSV/XLS conversions of the Static Data Extract.
Steve Ronuken Fuzzwork Enterprises 1116	Posted - 2013.01.31 14:02:00 - [6] - Quote First couple of issues: Starbase charters come in packs of 100. There's a couple of places where stores have a quantity of 1. You get Customs Gantry blueprints from the LP store, not Customs Gantries. FuzzWork Enterprises http://www.fuzzwork.co.uk/ Blueprint calculator, invention chance calculator, isk/m3 Ore chart-á and other 'useful' utilities.As well as mysql and CSV/XLS conversions of the Static Data Extract.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 51	Posted - 2013.01.31 16:54:00 - [7] - Quote Steve Ronuken wrote: First couple of issues: Starbase charters come in packs of 100. There's a couple of places where stores have a quantity of 1. You get Customs Gantry blueprints from the LP store, not Customs Gantries. Just saw your post on Reddit. Wonderful work! I replied with a few questions of my own, I'd be interested in hearing your reply. Thank you for reporting on some inaccuracies. I'll look into them and release a point release soon. =)
Ydnari Estrale Frontiers Project Wildfire 145	Posted - 2013.01.31 18:07:00 - [8] - Quote Very nice. Just started looking at this, found a couple of things. Caldari Navy Stasis Webifier Blueprint has repeated Federation Navy Fleet Major Insignia I instead of Federation Navy Fleet Colonel Insignia I x21 update lpRequiredItems set typeID = 15594 where parentID in (5533, 5532, 5531, 5524, 5536, 5538, 5526, 5527, 5534, 5528, 5525, 5530, 5537, 5523, 5529, 5535) and typeID = 15593 and quantity = 21; There's some duplicate offers for same item in same corp in there. And there's definitely some 5% implants with the costs repeated as for 1% and 3%, for example Zainou 'Gnome' Launcher CPU Efficiency LE-605 but I think that's been mentioned on the reddit thread and here already. For what it's worth I wanted the data turned around slightly, so I created three tables and populated them from your data - this process helped to shake out some of the duplicates too: lpOffer - one row per unique reward / LP / ISK / items combination lpOfferRequiredItem - 0, 1 or many rows for items for an offer lpStore - corporation, offer ID That way the isk/lp/items isn't repeated per corporation, since there's a load of shared offers across corporations with the same requirements. What do you think? I've knocked up a script that converts from your format to mine anyway, don't want to get in the way of getting the source data cleaned up.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 52	Posted - 2013.01.31 23:23:00 - [9] - Quote Ydnari wrote: Very nice. Just started looking at this, found a couple of things. Caldari Navy Stasis Webifier Blueprint has repeated Federation Navy Fleet Major Insignia I instead of Federation Navy Fleet Colonel Insignia I x21 update lpRequiredItems set typeID = 15594 where parentID in (5533, 5532, 5531, 5524, 5536, 5538, 5526, 5527, 5534, 5528, 5525, 5530, 5537, 5523, 5529, 5535) and typeID = 15593 and quantity = 21; There's some duplicate offers for same item in same corp in there. And there's definitely some 5% implants with the costs repeated as for 1% and 3%, for example Zainou 'Gnome' Launcher CPU Efficiency LE-605 but I think that's been mentioned on the reddit thread and here already. For what it's worth I wanted the data turned around slightly, so I created three tables and populated them from your data - this process helped to shake out some of the duplicates too: lpOffer - one row per unique reward / LP / ISK / items combination lpOfferRequiredItem - 0, 1 or many rows for items for an offer lpStore - corporation, offer ID That way the isk/lp/items isn't repeated per corporation, since there's a load of shared offers across corporations with the same requirements. What do you think? I've knocked up a script that converts from your format to mine anyway, don't want to get in the way of getting the source data cleaned up. Thanks for the info! Yeah, implants are a mess. I've already fixed the LE-605, along with a few other things. My alt is sitting in Jita, I'll verify the CN Stasis Webifier bit and fix it Your way of storing the data is interesting. I was going to lay out the data the way (or similar) however I don't knjavascript:if (typeof posting=='undefined'\|\|posting!=true) {posting=true;__doPostBack('forum$ctl00$PostReply','');}ow just how uniform all the LP store offers are across the board. For example, customs offic gantry blueprints are 3,000/10,000,000 at the 4 FW LP Stores, but double the price at CONCORD (and that's confirmed). So I'm reluctant to group offers together like that until they can be verified. Then again, CONCORD (and the FW) stores are kinda unique; I'm sure the vast majority of offers are duplicates. I would be interested in that script if you could post it. I may be able to use it. Also, what do you mean by this: Quote: There's some duplicate offers for same item in same corp in there. I thought I removed all the duplicates. =(
Ydnari Estrale Frontiers Project Wildfire 145	Posted - 2013.02.01 11:35:00 - [10] - Quote Sable Blitzmann wrote: I would be interested in that script if you could post it. I may be able to use it. tables: http://pastebin.com/raw.php?i=9BSTQWLQ script (Perl): http://pastebin.com/raw.php?i=hf18kJ6j needs your tables renaming to "oldLpStore" and "oldLpRequiredItems" before running Sable Blitzmann wrote: Also, what do you mean by this: Quote: There's some duplicate offers for same item in same corp in there. I thought I removed all the duplicates. =( Looks like in the end there's only one - EE-605 for Mordu's Legion, the offer looks right but there's two of them (ids 1992, 4039).
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 52	Posted - 2013.02.01 18:34:00 - [11] - Quote Ydnari wrote: Sable Blitzmann wrote: I would be interested in that script if you could post it. I may be able to use it. tables: http://pastebin.com/raw.php?i=9BSTQWLQ script (Perl): http://pastebin.com/raw.php?i=hf18kJ6j needs your tables renaming to "oldLpStore" and "oldLpRequiredItems" before running Sable Blitzmann wrote: Also, what do you mean by this: Quote: There's some duplicate offers for same item in same corp in there. I thought I removed all the duplicates. =( Looks like in the end there's only one - EE-605 for Mordu's Legion, the offer looks right but there's two of them (ids 1992, 4039). Ah, thanks. I'll definitely look into it. =)
Paitre Center for Advanced Studies Gallente Federation 0	Posted - 2013.02.03 04:45:00 - [12] - Quote The FW and Concord stores are definitely 'off' - that can be seen looking at the table that Steve Ronuken has up off fuzzworks. This dump is really helpful, overall - but I still can't get past the idea that there's still going to have to be a manual validation of the data, and that's just looking to be incredibly painful. Pretty sure we can make some general assumptions - there are the FW corps which have 'different' values for their LP stores, CONCORD is pretty much separate, as well, within each faction you have different corp arch-types, with multiple corps having the effectively the same LP stores. Of course, this does raise the question regarding whether or not it's worth too much effort to take their vagaries into consideration, beyond default values :)
Golden Gnu EVE University Ivy League 81	Posted - 2013.02.03 10:59:00 - [13] - Quote I wonder if the LP stores is somewhere in the cache/client files? Would make it so much easier to validate... I would rather write a tool to do the boring work, then do it by hand... not that I'm volunteering or anything :P Download is the meaning of life, upload is the meaning of intelligent life http://eve.nikr.net - home of jEveAssets
Steve Ronuken Fuzzwork Enterprises 1119	Posted - 2013.02.03 18:08:00 - [14] - Quote I'm slowly doing a little confirmation of the stores. 2 done so far (State Protectorate, Modern Finances) I'm putting my notes into: https://docs.google.com/spreadsheet/ccc?key=0As88qKwn3d59dEV5UDJKQVBnMV9QbEhabjdiY1ZwNUE#gid=0 But it's just notes, rather than something you can automate off. If anyone wants to validate a store, I'd suggest copying it all off into a google spreadsheet then doing a side by side comparison, marking any discrepancies. If you send it over to me, I'll update appropriately. FuzzWork Enterprises http://www.fuzzwork.co.uk/ Blueprint calculator, invention chance calculator, isk/m3 Ore chart-á and other 'useful' utilities.As well as mysql and CSV/XLS conversions of the Static Data Extract.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 53	Posted - 2013.02.03 23:09:00 - [15] - Quote Golden Gnu wrote: I wonder if the LP stores is somewhere in the cache/client files? Would make it so much easier to validate... I would rather write a tool to do the boring work, then do it by hand... not that I'm volunteering or anything :P I do not think the info is available in the Cache, otherwise someone would have done something like this by now. I agree, it would make it so much easier. If someone who is familiar with the cache/client files wants to look into this or provide a little more insight, that's be great. Steve Ronuken wrote: I'm slowly doing a little confirmation of the stores. 3 done so far (State Protectorate, Modern Finances,Royal Amarr Institute) I'm putting my notes into: https://docs.google.com/spreadsheet/ccc?key=0As88qKwn3d59dEV5UDJKQVBnMV9QbEhabjdiY1ZwNUE#gid=0 But it's just notes, rather than something you can automate off. If anyone wants to validate a store, I'd suggest copying it all off into a google spreadsheet then doing a side by side comparison, marking any discrepancies. If you send it over to me, I'll update appropriately. Thanks for the help! I've set up a quick web app that helps with the process. I check each item in the in-game store with the web app, and if it's the same I can just remove it from the DOM. If it needs to be changed, it presents the store ID and stuff. I also have a query running on each item that checks the other costs and if there's differences it tells me so I can investigate. So it helps a bit. If you can be a bit more accurate or detailed with your notes (such as every change you make with IDs and stuff) that'd be much easier to follow. I'll be putting up updated dumps tonight.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 53	Posted - 2013.02.03 23:10:00 - [16] - Quote Steve Ronuken wrote: If anyone wants to validate a store, I'd suggest copying it all off into a google spreadsheet then doing a side by side comparison, marking any discrepancies. If you send it over to me, I'll update appropriately. Also, what do you mean by copying it to a spreadsheet? I thought I tried copying the LP store to clipboard and it didn't work...
Steve Ronuken Fuzzwork Enterprises 1120	Posted - 2013.02.03 23:37:00 - [17] - Quote Sable Blitzmann wrote: Steve Ronuken wrote: If anyone wants to validate a store, I'd suggest copying it all off into a google spreadsheet then doing a side by side comparison, marking any discrepancies. If you send it over to me, I'll update appropriately. Also, what do you mean by copying it to a spreadsheet? I thought I tried copying the LP store to clipboard and it didn't work... I was meaning copy the web page (from mine. guess I should have been clearer. Or posted in my own thread. oops.) into a spreadsheet. because from there, you can make notes more easily. I've added an extra table just to maintain a list of which stores I've gone through and checked.. But that's not an important one. Anyway, some sql. Those three stores looked pretty close to right. corporationids of: 1000180, 1000077, 1000030. Don't just cut and paste it. The lpRequiredItems insert depends on the id inserted in the row before. It's because of the missing Caldari heavy assault missile launcher from the modern finances store. update lpStore set lpcost=1850,iskcost=1850000 where typeid=27315; insert into lpStore (corporationid,typeid,quantity,lpcost,iskcost) values (1000030,28377,1,24000,9600000); insert into lpRequiredItems (parentid,typeid,quantity) select 28779,typeid,quantity from lpRequiredItems where parentid=8791; update lpRequiredItems set typeID=15594 where parentid=5525 and quantity=21; update lpRequiredItems settypeid=17244 where parentid=6228; update lpRequiredItems set typeid=17244 where parentid=6228; update lpStore set typeid=24641,iskcost=10875000,lpcost=10875 where id=3762; FuzzWork Enterprises http://www.fuzzwork.co.uk/ Blueprint calculator, invention chance calculator, isk/m3 Ore chart-á and other 'useful' utilities.As well as mysql and CSV/XLS conversions of the Static Data Extract.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 53	Posted - 2013.02.04 08:15:00 - [18] - Quote v0.2 is posted in OP. Verified corps (personally): - University of Calle - Mordu's Legion - CONCORD - Modern Finances - Lai Dai Protection Service Along with various fixes.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 53	Posted - 2013.02.13 03:51:00 - [19] - Quote Uploaded v0.3. Biggest thing here is that all 4 FW militia stores are now verified Verified in v0.3: - Ytiri - State Protectorate - FedMart - Chemal Tech - 24th Imperial Crusade - Federal Defense Union - Tribal Liberation Force
Steve Ronuken Fuzzwork Enterprises 1144	Posted - 2013.02.13 04:29:00 - [20] - Quote Sable Blitzmann wrote: Uploaded v0.3. Biggest thing here is that all 4 FW militia stores are now verified Verified in v0.3: - Ytiri - State Protectorate - FedMart - Chemal Tech - 24th Imperial Crusade - Federal Defense Union - Tribal Liberation Force I've just updated to your latest version. Thanks a bunch for doing this. Even if you gave me a minor heart attack by changing it to storeid rather than id FuzzWork Enterprises http://www.fuzzwork.co.uk/ Blueprint calculator, invention chance calculator, isk/m3 Ore chart-á and other 'useful' utilities.As well as mysql and CSV/XLS conversions of the Static Data Extract.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 55	Posted - 2013.02.19 02:42:00 - [21] - Quote Update: Trying to figure out which corps are more popular so as to have a more focused verification process. I will be verifying the 4 navies next, and Lai Dai was also suggested for the research agents. In the mean time, I have been working on my own ISK/LP conversion site. \o/
Steve Ronuken Fuzzwork Enterprises 1169	Posted - 2013.02.19 04:31:00 - [22] - Quote Sable Blitzmann wrote: I have been working on my own ISK/LP conversion site. \o/ \o/ Always worth having more than version kicking around. And this way, I don't need to feel guilty for anything. FuzzWork Enterprises http://www.fuzzwork.co.uk/ Blueprint calculator, invention chance calculator, isk/m3 Ore chart-á and other 'useful' utilities.As well as mysql and CSV/XLS conversions of the Static Data Extract.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 55	Posted - 2013.02.19 18:12:00 - [23] - Quote Steve Ronuken wrote: Sable Blitzmann wrote: I have been working on my own ISK/LP conversion site. \o/ \o/ Always worth having more than version kicking around. And this way, I don't need to feel guilty for anything. Oh good, so I won't have to feel guilty for using your EMDR script to fuel it either. =P Credit where credit it due tho, thanks for introducing me to EMDR. This thing kicks ass! On to the topic at hand, I was asking around in the missioning forum which corps are popular so that they can be verified, where one pilot (Carniflex) said that each faction basically has 3 different types of stores: military, industrial, and exploration, and that the corps that use each store should be more or less the same. I tested this out by showing the four main factions and their corps, along with the number of LP Store offers in each corp. I figure if a corp has the same number of LP offers, then it's a good chance they share the same LP Store. This is fairly useful information and does show a lot of similarities, however it's not as cut and dry as "3 variations per faction". I will, however, be using this as a guide. What this means is that I will use a verified corp to verify another corp without visiting the store ingame. This will cut down the time it takes to verify as I can just tab between two tabs in quick succession to find any discrepancies between two like corps. For example, I've already verified Modern Finances, and I see that Caldari Business Tribunal, Expert Distribution, Prompt Delivery, etc have similar stores (145 items each). I can use Modern Finances as a template for the verification of those corps. However, this of course opens up the possibility of errors as they will not be completely verified, only verified by relation. Such errors include missing items, added items, incorrect isk/lp cost or req items... However, from what I've seen so far with verification, lp/isk cost remains stable between the corps, as does req items, so the chance of an LP store differentiating is slim. I will also be adding a column in `lpVerified` denoting how the corp was verified: 1 will be manual verification and 2 will be verification by relation to a like corp.
Feanos Minmatar Ship Construction Services Ushra'Khan 3	Posted - 2013.02.20 11:07:00 - [24] - Quote So, as someone who was doing this before UK left FW, mostly for grins, if you want, I've got a copy of my internal DB with the information for the various corpID's: sqlite> select distinct(corpID) from corpOffers; 1000002 1000010 1000019 1000033 1000049 1000053 1000054 1000055 1000057 1000059 1000062 1000067 1000072 1000074 1000079 1000082 1000083 1000086 1000093 1000094 1000100 1000104 1000130 1000160 1000165 1000172 1000179 1000182 There's, in general, three main LP store types for the various factions, from my research/testing: FW - Mostly military/Datacores Combat - This is your standard L4 combat bread/butter R&D - These give those nice little datachips for making ships that everyone likes If you're interested in the data I farmed, it's SQLite, with the following formatting: sqlite> .schema CREATE TABLE corpOffers( corpID INTEGER NOT NULL, offerID INTEGER NOT NULL); CREATE TABLE offers( offerID INTEGER NOT NULL, typeID INTEGER NOT NULL, iskCost INTEGER NOT NULL, lpCost INTEGER NOT NULL, reqItems TEXT, qty INTEGER NOT NULL, PRIMARY KEY(offerID), UNIQUE(offerID)); Located at: http://snipanet.com/lpdb.db Offers are unique to what they give/etc, so you end up with a relatively small offers table, with the corpOffers pushing data into this fairly readily, also makes it really easy to look up with some relatively clean joins. I'll see about dumping more corp data into this when I get a chance. There's been a cloaky in my system all day, so I'll get an alt busy soonish :D
Ydnari Estrale Frontiers Project Wildfire 153	Posted - 2013.02.20 23:31:00 - [25] - Quote a quick one: some duplicates snuck back in delete from lpStore where storeID in (6827, 6826, 28784); consider: select s.corporationID, s.typeID, s.quantity, s.lpCost, s.iskCost, group_concat(i.typeID), group_concat(distinct s.storeID) from lpstore.lpStore s left outer join lpstore.lpRequiredItems i on (s.storeID = i.parentID) group by s.corporationID, s.typeID, s.quantity, s.lpCost, s.iskCost having count(distinct s.storeID) > 1 which catches any exact duplicates
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 55	Posted - 2013.02.21 00:20:00 - [26] - Quote Ydnari wrote: a quick one: some duplicates snuck back in delete from lpStore where storeID in (6827, 6826, 28784); consider: select s.corporationID, s.typeID, s.quantity, s.lpCost, s.iskCost, group_concat(i.typeID), group_concat(distinct s.storeID) from lpstore.lpStore s left outer join lpstore.lpRequiredItems i on (s.storeID = i.parentID) group by s.corporationID, s.typeID, s.quantity, s.lpCost, s.iskCost having count(distinct s.storeID) > 1 which catches any exact duplicates Thanks! I already found and fixed the Quafe and Senate duplicates (both had 2 Fed Navy 100MN MWD and were missing a 10MN MWD). Thank you for letting me know about the CONCORD duplicate; just goes to show even verified corps have issues x_x. I've deleted the duplicate, and will most likely release v0.4 tonight/tomorrow with over 100 corps vverified (using the new template method described above) Awesome query as well. Will definitely save it and go back to it regularly.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 55	Posted - 2013.02.21 01:02:00 - [27] - Quote Updated OP with new version (v0.4). Also, here's a nifty image: http://eve-files.com/dl/260764 the 4 main factions and their verification progress. Green is verified, purplish is verified with template. This does not include smaller factions (Mordu's Legion, etc) because I'm lazy. Verified: - Brutor Tribe - Joint Harvesting - Theology Council - Six Kin Development - Lai Dai Protection Service - School of Applied Knowledge Verified via Relation: - CBD Corporation - Prompt Delivery - Hyasyoda Corporation - Deep Core Mining Inc. - Poksu Mineral Group - Minedrill - Caldari Provisions - Kaalakiota Corporation - Wiyrkomi Corporation - Top Down - Rapid Assembly - Perkone - Caldari Steel - Zainou - Nugoeihuvi Corporation - Echelon Entertainment - Ishukone Corporation - Zero-G Research Firm - Propel Dynamics - Expert Distribution - CBD Sell Division - Sukuuvestaa Corporation - Caldari Constructions - Expert Housing - Caldari Funds Unlimited - State and Region Bank - Chief Executive Panel - Mercantile Club - Caldari Business Tribunal - House of Records - Science and Trade Institute - Sebiestor Tribe - Republic Fleet - Republic Justice Department - Republic Security Services - Minmatar Mining Corporation - Core Complexion Inc. - Boundless Creation - Eifyr and Co. - Native Freshfood - Carthum Conglomerate - Imperial Armaments - Viziam - Zoar and Sons - Noble Appliances - Ducia Foundry - HZO Refinery - Inherent Implants - Amarr Certified News - Nurtura - Further Foodstuffs - Royal Amarr Institute - Imperial Chancellor - Amarr Civil Service - Ministry of Assessment - Amarr Trade Registry - Court Chamberlain - Emperor Family - Kador Family - Kor-Azor Family - Ardishapur Family - Civic Court - TransStellar Shipping - Federal Freight - Inner Zone Shipping - Material Acquisition - Astral Mining Inc. - Combined Harvest - Quafe Company - CreoDron - Roden Shipyards - Allotek Industries - Poteque Pharmaceuticals - Impetus - Egonics Inc. - The Scope - Aliastra - Bank of Luminaire - Garoun Investment Bank - President - Senate - Supreme Court - Federal Administration - Hedion University - Center for Advanced Studies - Republic Military School - Republic University
Ydnari Estrale Frontiers Project Wildfire 153	Posted - 2013.02.21 02:33:00 - [28] - Quote I've gone through the data and the store in-game for Federation Navy and found no errors or omissions. This should verify Federation Intelligence Office and Federation Customs as well; I use those stores a lot and have never noticed any difference. Can't speak for Federation Navy Academy, it's probably the same but haven't checked, I haven't got any LP with them.
Skalarik Republic Military School Minmatar Republic 1	Posted - 2013.02.21 14:28:00 - [29] - Quote Hi, nice job you've done here. For your next db-dump, would it be possible to limit the 'INSERT INTO ...' statements to insert max. 1000 rows per statement? I work with MsSql and Oracle databases (XE versions) and these can't take more than 1000...if not, well i'll just continue to insert them manually.
Tonto Auri Vhero' Multipurpose Corp 25	Posted - 2013.02.21 17:45:00 - [30] - Quote Even a thousand rows is a big number. Better split them in packs of 50-100 rows, with intemittent commits.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 55	Posted - 2013.02.21 19:41:00 - [31] - Quote Skalarik wrote: Hi, nice job you've done here. For your next db-dump, would it be possible to limit the 'INSERT INTO ...' statements to insert max. 1000 rows per statement? I work with MsSql and Oracle databases (XE versions) and these can't take more than 1000...if not, well i'll just continue to insert them manually. Will do. =)
Neugeniko Insight Securities 12	Posted - 2013.03.04 15:02:00 - [32] - Quote This is excellent! A little while back I was looking for this data to work out isk/lp. It seems like a few people are working on this already, so ill do what I can to help with the core data. Torrinos system is pretty popular for mission runners seeking a caldari 0.5 system with a few lvl 4 agents. Homegaurd and Spacelane patrol LP stores are there, ill compare these to the data up on fuzzworks and see if its accurate. Neug
Neugeniko Insight Securities 12	Posted - 2013.03.05 21:35:00 - [33] - Quote Compared the data on Fuzzworks to actual LP Store for Home Gaurd. Omissions ========= [1 x Zainou 'Snapshot' Rockets RD-905],[79,375 LP],[79,375,000 ISK] [Caldari Navy Dual 150mm Railgun],[24,000 LP],[9,600,000 ISK] 1 x Dual 150mm Railgun I 63 x Federation Navy Fleet Captain Insignia I 106 x Federation Navy Fleet Major Insignia I [1 x Zainou 'Gypsy' Target Painting TG-905],[79,375 LP],[79,375,000 ISK] [1 x Zainou 'Gypsy' Target Painting TG-903],[10,875 LP],[10,875,000 ISK] [1 x Zainou 'Gypsy' Target Painting TG-901],[375 LP],[375,000 ISK] Taking these into consideration I also checked Spacelane Patrol, LP store is exactly the same as Home Gaurd. Hope this helps. Neug
DaOpa Static Corp 9	Posted - 2013.04.05 18:41:00 - [34] - Quote Hundreds of hours of personal work to generate LP Store DB, only to be undone by a scraper and others who are republishing scraped data ..... I'm lost for words.... DaOpa's EVE Fansite \|\|Wormhole Database / Wormhole Systems Lookup Tool \|\|Live Streamer at twitch.tv/daopa
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 62	Posted - 2013.04.06 00:34:00 - [35] - Quote DaOpa wrote: Hundreds of hours of personal work to generate LP Store DB, only to be undone by a scraper and others who are republishing scraped data ..... I'm lost for words.... I appreciate the work you put into Ellatha, and it had been a great resource, however I'm not gonna mince words: it is fairly outdated with errors and, the biggest of all, proprietary which makes it useless for anything but simple lookups. I needed something tangible to manipulate, and I assume Zanto Snix did as well. Sorry if you feel slighted. =( In other news, I took a smalk break from EVE, and thus from this project, which explains lack of posts. But I have verified a few more corps and will be releasing the next version sometime soon. \o/ progress
Tonto Auri Vhero' Multipurpose Corp 55	Posted - 2013.04.06 12:01:00 - [36] - Quote Sable Blitzmann wrote: DaOpa wrote: Hundreds of hours of personal work to generate LP Store DB, only to be undone by a scraper and others who are republishing scraped data ..... I'm lost for words.... I appreciate the work you put into Ellatha, and it had been a great resource, however I'm not gonna mince words: it is fairly outdated with errors and, the biggest of all, proprietary which makes it useless for anything but simple lookups. Even for simple lookups, it was hardly useful. My every attempt to narrow search to at least a single page of results failed in the past.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 62	Posted - 2013.04.14 23:43:00 - [37] - Quote v0.5 is out, OP updated. This release took much longer than I had hoped, but as previously stated I took about a month long break from EVE. 85% of the corps are now verified, the remaining ones are mostly the small factions. Achievements: - Minmatar faction completely verified. - SOE verified (since a lot of missioners like SOE, figured this was a priority) - Got a couple nullsec factions verified without my alts dying in their shuttle! \o/ v0.5 - More verifications. Nothing new. Added: - MP-805 added to Caldari Navy store - Caldari Navy Dual 150mm Railgun (typeID = 15815) added to some Caldari corps - Federation Customs seems to be the same LP store as the fed navy, but was missing a chunk of items (BY-810, SE-605, EG-605, EE-605, PJ-805, SA-705). Added these items after verifying they do indeed exist in LP store (then verified LP store with relation to Fed Navy) - Ocular Filter - Standard/Improved to Intaki Commerce and Bank - WD-901 to Amarr Navy Fixed: - Mega Navy Issue for non-FW stores (storeID: 151, 153, 157, 156), changed iskCost (20000000 -> 200000000) - storeID: 9389 & 9390 (iskCost: 16200, lpCost: 10800000) (verified with Trust Partners, not Thukker Mix) - typeID: 28817 (iskCost 13400000 -> 113400000) for Intaki faction - typeID: 28819 (iskCost 14200000 -> 214200000) for Intaki faction - Required typeID: 16183 (set all quantities to 5 instead of mix of 1 & 5) - Large Blaster/Rail Spec lpCost (3000 -> 9000) for Intaki faction Verified: - Caldari Navy - Federation Navy - Duvolle Laboratories - Sisters of EVE - Pator Tech School - Trust Partners - Intaki Bank - Outer Ring Excavations - Imperial Academy - Intaki Syndicate Verified via Relation: - Spacelane Patrol - State War Academy - Wiyrkomi Peace Corps - Peace and Order Unit - Internal Security - Ishukone Watch - Home Guard - Corporate Police Force - Federal Navy Academy - Federal Intelligence Office - Federation Customs - The Sanctuary - Food Relief - Vherokior Tribe - Urban Management - The Leisure Group - Republic Parliament - Krusual Tribe - Freedom Extension - Intaki Commerce - Sarum Family - Ministry of Internal Order - Ministry of War - Amarr Navy - Intaki Space Police
Uppsy Daisy 24th Imperial Crusade Amarr Empire 243	Posted - 2013.04.15 22:17:00 - [38] - Quote Now that is dedication.. I salute you/
Jess Technite Almost Absolute 0	Posted - 2013.04.25 00:42:00 - [39] - Quote Working with your database have discovered an error with a CONCORD offer (not verified all, only this ID, and only by Ellatha, so no sure if in-game is correct): SELECT * FROM LPStore WHERE typeID = 3963 This is the ID of the Blueprint, and indeed should be the ID of the item: UPDATE LPStore SET typeID = 3962 WHERE typeID = 3963 Ydnari wrote: Sable Blitzmann wrote: I would be interested in that script if you could post it. I may be able to use it. tables: http://pastebin.com/raw.php?i=9BSTQWLQ script (Perl): http://pastebin.com/raw.php?i=hf18kJ6j needs your tables renaming to "oldLpStore" and "oldLpRequiredItems" before running Sable Blitzmann wrote: Also, what do you mean by this: Quote: There's some duplicate offers for same item in same corp in there. I thought I removed all the duplicates. =( Looks like in the end there's only one - EE-605 for Mordu's Legion, the offer looks right but there's two of them (ids 1992, 4039). Seems nice... if you have MySQL XD. I use PostgreSQL and this is not possible (or I don't know how to do it), so when I have some time will do it in VB.NET 2010 for separate it in two tables (It's a personal software in this language), and will paste it here.
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 63	Posted - 2013.04.27 17:32:00 - [40] - Quote Just a heads up, the database schema will most likely be changing with the next release. I'm gonna base it mostly on Ydnari's approach (https://forums.eveonline.com/default.aspx?g=posts&m=2546104#post2546104). Since a lot of the data in the database is redundant, I aim to slim it up a bit. I'm doing this because my lpStore application (which I've been procrastinating with releasing, ugh) would benefit from it. Let me know if there's any concerns with this new approach Jess Technite wrote: The process that iterates all the original table have a duration of 45 minutes :S Really? Yikes! x_x
Steve Ronuken Fuzzwork Enterprises 1339	Posted - 2013.04.27 20:03:00 - [41] - Quote Let me guess Jess Technite, you added, umm, one index, and it sped it up? Anytime a DB app is slow, indexes will probably help Steve Ronuken for CSM 9!-á I'm starting early :) Handy tools and an SDE conversion Twitter: @fuzzysteve on Twitter
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 64	Posted - 2013.04.29 05:32:00 - [42] - Quote Put together the release with the database schema changes. Updated schema can be found here: http://pastebin.com/yxiMSeWJ Changelog: - The way that data has been laid out. NO ADDITIONAL VERIFICATION HAS TAKEN PLACE, this release is strictly an update to how the database is organized. - Each offer is now unique and stored in the `lpOffers` table. This reduces redundant information, making the data slighty more compact (which makes is slightly more faster) - Offers are linked to corps via `lpStore` - Required items are much the same (besdies now pointing to unique offers), the table has been relabeled as `lpOfferRequirements` - Included in this release is a table labeled `lpConversion`. This table documents the change from the old ID (storeID) to the new, combined ID (offerID). This table will not be inclded in future releases Updated OP with link to download
Jess Technite Almost Absolute 0	Posted - 2013.05.02 17:35:00 - [43] - Quote Sable Blitzmann wrote: Just a heads up, the database schema will most likely be changing with the next release. I'm gonna base it mostly on Ydnari's approach (https://forums.eveonline.com/default.aspx?g=posts&m=2546104#post2546104). Since a lot of the data in the database is redundant, I aim to slim it up a bit. I'm doing this because my lpStore application (which I've been procrastinating with releasing, ugh) would benefit from it. Let me know if there's any concerns with this new approach Jess Technite wrote: The process that iterates all the original table have a duration of 45 minutes :S Really? Yikes! x_x Nah, it's only Ydnari's approach in VB.NET code :) BTW, I don't know why the university (Software Engineering finished in January) decided to use PostgreSQL -¼-¼ Steve Ronuken wrote: Let me guess Jess Technite, you added, umm, one index, and it sped it up? Anytime a DB app is slow, indexes will probably help In fact, it's the same in three tables. When I iterate for calculating the LP/ISK ratio over all the rows, I only iterate over 1.584 rows (2 minutes) and not over the 29.070 (45 minutes) original ones. When the process is finished, I select the most worth and when I want to see their details, will query to the lpcorps with the offerID and also won't need to iterate over that huge amount of rows. More light :). But well, maybe that index in the lpCorps also plays his paper
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 65	Posted - 2013.06.04 02:14:00 - [44] - Quote Updated for Odyssey. Changelog: v0.5.2 - Navy Battlecruisers Added Another small point release as it doesn't contain any verifications, this release adds the new navy Battlecruisers introduced in Odyssey (from Odyssey 1.0 Patchnotes) Added: - All 4 Navy Battlecruisers - this process was automated by adding the battlecruisers to corporations already offering Navy cruisers - All 4 Navy Battlecruiser Blueprint copies were also added via the above method (using Built Cruisers ) - FW stores got their own offer with the discounted prices Changed: - Armageddon Navy Issue, Scorpion Navy Issue, Dominix Navy Issue, Typhoon Fleet Issue have had their LP cost increased to 250,000 LPs in the Factional Warfare LP Stores. Confirm: - There are a few corporations that offer mostly blueprints - I am not sure if they offer ship blueprints and if so if they offer the new navy BC blueprints. This needs to be confirmed, and if so, needs to be added
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 65	Posted - 2013.06.05 17:05:00 - [45] - Quote So, this snuck up in the expansion (thanks to Artemis Anva pointing it out) - Navy Cap Boosters are now available in sizes of 25, 50 and 75, which are available through FW LP Stores. - Navy Cap Booster 100 and 150 are now m-ore expensive when purchased in the LP Store. v0.5.2 does not cover these changes. I will have to look at them throughout the week when I get a chance, unless someone can provide screenshots of the new prices (remember, FW stores can vary in price from regular stores!). CCP didn't think it pertinent to include the new/updated prices in the patch notes
Sable Blitzmann Fweddit I Whip My Slaves Back and Forth 65	Posted - 2013.06.06 14:24:00 - [46] - Quote v0.5.3 is out with Navy Cap Booster changes for Odyssey. OP has been updated Changelog: v0.5.3 - Navy Cap Booster Changes This version includes the navy cap booster changes that shipped with Odyssey Added: - Navy cap booster 25, 50, and 75 added to FW LP Stores, cost: 60, 125, 185 in LP and 60000, 125000, 185000 isk respectively Changed: - Navy cap booster 100 and 150 prices raised to 250 and 375 lp and 250000 and 375000 isk respectively Confirm: - (from before) There are a few corporations that offer mostly blueprints - I am not sure if they offer ship blueprints and if so if they offer the new navy BC blueprints. This needs to be confirmed, and if so, needs to be added
Steve Ronuken Fuzzwork Enterprises 1495	Posted - 2013.06.06 16:20:00 - [47] - Quote bah, changed database structures make me have to rewrite SQL ah well, at least changes were highlighted that I needed to take care of. .= and += can lead to very different answers ;) (in case I've not mentioned it, https://github.com/fuzzysteve/lpstore it depends on a memcache DB for price data, but if you don't have it, it'd be simple enough to replace with, say, database calls. I wouldn't recommend hitting eve central or eve market data individually for each price. ) Steve Ronuken for CSM 9!-á I'm starting early :) Handy tools and an SDE conversion Twitter: @fuzzysteve on Twitter
Sable Blitzmann In Exile. Imperial Outlaws. 66	Posted - 2013.07.04 04:48:00 - [48] - Quote OP Updated Thanks to those who mailed me about the changes to Navy Cruisers in Odyssey (thanks CCP for not including that in the patch notes). Note: these changes only affect the FW stores. v0.6 - FW Navy Cruiser Fixes I decided to bump this release up to a 0.x point release even tho no verification has been done due to significant changes have been done since v0.5. It was brought to my attention that CCP changed the Navy Cruiser requirements and added blueprints for FW stores. Added: - 2x Blueprints for the previous tier1 cruisers have been added to each FW corp, with prices at 45000 LP and either 5000000 isk or a cruiser-class pirate tag Changed: - Previous Tier1 Navy Cruisers have had their LP cost increased to 45000 for FW corps to bring in line with other Navy cruisers
Chic Botany Pator Tech School Minmatar Republic 31	Posted - 2013.07.27 08:45:00 - [49] - Quote Kudos for doing this, and when I get my head round sql I'll have a look. The only gripe is WHY THE HELL DOESN'T CCP GIVE THIS INFORMATION FREELY IN THE DUMPS ETC, it's not like it's confidential info or anything.
Sable Blitzmann In Exile. Imperial Outlaws. 72	Posted - 2013.08.31 17:45:00 - [50] - Quote lpDatabase should be updated very soon after Odyssey 1.1 hits. I have all the changes queued, I just need to know the new typeIDs for the various new store items (gotta wait for the SDE to come out as I'm too lazy to gather it from the test server).
Sable Blitzmann In Exile. Imperial Outlaws. 73	Posted - 2013.09.02 23:00:00 - [51] - Quote Updated for Odyssey 1.1: http://dl.eve-files.com/media/1309/lpDatabase_v0.7.zip v0.7 - Odyssey 1.1 Odyssey 1.1 introduced new mindlinks to stores. This has obviously not been verified as it was all automated based on what CCP has stated in forum posts / patch notes Added: - Navy Mindlinks added to their respective stores for 100,000,000 isk / 100,000 lp. Per CCP, Navy Mindlinks were added to every racial store, including FW stores. I took all corps belonging to each of the four main factions and autmatically added their respective Mindlink (Imperial Navy Warfare Mindlink for all of Amarr faction with LP store). This has obviously not been verified as it was automated - Added T2 mindlinks to CONCORD LP Store for 20,000,000 isk / 20,000 LP
Steve Ronuken Fuzzwork Enterprises Vote Steve Ronuken for CSM 1858	Posted - 2013.09.03 13:17:00 - [52] - Quote I've been informed that for the Fed Navy Comet, it should be using an Incursus, rather than a Tristan Steve Ronuken for CSM 9!-á I'm starting early :) Handy tools and an SDE conversion Twitter: @fuzzysteve on Twitter
Sable Blitzmann In Exile. Imperial Outlaws. 73	Posted - 2013.09.03 17:27:00 - [53] - Quote Steve Ronuken wrote: I've been informed that for the Fed Navy Comet, it should be using an Incursus, rather than a Tristan Thank you. I've check a couple stations and this is indeed the case. I wonder if this was a recent change, because I remember it being Tristins
Jess Technite Almost Absolute 0	Posted - 2013.09.19 09:55:00 - [54] - Quote For all those that (like me) use PostgreSQL there's a conversion of the file published by Sable Blitzmann in #51: http://dl.eve-files.com/media/1309/lpDatabase.zip
Sable Blitzmann In Exile. Imperial Outlaws. 86	Posted - 2013.10.22 06:12:00 - [55] - Quote v0.7.1 - Cruiser BP Fixes Removed: - With v0.6, new Navy Cruiser BPCs were added to the FW store. Unfortunately, all BPCs were added to all FW stores. This removes the erronous entries. (Thanks Mr Turing!) Changed: - Fed Navy Comet required item changed from Tristan to Incursus (Thanks Steve!)
Sable Blitzmann In Exile. Imperial Outlaws. 86	Posted - 2013.11.16 04:51:00 - [56] - Quote Update for Rubicon 1.0: http://eve-files.com/dl/265883 v0.8 - Rubicon 1.0 Added: - Astero: 100,000LP/10,000,000ISK for SoE corp, and 80,000LP/5,000,000ISK for The Sanctuary - Astero BPC: 30,000LP/15,000,000ISK for SoE corp, and 20,000LP/10,000,000ISK for The Sanctuary - Stratios: 300,000LP/20,000,000ISK for SOE corp, and 240,000LP/15,000,000ISK for The Sanctuary - Stratios BPC: 120,000LP/30,000,000ISK for SoE corp, and 80,000LP/20,000,000ISK for The Sanctuary Also, OP is getting too big. Copying changelog to this post until I figure out what to do with it. I don't want to lose links to previous versions in case someone is interested in them for whatever reason. =) v0.8 - Update for Rubicon 1.0 v0.7.1 -Point release for fixes v0.7 - Updated for Odyssey 1.1 v0.6 - Fixes changes made in Odyssey v0.5.3 - Point release. Includes Navy Cap Booster changes/addition with Odyssey. v0.5.2 - Point release. Navy Battlecruisers added for Odyssey expansion! v0.5.1 - Point release. Database schema has changed to remove redundancy, please see this post for changes. v0.5 - Nothing really new with this release besides the continued fixes. v0.4 - With this release, I took the easy way out. As described here, I've started to use already-verified corps as a template for other verifications. Many corps in the game share the same LP store, and so I set up a script that would compare multiple corps to a template corp. Template corps are always manually verified. v0.3 - Second round of fixes include all 4 FW LP Stores. I tried to focus on them as they are very important in the LP Store business, and making sure that the data was correct was a priority (this also knocks out 4 of the biggest corps to verify \o/). v0.2 - First round of verification's and fixes tot he database. Some items are still out of whack, but I believe that some of the more glaring ones are under control now. I have personally verified 5 corps so far. That's a far cry from the few hundred that there are, but it's a start. v0.1 - initial release. Data might not be up to par. NEED TESTERS
Steve Ronuken Fuzzwork Enterprises Vote Steve Ronuken for CSM 2063	Posted - 2013.11.16 17:32:00 - [57] - Quote Thanks Steve Ronuken for CSM 9! http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter
Drailen ED-Technics 6	Posted - 2013.11.23 22:34:00 - [58] - Quote Been admiring this work for a while and would like to start using it, but...any chance of a version that doesn't require MySQL to be installed? CSV, MSSQL, SQLite would be great if it's available.
Sable Blitzmann In Exile. Imperial Outlaws. 92	Posted - 2013.11.23 23:37:00 - [59] - Quote Drailen wrote: Been admiring this work for a while and would like to start using it, but...any chance of a version that doesn't require MySQL to be installed? CSV, MSSQL, SQLite would be great if it's available. I've been floating the idea of making json version available which should be easy to then convert to any other format. This will give me an excuse to do that. I'll try to get something out by tomorrow. =)
Drailen ED-Technics 6	Posted - 2013.11.23 23:43:00 - [60] - Quote That would be great, thanks!
Sable Blitzmann In Exile. Imperial Outlaws. 93	Posted - 2013.11.24 03:23:00 - [61] - Quote http://eve-files.com/dl/266076 - added json directory. Every corp has it's own json file. Every offer is in the following format: offerID: -- typeID -- qty -- lpCost -- iskCost -- reqItems: (if applicable) ---- typeID : qty Also, I've update the SQL dump to also include a comment on the lpStore table that represents the version of the data. You can all this via SELECT table_comment FROM INFORMATION_SCHEMA.TABLES WHERE table_schema = :dbName AND table_name = lpStore
Drailen ED-Technics 6	Posted - 2013.11.24 18:25:00 - [62] - Quote JSON format works like a charm! Thanks for the quick update.
Taal Khurin Happy Asteroid Ltd 94	Posted - 2013.11.28 00:07:00 - [63] - Quote You completely ripped the http://www.ellatha.com/eve/LP_Stores.asp sites data that someone spent ages putting together and are now touting it as your own? For shame!
Mikokoel Mining Industry Exile Foundation HYDRA RELOADED 20	Posted - 2013.11.28 11:54:00 - [64] - Quote You fail to see that those LP websites from ellatha and chruker are outdated and that accessing their information needs complicated HTML scraping? He offers a well thought out database with up-to-date information, in various formats, and you think it's a rip-off? For shame! Mikokoel \| CEO of Mining Industry Exile Foundation \| EvE API Development:-á Leokokim \| PvP-Character
Steve Ronuken Fuzzwork Enterprises Vote Steve Ronuken for CSM 2092	Posted - 2013.11.28 12:25:00 - [65] - Quote Taal Khurin wrote: You completely ripped the http://www.ellatha.com/eve/LP_Stores.asp sites data that someone spent ages putting together and are now touting it as your own? For shame! You failed to see that the source of the information is all mentioned in the first post? Steve Ronuken for CSM 9! http://www.fuzzwork.co.uk/ Twitter: @fuzzysteve on Twitter
TestBox Center for Advanced Studies Gallente Federation 0	Posted - 2013.11.28 16:34:00 - [66] - Quote Mikokoel wrote: You fail to see that those LP websites from ellatha and chruker are outdated and that accessing their information needs complicated HTML scraping? He offers a well thought out database with up-to-date information, in various formats, and you think it's a rip-off? For shame! So lets use this in a different example - 1. Use a Robot to Scrap all of "http://eveboard.com/" characters (Chribba's awesome site). 2. Dump it into a excel spreadsheet and post it here. 3. Someone else converts that spreadsheet into SQL and other forms. find errors in some data and fixes it. 4. Makes a new thread saying Look I have awesome Character data for all you guys to use in various formats .. 5. Make a sight mention the data is from Chribba's site ... You find this alright for people to do?
Taal Khurin Happy Asteroid Ltd 94	Posted - 2013.11.28 23:10:00 - [67] - Quote Mikokoel wrote: You fail to see that those LP websites from ellatha and chruker are outdated and that accessing their information needs complicated HTML scraping? He offers a well thought out database with up-to-date information, in various formats, and you think it's a rip-off? For shame! I know the person that compiled all the data personally and they were in the process of updating it when they noticed your thread. They are still very active and were very miffed about it i can tell you.
Elmore Jones Nebula II 22	Posted - 2013.11.29 09:18:00 - [68] - Quote While I can understand that finding you have a rival project might be off putting, this kind of rage posting isn't helping. They're both working on the same information from the same game. It's going to be a very similar end result which in no way implies bot scraping from another persons effort. +++ Reality Error 404 - Reboot Cosmos +++
Leokokim Mining Industry Exile Foundation HYDRA RELOADED 2	Posted - 2013.11.29 14:18:00 - [69] - Quote TestBox wrote: 5. Make a sight mention the data is from Chribba's site ... You find this alright for people to do? You mean like here where it is in the second paragraph of the first page? (right below the TL:DR)
Sable Blitzmann In Exile. Imperial Outlaws. 93	Posted - 2013.11.29 23:56:00 - [70] - Quote Just to clear a few things up... I've made several mentions, in the original post, to where most of this data came from, and various method I used to obtain it. I never once claimed that I was the one that gathered it all. However, I believe it's a bit unfair to portray me as someone who is profiting off of someone else's work. - The original data was extremely out of date. I wish I kept a count on the inaccuracies I found when I was preparing for initial release. It was mind boggling, we're talking a few expansions old. Especially the whole module renaming phase; oh god that was horrible trying to investigate old names and finding their correct typeID. I'm glad to hear that the person has since made an effort to update their own database. But I have spent hours upon hours going through and fixing inaccuracies. I have spent hours flying from station to station to personally, and manually verify most of the corps as everything was outdated. I don't feel as if I simply scraped the data, packaged it up in a neat wrapper and stuck my name on it with credits in fine print. Kudos to those that took the time to gather all the initial data and put it up. Unfortunately, stuff like that rots, and I needed up to date information. - It was proprietary. IE: absolutely useless for anything. I needed a format that I could manipulate. So I created one. I could have kept it to myself, as the other LP stores out there have done, but I decided to release it to the greater EVE community. Sue me. Again, kudos to those that took the time to gather initial data. But it was way out of date and proprietary. Anyone is welcome to contribute to this project if they wish so that the whole eve community can benefit.
Taal Khurin Happy Asteroid Ltd 94	Posted - 2013.11.30 01:09:00 - [71] - Quote I guess my only real gripe that there was no real appreciation for the original developers of the data. I'm sure if a certain person whoses name began with "D" would get a mention he would be ok :)
Sable Blitzmann In Exile. Imperial Outlaws. 93	Posted - 2013.11.30 01:32:00 - [72] - Quote Then DaOpa should speak up for himself. He's already commented in this thread and gave basically the same response you and TestBox did. I will not have my thread derailed by people who think I slighted someone's work when they themselves don't bring up the issue. That being said, I will revise the original post to better reflect that this is a derivative work, as looking over it for the first time since I posted it it mentions it somewhat in passing, under a history heading.
Sable Blitzmann In Exile. Imperial Outlaws. 93	Posted - 2013.11.30 01:56:00 - [73] - Quote And now, back to the discussion at hand... I'm currently looking into using the LogServer to perhaps validate data and keep this thing up to date. If you open the LP Store with the log server running, it starts to print out pretty much everything you need. However, it seems to truncate after a specific size of information has printed to the LogServer. Here's a sample of the data that pops up while accessing the LP Store of University of Caille: http://pastebin.com/MZxQ4m9D I'm not familiar with the LogServer at all, and I'm not sure if all information is sent to the logserver which then truncates the info before printing, or if the info is first truncated by the client then sent to the LogServer. I do know, tho, that there are ways, or used to be ways, to hook into the log server and read info as it's printed (see: the now defunct BACON software for local monitoring). And, as far as I remember, that software was not against the EULA (this may or may have not changed, I have no idea). If anyone has any experience with this or with the LogServer, please let me know. If some software is developed that can achieve this, I can then make it a quick trek to visit the stations that need visiting and just dump the data. Cheers!
Sable Blitzmann In Exile. Imperial Outlaws. 115	Posted - 2014.01.21 15:39:00 - [74] - Quote No update, just giving this topic a little activity so it doesn't auto-lock. Using the LogServer was a dead end, unfortunately. Oh well.
Sable Blitzmann In Exile. Imperial Outlaws. 115	Posted - 2014.01.27 22:16:00 - [75] - Quote v0.9 - Rubicon 1.1 Added: - Nestor: 1,000,000LP/100,000,000ISK for SoE corp, and 800,000LP/80,000,000ISK for The Sanctuary - Nestor BPC: 600,000LP/150,000,000ISK for SoE corp, and 400,000LP/100,000,000ISK for The Sanctuary Can't upload to eve-files currently, so this is being hosted on my server.
Taleden North Wind Local no. 612 72	Posted - 2014.02.19 21:38:00 - [76] - Quote Thanks for making this data so much easier to use. I've just started pulling it into my own projects, and in case anyone is curious (or feels inclined to spot check it), here's the current clustering of corporations who share exactly the same set of offers: Quote: Royal Khanid Navy Freedom Extension Krusual Tribe Pator Tech School Republic Parliament The Leisure Group Urban Management Vherokior Tribe Intaki Bank Intaki Commerce CBD Corporation CBD Sell Division Caldari Business Tribunal Caldari Funds Unlimited Chief Executive Panel Echelon Entertainment Expert Distribution Expert Housing House of Records Mercantile Club Modern Finances Nugoeihuvi Corporation Prompt Delivery Science and Trade Institute State and Region Bank Ytiri True Creations CONCORD Ardishapur Family Carthum Conglomerate Ducia Foundry Further Foodstuffs HZO Refinery Imperial Armaments Inherent Implants Joint Harvesting Noble Appliances Nurtura Royal Amarr Institute Viziam Zoar and Sons Pend Insurance Federal Defense Union Ammatar Fleet Caldari Navy Corporate Police Force Home Guard Internal Security Ishukone Watch Peace and Order Unit Spacelane Patrol State War Academy Wiyrkomi Peace Corps Nefantar Miner Association Imperial Shipment Khanid Transport The Sanctuary Ammatar Consulate True Power Thukker Mix Aliastra Bank of Luminaire Egonics Inc. FedMart Federal Administration Federal Freight Garoun Investment Bank Impetus Inner Zone Shipping President Quafe Company Senate Supreme Court The Scope TransStellar Shipping University of Caille Food Relief Guristas Archangels Dominations Guardian Angels Brutor Tribe Republic Fleet Republic Justice Department Republic Military School Republic Security Services Intaki Space Police Intaki Syndicate Sisters of EVE Serpentis Corporation Lai Dai Corporation Khanid Innovation Khanid Works 24th Imperial Crusade Federal Intelligence Office Federal Navy Academy Federation Customs Federation Navy Tash-Murkon Family Allotek Industries Astral Mining Inc. Center for Advanced Studies Chemal Tech Combined Harvest CreoDron Material Acquisition Poteque Pharmaceuticals Roden Shipyards Amarr Constructions Boundless Creation Core Complexion Inc. Eifyr and Co. Minmatar Mining Corporation Native Freshfood Republic University Sebiestor Tribe Six Kin Development State Protectorate Outer Ring Excavations Amarr Certified News Amarr Civil Service Amarr Trade Registry Civic Court Court Chamberlain Emperor Family Hedion University Imperial Chancellor Kador Family Kor-Azor Family Ministry of Assessment Theology Council Tribal Liberation Force Lai Dai Protection Service Caldari Constructions Caldari Provisions Caldari Steel Deep Core Mining Inc. Hyasyoda Corporation Ishukone Corporation Kaalakiota Corporation Minedrill Perkone Poksu Mineral Group Propel Dynamics Rapid Assembly School of Applied Knowledge Sukuuvestaa Corporation Top Down Wiyrkomi Corporation Zainou Zero-G Research Firm Duvolle Laboratories Blood Raiders Mordu's Legion Salvation Angels Guristas Production Amarr Navy Imperial Academy Ministry of Internal Order Ministry of War Sarum Family Serpentis Inquest Trust Partners
Sable Blitzmann In Exile. Imperial Outlaws. 116	Posted - 2014.03.09 22:35:00 - [77] - Quote No new activity, just a simple bump to keep thread alive. Apparently there will be a new ship skinning thing, with one of them available in CONCORD LP store. I will be monitoring this and will release a new version if needed. =)
Sable Blitzmann In Exile. Imperial Outlaws. 118	Posted - 2014.03.26 05:55:00 - [78] - Quote Took a little while due to other things, but v0.10 is out with the addition of the Police Pursuit Navy Comet in the CONCORD LP Store, woop woop Download here: http://eve-files.com/dl/267604
Vapuk Kripit Straight Luck No Skill 0	Posted - 2014.04.11 01:08:00 - [79] - Quote This looks to be an amazingly useful tool to a noob like me. However, at the risk of not looking like a stats major, how would one access this data please. Without ever having used sql - I have no idea how to access this (probable) cornucopia. Thank you - and even if no reply eventuates. Awesome work anyway. thanks
Sable Blitzmann In Exile. Imperial Outlaws. 119	Posted - 2014.04.11 03:32:00 - [80] - Quote You can load the SQL file into a MySQL database, where you can manipulate it from there. I'm not sure about other DB programs. I also supply a version in JSON format which should be easy to parse. It really depends what you want to use this data for. You will need to research into both these options for this data to be useful. There's not a whole lot you can do with it out of the box - you must devise a way to store it / access it and use it for your own project. On top of that, you probably want access to the names of the items which is provided by CCP through their static database dump I might be able to create CSV files based on the tables, so that those with spreadsheet experience can use the info...
Steve Ronuken Fuzzwork Enterprises Vote Steve Ronuken for CSM 3183	Posted - 2014.04.11 10:21:00 - [81] - Quote There are, on the other hand, a few tools which use the database They're at the bottom of Sable's first post, allowing you to see which things worth getting with your LP Woo! CSM 9! http://fuzzwork.enterprises/ Twitter: @fuzzysteve on Twitter
Berluth Luthian Onslaught Inc RISE of LEGION 187	Posted - 2014.05.07 22:21:00 - [82] - Quote Thanks for all your work on this guys! How is that .csv file coming Sable? I don't know how to access JSON (my problem, I know) but I can do spreadsheets. I figure a lot of this work could be helpful insight into the upcoming module rebalancing and hope you guys can be helpful parties to that. I'd like to see NPC corps be really stron guiding forces that help to push new players' progression. I had a really ambitious project in mind of outlining each NPC corp, their clusters of LP store offerings, the best place to stage yourself and then ideal 'next step' corps. I'd like PvE progression to look something more like: Start with a basic NPC corp then have to choose between corps with unique mixes of: -Unique high value LP store items -lower risk lower reward missions that can be done at higher volume -some corps with a large variety of LP store items but traded for higher isk:LP exchange rates -distance from main trade hubs -likelihood of missions spawning outside highsec -more corps that involve a kind of PVP aspect like FW corps (perhaps you could be a chartered employee of NPC corps occasionally being involved in periodic inter-corp trade wars that also involve the risk of being attacked by enemy chartered members, but also with the reward of MUCH higher LP returns)
Sable Blitzmann Aperture Harmonics No Holes Barred 126	Posted - 2014.06.03 15:44:00 - [83] - Quote I will be adding the new Mordu LP items when I get some time in the coming days.
Steve Ronuken Fuzzwork Enterprises Vote Steve Ronuken for CSM 3384	Posted - 2014.06.05 20:05:00 - [84] - Quote There are a few new other modules out there now. The drone ones. (fed navy store) Federation Navy Drone Damage Amplifier- 30,000 lp, 12,000,000 isk, 1 DDA, 2 CN Commodore II tags, 10 CN Vice Admiral I tags, 17 CN Admiral I tags. Federation Navy Drone Navigation Computer - 10,000 LP, 7,2000,000 isk, 1 DNA I, 89 CN Captain I tags, 112 CN captain II tags, 135 CN Captain III tags Woo! CSM 9! http://fuzzwork.enterprises/ Twitter: @fuzzysteve on Twitter
Sable Blitzmann Aperture Harmonics No Holes Barred 127	Posted - 2014.06.05 21:33:00 - [85] - Quote Steve Ronuken wrote: There are a few new other modules out there now. The drone ones. (fed navy store) Federation Navy Drone Damage Amplifier- 30,000 lp, 12,000,000 isk, 1 DDA, 2 CN Commodore II tags, 10 CN Vice Admiral I tags, 17 CN Admiral I tags. Federation Navy Drone Navigation Computer - 10,000 LP, 7,2000,000 isk, 1 DNA I, 89 CN Captain I tags, 112 CN captain II tags, 135 CN Captain III tags When were those added? And is it only fed navy?
Steve Ronuken Fuzzwork Enterprises Vote Steve Ronuken for CSM 3384	Posted - 2014.06.06 11:31:00 - [86] - Quote I'm pretty sure they were added with Kronos (mentioned in the giving drones an assist devblog) And nope. There are imp navy ones. I've only checked the fed navy ones, due to being at Dodi. 33832 \| Imperial Navy Omnidirectional Tracking Enhancer 33842 \| Federation Navy Drone Damage Amplifier 33844 \| Imperial Navy Drone Damage Amplifier 33846 \| Dread Guristas Drone Damage Amplifier 33850 \| Federation Navy Drone Navigation Computer (not sure if the DG ones are just drops) Woo! CSM 9! http://fuzzwork.enterprises/ Twitter: @fuzzysteve on Twitter
Sable Blitzmann Aperture Harmonics No Holes Barred 131	Posted - 2014.07.02 22:15:00 - [87] - Quote Well, I'm only about a month late with this... Sorry about the delay. I help with the code for Pyfa, and with the last release I put a lot of time and energy. Couple that with the fact that these updates are largely manual manipulation of the DB, I just simply got burned out. So I've been in a hidey hole playing Minecraft for the past 3 weeks >_> v0.11 is out with the Mordus ships: http://eve-files.com/dl/269104 This does NOT include the new drone modules, as I have to do a bit of research and manual flying around to check these (dev blog says Gal and Amarr Navy, including FW, however I don't trust the dev blogs -_-)
Sable Blitzmann Aperture Harmonics No Holes Barred 132	Posted - 2014.07.05 15:49:00 - [88] - Quote Just remembered about the new mid-grade implants (or are the low-grades the new ones and mid grades are renamed???)... I assume they are in the same corps as their low/high counterparts...
Xercodo Xovoni Astronautical Manufacturing and Engineering 3620	Posted - 2014.07.19 04:18:00 - [89] - Quote Hey I'd like to point out that caldari navy missile aren't sold from the khanid navy LP store (and if your DB doesn't agree then Steve needs to do an update :P) The Drake is a Lie
Sable Blitzmann Aperture Harmonics No Holes Barred 134	Posted - 2014.07.19 21:46:00 - [90] - Quote Xercodo wrote: Hey I'd like to point out that caldari navy missile aren't sold from the khanid navy LP store (and if your DB doesn't agree then Steve needs to do an update :P) Thanks, I'll double check soonish. Do they not have any missiles?
Steve Ronuken Fuzzwork Enterprises Vote Steve Ronuken for CSM 3542	Posted - 2014.07.19 23:02:00 - [91] - Quote I do need to do an update (still on 0.10) Woo! CSM 9! http://fuzzwork.enterprises/ Twitter: @fuzzysteve on Twitter
Sable Blitzmann Aperture Harmonics No Holes Barred 134	Posted - 2014.07.20 05:22:00 - [92] - Quote I did check ingame, and the Caldari missiles are indeed in Royal Khanid Navy LP store. So no change needs to be made there

Pages: 1 2 3 4 :: [one page]

COPYRIGHT NOTICE
EVE Online, the EVE logo, EVE and all associated logos and designs are the intellectual property of CCP hf. All artwork, screenshots, characters, vehicles, storylines, world facts or other recognizable features of the intellectual property relating to these trademarks are likewise the intellectual property of CCP hf. EVE Online and the EVE logo are the registered trademarks of CCP hf. All rights are reserved worldwide. All other trademarks are the property of their respective owners. CCP hf. has granted permission to EVE-Search.com to use EVE Online and all associated logos and designs for promotional and information purposes on its website but does not endorse, and is not in any way affiliated with, EVE-Search.com. CCP is in no way responsible for the content on or functioning of this website, nor can it be liable for any damage arising from the use of this website.