EVE Search - New Dev Blog: Full Suite of Upgrades to the Tranquility DB

Check My IP Information

All Channels

EVE Information Portal

New Dev Blog: Full Suite of Upgrades to the Tranquility DB - Yippie!

» Click here to find additional results for this topic using Google

Monitor this thread via RSS [?]


Author	Thread Statistics \| Show CCP posts - 14 post(s)

CCP Zymurgist Gallente C C P	Posted - 2011.03.24 16:29:00 - [1] CCP Yokai has a new blog in our technical series about the upgrades we have applied to the Tranquility Database. Read more about it here. Zymurgist Community Representative CCP NA, EVE Online Contact Us


CCP Yokai	Posted - 2011.03.24 17:16:00 - [2] Originally by: Marconus Orion I'm not very tech savy so for us laymen non-super geeks, please using a car reference, what is the comparison? We going from a Fiesta to a Mustang? We had a Ferrari 1985 288 GTO We have a Ferrari 2011 599 GTO Both great... both fast... the new one is just magic. make sense?


CCP Yokai	Posted - 2011.03.24 17:34:00 - [3] Originally by: EliteSlave I wish i could post that screen cap of Stan after sneaking into that trailer with internet.... But, I have so many questions about the hardware... like specific model numbers, firmware. More so to do with possible integration here at my office as we have a pretty large database and are looking to scale up our hardware as we are approaching saturation of it. so any ** is good ** Ask and I'll try and answer... better yet if you are at Fanfest... I present all that tomorrow.


CCP Yokai	Posted - 2011.03.24 17:54:00 - [4] Originally by: EliteSlave Originally by: CCP Yokai Originally by: EliteSlave I wish i could post that screen cap of Stan after sneaking into that trailer with internet.... But, I have so many questions about the hardware... like specific model numbers, firmware. More so to do with possible integration here at my office as we have a pretty large database and are looking to scale up our hardware as we are approaching saturation of it. so any ** is good ** Ask and I'll try and answer... better yet if you are at Fanfest... I present all that tomorrow. Wow, didnt expect a response like that.. Well I guess the first few questions are we are currently doing the FC/IP (Fibre Chan over IP) and we are kinda limited in the I/O factor of around 30 that we have currently attached to 12 Dell Powervault 3610's ( ISCSI / FC/IP and FC ) and we are already maxing out the hardware and we are trying to get the next bang for out buck with going full FC but since this will be our first foray into the "Enterprise" level we are reading "blah blah blah" and dont really understand what we should be looking for of sorts. Now im not expecting you to give me a visio flowchart of the equipment or how its setup. But if you can say broad terminology that is well acceptable for growth of the next 2-3 years and allows for 1000-1500 ( ideally would like to have hardware that supports 2500-3000 to allow for growth) users concurrently hitting the database at any given time would mucho appreciated. First off... nothing over anything if you can do it... FC is the best bet for "Enterprise" like you said because of the session based communications and the potential for synchronous protection to redundant SAN controller. I am biased... this is my opinion but I avoid iSCSI unless forced but sharp object. Next... direct connection or true SAN need to be decided on early. Direct connecting the disks is faster (like nano seconds only) but cheaper because you don't have to buy switches. BUT!!! When you run out of host ports and you need to get another system attached or accessing the LUNs, boy are you gonna miss those switches. Next... SAS unless you know better. SAS is great! I love this stuff... cheaper than FC-SCSI and much better than SATA... best mid-ground disks. SSD's rock my socks but you will pay massively for them or you will get cheap ones and hate what you did later. Last... Find the right performance metric. Concurrent users means lots to lots of people. I would suggest looking at your IOPS. A 12 drive tray of SAS usually nets 5-10K IOPS on normal workloads for a DB. Hope that helps a little. All I can toss at you between beers at Fanfest :) CCP Yokai


CCP Yokai	Posted - 2011.03.24 17:56:00 - [5] Originally by: Ban Doga Edited by: Ban Doga on 24/03/2011 17:46:25 I remember that someone (CCP Explorer ?) said not so long ago, that the DB is not anywhere near its performance limit. So I'm really looking forward to seeing no performance improvements from this one. I'm happy that you are happy, tho... Check the disk busy... CPU... um and other graphs in the blog... We dug deeper and found some bottlenecks recently.


CCP Yokai	Posted - 2011.03.24 18:11:00 - [6] Originally by: gtiness What is the size of the EVE database? Lots of "stuff" in there but somewhere around 1.3TB


CCP Valar	Posted - 2011.03.24 18:17:00 - [7] Perhaps the perceived performance for the users won't change much with the new database hardware, but it gives us a lot of room to grow and makes us able to perform more online maintenance without affecting users and prevents us from having to schedule extended downtimes for things we needed to do offline before. Also, a major part of the decision to upgrade the hardware was to increase availability and options for disaster recovery. ---- Senior Virtual World Database Administrator Virtual World Operations CCP Games


CCP Yokai	Posted - 2011.03.25 09:15:00 - [8] Originally by: Hawk TT CCP, now you have to look at Intel Xeon X5698 Dual-Core 4.4GHz and X569X @ 4.66GHz... I suppose those would be nice match for the SOL nodes... Spoiler Alert!!! Watch my very short 2 min section of the Keynote today at 15:00... All I can say right now... but there is way! more to come.


CCP Yokai	Posted - 2011.03.25 09:20:00 - [9] Edited by: CCP Yokai on 25/03/2011 09:21:06 General Response to "I thought the DB was not under load". It wasn't back then... but it is now. Changes I can think of off the top of my head that affect the DB. Inventory 64 API Evegate Enhanced Backups Cleanup jobs Simple DB size growth We are doing ALOT behind the scenes that needs more power from the DB and we were obviously starting to break it.


CCP Yokai	Posted - 2011.03.25 09:27:00 - [10] Originally by: Korerin Mayul you have four 8g ports per server, rolled into 2 trunks of 16g? - sweet!! what is managing the host level trunking? I havent seen this done in anger before THIS Additionally, be really careful with thin provisioning, I speek form bitter, bitter experience that using that stuff in prod will cause many tears and late night clickeyfests. Only being used for non-production warehousing and such. Just more cool stuff we didn't have before. Daddy likes options you know?



CCP Yokai	Posted - 2011.03.25 09:29:00 - [11] Originally by: Svizac Marmotov Is Tranquility going to become self-aware? My best guess... 04-15-2011 (I'm having it do my taxes)


CCP Yokai	Posted - 2011.03.25 09:30:00 - [12] Edited by: CCP Yokai on 25/03/2011 09:32:07 Originally by: ModeratedToSilence Originally by: CCP Yokai Originally by: Marconus Orion I'm not very tech savy so for us laymen non-super geeks, please using a car reference, what is the comparison? We going from a Fiesta to a Mustang? We had a Ferrari 1985 288 GTO We have a Ferrari 2011 599 GTO Both great... both fast... the new one is just magic. make sense? Attempting to align computer technology development with automotive development is stupidity. Computer hardware tends to double in its basic attributes every 18-24 months. If we had the same development in motor vehicles we would not be playing internet spaceships - we would be in real life spaceships. Note: I agree with you and this is why I used a 1985 to 2011 comparison for a 2008 to 2011 server change. Seems about right to me. But I get what you mean... hard to compare really... I just like the 599 GTO enough to make up any excuse to use it.


CCP Yokai	Posted - 2011.03.25 09:53:00 - [13] Originally by: Rahnim And all this stuff is live now? when did you change this stuff? did it fix the large scale fleet lag? Yes, 03-17-2011, NO


CCP Yokai	Posted - 2011.03.26 12:08:00 - [14] Originally by: Erichk Knaar Originally by: Mister Rocknrolla So, to a layman, is this considered "cutting-edge" or just "really, REALLY good" stuff? Just wondering if development of this sort of computing capacity lends itself to other industries? Does CCP interact with other industries to help them in developing this kind of computing power? TL;DR: Could TQ find a cure for cancer, an alternative to fossil fuels and an efficient way to travel across the galaxy if we weren't using it to play games? For it's purpose, it's bleeding edge. There have been other things done in different spaces, but for gaming, CCP is way ahead. What that guy said... It isn't made of stuff only found in Area 51 Silos... but for a DB... it is way at the top and edge of what can be done. The V7000 is very very new and we have been testing since it released.

COPYRIGHT NOTICE
EVE Online, the EVE logo, EVE and all associated logos and designs are the intellectual property of CCP hf. All artwork, screenshots, characters, vehicles, storylines, world facts or other recognizable features of the intellectual property relating to these trademarks are likewise the intellectual property of CCP hf. EVE Online and the EVE logo are the registered trademarks of CCP hf. All rights are reserved worldwide. All other trademarks are the property of their respective owners. CCP hf. has granted permission to EVE-Search.com to use EVE Online and all associated logos and designs for promotional and information purposes on its website but does not endorse, and is not in any way affiliated with, EVE-Search.com. CCP is in no way responsible for the content on or functioning of this website, nor can it be liable for any damage arising from the use of this website.