|
|
| Author |
Thread Statistics | Show CCP posts - 6 post(s) |
|
CCP Fallout
   |
Posted - 2010.05.13 17:24:00 -
[1]
Friday, May 7th, was an interesting and rough day for both players and CCP. What happened, and how can we prevent future occurances? CCP Red Button returns with a post mortem of the events in his newest dev blog.
Fallout
Associate Community Manager
CCP Hf, EVE Online
Contact us |
|
|
CCP Red Button
|
Posted - 2010.05.13 17:57:00 -
[2]
To answer your question Gerash the Tranquility main database which is at the heart of EVE is clustered and fully redundant in every way. If needed we can recover the database up to the minute from backup but the problem is the time it currently takes. So what we aim to do now is being able to instantly switch to a time-delayed mirror in addition to drastically reducing backup restoration times.
------
Hmmm... wonder where this cable goes 0_o |
|
|
CCP Red Button
|
Posted - 2010.05.13 21:55:00 -
[3]
Interresting question Lagruna. To tell you the truth I am not sure why this section of the junkyard needed cleaning at this point. Each section of the junkyard is used for a different set of things as far as I know and thus might fill up at different rates so that might explain why. I will try to find out tomorrow. The reason for the modification was to optimize performance.
------
Hmmm... wonder where this cable goes 0_o |
|
|
CCP Red Button
|
Posted - 2010.05.14 09:39:00 -
[4]
Edited by: CCP Red Button on 14/05/2010 09:40:52
Edited by: CCP Red Button on 14/05/2010 09:40:23
 Originally by: Diomedes Calypso
Could someone give me a few sentences on why rol-backs would be a nightmare, especially in a game ?
Fair question Diomedes. The reason why we consider rollbacks an absolute last resort thing is that by doing so, even by a short period, you are loosing some of EVE History. Imagine a big battle being fought and then suddenly it never happened, a successful mission completed and then it never was, that ingenious market trade.. etc. So we will essentially explore every other option and turn every stone before deciding to rollback, even if that would in some cases be the easiest option from a technical standpoint.
------
Hmmm... wonder where this cable goes 0_o |
|
|
CCP Red Button
|
Posted - 2010.05.14 09:52:00 -
[5]
Originally by: cpu939
how many junkyards are there? how many items are in each junkyards?
also what is the daily recycled average i.e. number of items cleared of the list?
how many of the dev team did it take to fix this problem?
i bet the mayday call went out for all the devs to come quick (sry bad pun)
So many questions and so few answers 
To tell you the truth I don't really know how many there are. There are several, I know that much, and the number of items in each varies depending on what it contains. The recycled average also varies depending on the activity levels in game and the frequency of cleanups.
There were quite a few people working on fixing this problem last Friday, not just DBAs and programmers but individuals from almost every part of the company, customer support, community, operations, engineering etc. Essentially when EVE has a problem, the whole of CCP drops whatever they are doing and comes running.
------
Hmmm... wonder where this cable goes 0_o |
|
|
CCP Red Button
|
Posted - 2010.05.14 10:49:00 -
[6]
Crudamus, no existing items were affected by this error. This only affected a small portion of new items being created during the 60 minute time period the script was running. That includes market orders being completed, items stacked or unstacked, new characters created etc. Most of these we were able to fix during Fridays downtime and we are still working on finding and fixing the rest. So if you were active and logged on in that time period and think this might have affected you I would encourage you to send in a petition and the GM's will investigate.
------
Hmmm... wonder where this cable goes 0_o |
|
|
|
| |
|