Pages: 1 2 3 4 5 :: [one page] |
|
Author |
Thread Statistics | Show CCP posts - 6 post(s) |
|
CCP Mitnal
C C P
|
Posted - 2008.10.30 03:23:00 -
[1]
We are currently experiencing difficulties with our database that has caused Tranquility to be offlined.
We will provide more details once we have them.
Please keep all discussion to this thread, others will be locked or removed.
UPDATE: 03:33 We are currently anticipating that the problem will be fixed by 04:00
Mitnal Community Representative CCP Games, EVE Online Email / Netfang |
|
Dakhur
|
Posted - 2008.10.30 03:24:00 -
[2]
yay! an official response!!
|
Phu Bar
Special Branch Tygris Alliance
|
Posted - 2008.10.30 03:24:00 -
[3]
sticky
<3 ccp
|
Sergio Ling
Veto.
|
Posted - 2008.10.30 03:24:00 -
[4]
So the server is down? _
BET ISK ON ANYTHING AT ALL |
Parkuras
|
Posted - 2008.10.30 03:24:00 -
[5]
YAY Sticky...
So hows it goin in ICE-MAN-LAND?
|
Br0ke
GoonFleet GoonSwarm
|
Posted - 2008.10.30 03:24:00 -
[6]
Well thanks for not waiting hours to make a post at least.
|
Rysotope
Ram Protectorate AKEGATA CONSORTIUM 418
|
Posted - 2008.10.30 03:24:00 -
[7]
Thanks for the update!
|
Revolution Rising
Venture Research and Resources New MagnaDyne Enterprises
|
Posted - 2008.10.30 03:24:00 -
[8]
Edited by: Revolution Rising on 30/10/2008 03:25:14 At least it's starting back up now, it would've been nice had you mentioned it before the cluster was coming back up.
VRR Recruitment
|
Apocalisys
|
Posted - 2008.10.30 03:25:00 -
[9]
Hope the server come alive soon.
|
Rojo Mojo
A MAGUS INDUSTRIES
|
Posted - 2008.10.30 03:25:00 -
[10]
LOL at motivation poster
|
|
Dirk Magnum
Royal Hiigaran Navy
|
Posted - 2008.10.30 03:25:00 -
[11]
Just out of curiosity can you temp-ban all the idiots who will continue to spam threads about this until the server goes back up? I mean I'm just sayin. They're a pox on the forum after every minor server mishap.
|
AdioHyperion
Caldari One Stop Mining Shop
|
Posted - 2008.10.30 03:25:00 -
[12]
Atleast it wont be down long.... "knocks on wood"
|
Atla Jones
Rothana Heavy Industries
|
Posted - 2008.10.30 03:26:00 -
[13]
Time for puppies!!!
Irish Jacks
|
Chaos Incarnate
Faceless Logistics
|
Posted - 2008.10.30 03:26:00 -
[14]
latenight server implosion makes universe very sad _____________________
The unofficial faceless Achura alt of EVE Online
|
AdioHyperion
Caldari One Stop Mining Shop
|
Posted - 2008.10.30 03:26:00 -
[15]
Originally by: Dirk Magnum Just out of curiosity can you temp-ban all the idiots who will continue to spam threads about this until the server goes back up? I mean I'm just sayin. They're a pox on the forum after every minor server mishap.
What else are we supposed to do until it comes back up?
|
Tornim
Minmatar HeXstoof
|
Posted - 2008.10.30 03:26:00 -
[16]
so what really happened?
|
Ehronn
Caldari Nutz N Boltz Skunk-Works
|
Posted - 2008.10.30 03:26:00 -
[17]
Play new Eve Offline, To Play Eve Offline we at CCP ask that you close your eyes really tight. With your eyes closed, in a high pitch voice yell PEW PEW and Yarr every few minutes at random while paying us 14.95 per month. Enjoy! -----------------------
Dysfunctional Playground |
Kuar Z'thain
Destructive Influence Band of Brothers
|
Posted - 2008.10.30 03:26:00 -
[18]
So, what should I petition my lost escalation under?
|
Chaos Incarnate
Faceless Logistics
|
Posted - 2008.10.30 03:26:00 -
[19]
Originally by: Dirk Magnum Just out of curiosity can you temp-ban all the idiots who will continue to spam threads about this until the server goes back up? I mean I'm just sayin. They're a pox on the forum after every minor server mishap.
Does that include me? _____________________
The unofficial faceless Achura alt of EVE Online
|
Taius Pax
|
Posted - 2008.10.30 03:26:00 -
[20]
Originally by: Chaos Incarnate latenight server implosion makes universe very sad
YOUR FACE! IT CRASHED THE SERVER!
|
|
IR Scoutar
Caldari State War Academy
|
Posted - 2008.10.30 03:27:00 -
[21]
this thread should be locked as it clearly wasnt the first one about this
|
Triffon
Caldari Intervene Industries
|
Posted - 2008.10.30 03:27:00 -
[22]
i hope it come back online soon i need to change my traning
|
Animenick
|
Posted - 2008.10.30 03:27:00 -
[23]
So is this server nerf part of the new patch?
|
Elluvia
|
Posted - 2008.10.30 03:27:00 -
[24]
I appreciate the update. I can deal with the issues as long as CCP continues to work the problems and treat us like adults.
|
Parkuras
|
Posted - 2008.10.30 03:27:00 -
[25]
Originally by: AdioHyperion
Originally by: Dirk Magnum Just out of curiosity can you temp-ban all the idiots who will continue to spam threads about this until the server goes back up? I mean I'm just sayin. They're a pox on the forum after every minor server mishap.
What else are we supposed to do until it comes back up?
Play with yourself... or if you have friends.... and they are willing, play with them.
|
Dirk Magnum
Royal Hiigaran Navy
|
Posted - 2008.10.30 03:27:00 -
[26]
Oh no you can spam THIS thread all you want. I meant spam the "new topic" button.
|
Daquaris
Caldari Novus Aevum Transport and Industries Novus Aevum
|
Posted - 2008.10.30 03:27:00 -
[27]
Edited by: Daquaris on 30/10/2008 03:27:42 Here's a GMT conversion tool for the mathematically challenged:
http://wwp.greenwichmeantime.com/time-zone/
|
Cat Molina
Minmatar Psychotic Inc.
|
Posted - 2008.10.30 03:28:00 -
[28]
Originally by: Ehronn Play new Eve Offline, To Play Eve Offline we at CCP ask that you close your eyes really tight. With your eyes closed, in a high pitch voice yell PEW PEW and Yarr every few minutes at random while paying us 14.95 per month. Enjoy!
^^ LOL
|
Animenick
|
Posted - 2008.10.30 03:28:00 -
[29]
Originally by: Daquaris Edited by: Daquaris on 30/10/2008 03:27:42 Here's a GMT conversion tool for the mathematically challenged:
http://wwp.greenwichmeantime.com/time-zone/
No need conversion tool. Have forum timestamp!
|
AdioHyperion
Caldari One Stop Mining Shop
|
Posted - 2008.10.30 03:28:00 -
[30]
Edited by: AdioHyperion on 30/10/2008 03:28:21 So since the server is down... that means we dont need a server inspection tonight right? =)
|
|
Vendrin
Caldari Stimulus
|
Posted - 2008.10.30 03:28:00 -
[31]
Originally by: Parkuras
Originally by: AdioHyperion
Originally by: Dirk Magnum Just out of curiosity can you temp-ban all the idiots who will continue to spam threads about this until the server goes back up? I mean I'm just sayin. They're a pox on the forum after every minor server mishap.
What else are we supposed to do until it comes back up?
Play with yourself... or if you have friends.... and they are willing, play with them.
Why does it matter if they are willing?
|
Weirda
Minmatar Queens of the Stone Age
|
Posted - 2008.10.30 03:29:00 -
[32]
Originally by: Kuar Z'thain So, what should I petition my lost escalation under?
Please Delete? __ weirda |
5yndr0m3
Caldari Ninjas N Pirates
|
Posted - 2008.10.30 03:30:00 -
[33]
For the followers of the Device.
The Device, The sacred relic of Stuff Doing, was in the Divine Temple before the outage occurred.
|
AdioHyperion
|
Posted - 2008.10.30 03:30:00 -
[34]
woot there is a count down!! 5minutes 36seconds
|
Parkuras
|
Posted - 2008.10.30 03:30:00 -
[35]
Originally by: Vendrin
Originally by: Parkuras
Originally by: AdioHyperion
Originally by: Dirk Magnum Just out of curiosity can you temp-ban all the idiots who will continue to spam threads about this until the server goes back up? I mean I'm just sayin. They're a pox on the forum after every minor server mishap.
What else are we supposed to do until it comes back up?
Play with yourself... or if you have friends.... and they are willing, play with them.
Why does it matter if they are willing?
=\ Never thought of it like that...
|
Tornim
Minmatar HeXstoof
|
Posted - 2008.10.30 03:30:00 -
[36]
5 min left till startup
|
MissNobody
|
Posted - 2008.10.30 03:31:00 -
[37]
It said that 5 minutes ago, now for a second countdown :P lo
|
Adeena Torcfist
Caldari Dark Underground Forces Ethikos Trade Alliance
|
Posted - 2008.10.30 03:31:00 -
[38]
i hope to god im alive still. I think u secretly knew i was doing AE 4 Bonus room. u could have waited to offline TranQ for 5 minutes.......
|
isy18
|
Posted - 2008.10.30 03:31:00 -
[39]
30 seconds =) lets see
|
Epegi Givo
Amarr Vengeance Imperium
|
Posted - 2008.10.30 03:32:00 -
[40]
Edited by: Epegi Givo on 30/10/2008 03:33:51 Edited by: Epegi Givo on 30/10/2008 03:32:28 Edited by: Epegi Givo on 30/10/2008 03:30:33 Edited by: Epegi Givo on 30/10/2008 03:29:27 Edited by: Epegi Givo on 30/10/2008 03:29:18 Edited by: Epegi Givo on 30/10/2008 03:29:10 Edited by: Epegi Givo on 30/10/2008 03:29:03 Edited by: Epegi Givo on 30/10/2008 03:28:38 Edited by: Epegi Givo on 30/10/2008 03:28:48 Edited by: Epegi Givo on 31/9/20009 03:28:38 Edited by: A poor editor on 30/10/2008 03:28:38 I am loling at all the people making threads over the servers crash, and how the mods are locking every single one of them, so half the screen is locked threads.
This is my sig, or is it? -------------------------------------
|
|
ImRedYoureDead
Raata Tech Aegis Militia
|
Posted - 2008.10.30 03:32:00 -
[41]
I can see the 30,000 Carebears tears starting to dry up already. It's ok guys, you can go back to getting ****d by Kruul any moment now.
|
isy18
|
Posted - 2008.10.30 03:32:00 -
[42]
and timer reset to 3 min =)
|
AdioHyperion
|
Posted - 2008.10.30 03:33:00 -
[43]
Originally by: isy18 and timer reset to 3 min =)
Yea they cant count
|
sp009
Caldari Organization Outcast
|
Posted - 2008.10.30 03:33:00 -
[44]
Who wants to take bets that the 5min start up will count down to 0 then restart at 5mins
|
Tornim
Minmatar HeXstoof
|
Posted - 2008.10.30 03:34:00 -
[45]
lets all log back in at once. just to make sure the server is really fixed
|
Tipz NexAstrum
Celestial Horizon Corp. Celestial Industrial Alliance
|
Posted - 2008.10.30 03:34:00 -
[46]
Edited by: Tipz NexAstrum on 30/10/2008 03:35:42 Edited by: Tipz NexAstrum on 30/10/2008 03:35:11 Does Valar get a free breakfast for being woken up this early?
Originally by: CCP Navigator People who think I am joking or talking big are going to understand very quickly that there will be order in these forums.
|
Korizan
|
Posted - 2008.10.30 03:34:00 -
[47]
THe server will come up. CCP will log in a few people to look @ it. THen allow a few more in so the logon server doesn't crash as thousands of people try to login @ once. Then we are going to get the .. The server is up but I can't login comments...
Time to surf the web for oh 20 minutes
|
BuckStrider
Fleem Co
|
Posted - 2008.10.30 03:34:00 -
[48]
Originally by: ImRedYoureDead I can see the 30,000 Carebears tears starting to dry up already. It's ok guys, you can go back to getting ****d by Kruul any moment now.
All i wanna do is move my carrier
|
Planktal
Gallente Kenshao Industries The Star League
|
Posted - 2008.10.30 03:35:00 -
[49]
good thing I had long skills running on my main and alt account as well as not in combat when the server went wonky. Oh, and it's down again
Here, sanity... niiiice sanity, come to daddy... okay, that's a good sanity... *THWONK!* GOT the bastard. |
Keflin Geard
Black Nova Corp Band of Brothers
|
Posted - 2008.10.30 03:35:00 -
[50]
I wish Darth Vader ran CCP
|
|
Yur mom
|
Posted - 2008.10.30 03:35:00 -
[51]
4:00 UTC WTF!!!!!!!!! This will just be like a patch day, no doubt. CCP just say it's down until you fix it, not 30 min intervals PLZ
|
isy18
|
Posted - 2008.10.30 03:35:00 -
[52]
lol sounds familiar
|
AdioHyperion
|
Posted - 2008.10.30 03:35:00 -
[53]
Originally by: BuckStrider
Originally by: ImRedYoureDead I can see the 30,000 Carebears tears starting to dry up already. It's ok guys, you can go back to getting ****d by Kruul any moment now.
All i wanna do is move my carrier
I just wanna switch skills and go to bed... but we are all waiting
|
Judas Yanakov
Caldari Corp 1 Allstars
|
Posted - 2008.10.30 03:35:00 -
[54]
It would appear to be back down again The answer is ALWAYS 42. |
Hendow
|
Posted - 2008.10.30 03:35:00 -
[55]
Originally by: Tornim lets all log back in at once. just to make sure the server is really fixed
best post I have read
|
Sekhpty
|
Posted - 2008.10.30 03:36:00 -
[56]
Originally by: Dirk Magnum Just out of curiosity can you temp-ban all the idiots who will continue to spam threads about this until the server goes back up? I mean I'm just sayin. They're a pox on the forum after every minor server mishap.
Totally agree.
Anyway, thanks for the post...
|
Super Skulls
Twin Sun Syndicate
|
Posted - 2008.10.30 03:36:00 -
[57]
reset, we've all been had
|
|
CCP Mitnal
C C P
|
Posted - 2008.10.30 03:36:00 -
[58]
Updated.
Mitnal Community Representative CCP Games, EVE Online Email / Netfang |
|
Cat Molina
Minmatar Psychotic Inc.
|
Posted - 2008.10.30 03:36:00 -
[59]
<snickers>
|
mytwocents
|
Posted - 2008.10.30 03:36:00 -
[60]
so, skill training has been hit with the nerf bat now, it said 28 mins
|
|
Noriko Sakai
Gallente DC1 Coalition
|
Posted - 2008.10.30 03:36:00 -
[61]
Originally by: sp009 Who wants to take bets that the 5min start up will count down to 0 then restart at 5mins
It did, It reached 0 and it's now stuck in checking status, which is what it was before the countdown started.
|
Epegi Givo
Amarr Vengeance Imperium
|
Posted - 2008.10.30 03:36:00 -
[62]
the past 2 MMOs that I played are seeming to have horrible server problems. Flyff had a catastrophi server shutdown that shut the game down for about 4 days some of the servers are still down. Now eve is pretending to be and x-box -------------------------------------
|
Adeena Torcfist
Caldari Dark Underground Forces Ethikos Trade Alliance
|
Posted - 2008.10.30 03:37:00 -
[63]
lol more minutes.....
|
Dueroth Kael
|
Posted - 2008.10.30 03:37:00 -
[64]
So whats really goin on ccp... the server has been acting up alot ... lag is worse than ever... and client crashing is more than usual now... i lost two ravens to client crashes.. 1 which is bein petitioned... So whats goin on???
|
Kittamaru
Gallente Democracy of Klingon Brothers Utterly Harmless
|
Posted - 2008.10.30 03:37:00 -
[65]
Rawr, long skill train FTW.
Bad thing is - I'm gonna be out my T2 mining drones... and possibly my hulk since I was under attack by NPC's when the server died.
|
Kessiaan
Minmatar Army of One
|
Posted - 2008.10.30 03:37:00 -
[66]
Well, the title screen countdown has shown several attempts to restart the server.. it ticks for about 30 seconds, then goes to 'Unknown' again about 5-6 minutes.
Trying to connect just gives me 'The socket was closed'
If I was a betting man I'd say they're having issues with their database - either it's lagging beyond what they can deal with or it's just crashing outright. ----- My in Eve Profile My BattleClinic Page |
Taius Pax
|
Posted - 2008.10.30 03:37:00 -
[67]
doh, countdown reached 0 now it's counting from 10 mins.
/me is fienin for some EvE
|
BuckStrider
Fleem Co
|
Posted - 2008.10.30 03:37:00 -
[68]
Edited by: BuckStrider on 30/10/2008 03:37:54
Originally by: Judas Yanakov It would appear to be back down again
Hurry....must move chimera....I gots people to keeeeeeel!
|
Khwalik
Ghetto Kings
|
Posted - 2008.10.30 03:38:00 -
[69]
Lame
|
commander tennder
|
Posted - 2008.10.30 03:38:00 -
[70]
and now its 7 mins
|
|
Bidermaier
|
Posted - 2008.10.30 03:38:00 -
[71]
I was mining when they server went down. Should i worry about my Hulk?
|
Ghost Goat
|
Posted - 2008.10.30 03:38:00 -
[72]
guess the old "lets reboot the cluster and hope it works" didnt work
i was soooo close to change a skill ,give us the damn que allready .
|
Taius Pax
|
Posted - 2008.10.30 03:38:00 -
[73]
Originally by: BuckStrider Edited by: BuckStrider on 30/10/2008 03:37:54
Originally by: Judas Yanakov It would appear to be back down again
Hurry....must move chimera....I gots people to keeeeeeel!
Where's your chimera?
|
Taius Pax
|
Posted - 2008.10.30 03:39:00 -
[74]
Edited by: Taius Pax on 30/10/2008 03:39:51 ick...double post
|
AdioHyperion
Caldari One Stop Mining Shop
|
Posted - 2008.10.30 03:40:00 -
[75]
he doesnt know where it is
|
Tornim
Minmatar HeXstoof
|
Posted - 2008.10.30 03:40:00 -
[76]
only 300 sec.
...
this time
|
Khwalik
Ghetto Kings
|
Posted - 2008.10.30 03:41:00 -
[77]
Originally by: Bidermaier I was mining when they server went down. Should i worry about my Hulk?
should be fine.
|
Generic Alt
|
Posted - 2008.10.30 03:41:00 -
[78]
Originally by: Ghost Goat guess the old "lets reboot the cluster and hope it works" didnt work
i was soooo close to change a skill ,give us the damn que allready .
I was literally 5 mins away from skill train completion when I got booted.
I agree... give us the skill queue, please!
|
AdioHyperion
Caldari One Stop Mining Shop
|
Posted - 2008.10.30 03:41:00 -
[79]
doubt it
|
AdioHyperion
Caldari One Stop Mining Shop
|
Posted - 2008.10.30 03:42:00 -
[80]
Originally by: Generic Alt
Originally by: Ghost Goat guess the old "lets reboot the cluster and hope it works" didnt work
i was soooo close to change a skill ,give us the damn que allready .
I was literally 5 mins away from skill train completion when I got booted.
I agree... give us the skill queue, please!
+1
|
|
Noriko Sakai
Gallente DC1 Coalition
|
Posted - 2008.10.30 03:42:00 -
[81]
Well, ain't I glad that I picked up Red alert 3 earlier today. Installing now
|
sp009
Caldari Organization Outcast
|
Posted - 2008.10.30 03:42:00 -
[82]
Well least i got a timer back 367secs for start up, i wonder if ccp has a stacking penalty to there start up times?
|
Taius Pax
|
Posted - 2008.10.30 03:42:00 -
[83]
Originally by: Bidermaier I was mining when they server went down. Should i worry about my Hulk?
Langoliers probably got it
|
AdioHyperion
Caldari One Stop Mining Shop
|
Posted - 2008.10.30 03:42:00 -
[84]
im showing 190 secs
|
Eternum Praetorian
Tupperware Party
|
Posted - 2008.10.30 03:43:00 -
[85]
Originally by: Dueroth Kael
So whats really goin on ccp... the server has been acting up alot ... lag is worse than ever... and client crashing is more than usual now... i lost two ravens to client crashes.. 1 which is bein petitioned... So whats goin on???
Upgrades....
Welcome to the future
|
Zach Forrester
|
Posted - 2008.10.30 03:43:00 -
[86]
Eep, I hope I didn't have anything to do with this! ^^;
Basically, I was checking through my contracts, when I tried to get details on a contract I'd completed back in February this year. It tried to fetch the data, then I got booted off the server and told the socket was closed.
>.>
<.<
I didn't mean it, honest!
It was either my bad (in which case I deeply apologise for the inconvenience I inadvertently caused) or it was just atrociously bad timing on my part. To quote Jeff Dunham's puppet Walter:
"Remember that last big earthquake? Bad timing on that one."
"Why?"
"Not 2 seconds beforehand I told my grandson to pull my finger. He pulled it, I farted and half the neighbourhood fell down!"
|
James Marshalll
Gallente
|
Posted - 2008.10.30 03:43:00 -
[87]
Originally by: Dueroth Kael
So whats really goin on ccp... the server has been acting up alot ... lag is worse than ever... and client crashing is more than usual now... i lost two ravens to client crashes.. 1 which is bein petitioned... So whats goin on???
Guess that "fix" to offline account training didn't help much. Wonder what new excuse will bet made now.
|
Triffon
Caldari Intervene Industries
|
Posted - 2008.10.30 03:43:00 -
[88]
Originally by: AdioHyperion
Originally by: Generic Alt
Originally by: Ghost Goat guess the old "lets reboot the cluster and hope it works" didnt work
i was soooo close to change a skill ,give us the damn que allready .
I was literally 5 mins away from skill train completion when I got booted.
I agree... give us the skill queue, please!
+1
+1
|
Taius Pax
|
Posted - 2008.10.30 03:43:00 -
[89]
Edited by: Taius Pax on 30/10/2008 03:43:38
Originally by: Noriko Sakai Well, ain't I glad that I picked up Red alert 3 earlier today. Installing now
ohh Noriko Sakai, I use to love her music 12 years ago
edit: if on the completely off chance you are Noriko Sakai, I still love Aoi Usagi
|
Dark 'Shadow
Shadow Fire Industries
|
Posted - 2008.10.30 03:44:00 -
[90]
Originally by: AdioHyperion
Originally by: Generic Alt
Originally by: Ghost Goat guess the old "lets reboot the cluster and hope it works" didnt work
i was soooo close to change a skill ,give us the damn que allready .
I was literally 5 mins away from skill train completion when I got booted.
I agree... give us the skill queue, please!
+1
+2
|
|
Yur mom
|
Posted - 2008.10.30 03:44:00 -
[91]
Originally by: Triffon
Originally by: AdioHyperion
Originally by: Generic Alt
Originally by: Ghost Goat guess the old "lets reboot the cluster and hope it works" didnt work
i was soooo close to change a skill ,give us the damn que allready .
I was literally 5 mins away from skill train completion when I got booted.
I agree... give us the skill queue, please!
+1
+1
+.86 (stacking penalty)
|
|
CCP Valar
|
Posted - 2008.10.30 03:45:00 -
[92]
This is the real deal. Server will be up in a few minutes, possibly a bit laggy while the DB server cache is rebuilt.
I'll post a little post-mortem here in a few. ---- Virtual World Database Administrator Operations department CCP Games |
|
Nacho Muchos
|
Posted - 2008.10.30 03:45:00 -
[93]
Originally by: AdioHyperion
Originally by: Generic Alt
Originally by: Ghost Goat guess the old "lets reboot the cluster and hope it works" didnt work
i was soooo close to change a skill ,give us the damn que allready .
I was literally 5 mins away from skill train completion when I got booted.
I agree... give us the skill queue, please!
+1
I was 15 minutes from finishing a skill, and I was warping into a mission when it went down. I sure hope my ship is still there when I login, and yes we definitely need some sort of skill queue for things like this, even if it is only one skill in advance. I was just about to give up and go to sleep but that would cost me another 6 or so hours of skill training, which is pretty crucial when you are training a new character. >.>
|
Ghost Goat
|
Posted - 2008.10.30 03:45:00 -
[94]
Originally by: Generic Alt
Originally by: Ghost Goat guess the old "lets reboot the cluster and hope it works" didnt work
i was soooo close to change a skill ,give us the damn que allready .
I was literally 5 mins away from skill train completion when I got booted.
I agree... give us the skill queue, please!
5 mins ! man i was hoovering over the skill i wanted to switch to,clicked it and was about to go to sleep when i noticed it didnt changed and a sec later i got disconnected .
|
AdioHyperion
Caldari One Stop Mining Shop
|
Posted - 2008.10.30 03:45:00 -
[95]
Originally by: CCP Valar I'll post a little post-mortem here in a few.
Do what?
|
Nik W
|
Posted - 2008.10.30 03:45:00 -
[96]
Originally by: Triffon
Originally by: AdioHyperion
Originally by: Generic Alt
Originally by: Ghost Goat guess the old "lets reboot the cluster and hope it works" didnt work
i was soooo close to change a skill ,give us the damn que allready .
I was literally 5 mins away from skill train completion when I got booted.
I agree... give us the skill queue, please!
+1
+1
+1
|
commander tennder
|
Posted - 2008.10.30 03:45:00 -
[97]
5 sec
|
Zach Forrester
|
Posted - 2008.10.30 03:46:00 -
[98]
Originally by: CCP Valar This is the real deal. Server will be up in a few minutes, possibly a bit laggy while the DB server cache is rebuilt.
I'll post a little post-mortem here in a few.
Again, I apologise if I had anything to do with this. XD I swear I'm paranoid now. A hundred angry mercenaries will come to pod me, I'm sure of it. *panicpanicpanic*
|
Otho Underhill
|
Posted - 2008.10.30 03:46:00 -
[99]
In
|
Super Skulls
Twin Sun Syndicate
|
Posted - 2008.10.30 03:46:00 -
[100]
zomg it worx!!!!
|
|
Tukaa
Amarr Burning Sky Labs
|
Posted - 2008.10.30 03:46:00 -
[101]
ONLINE
|
Mankirks Wife
|
Posted - 2008.10.30 03:46:00 -
[102]
Originally by: Yur mom
+.86 (stacking penalty)
Due to balance issues, we have seen fit to nerf pyramid quotes. ---
|
AdioHyperion
Caldari One Stop Mining Shop
|
Posted - 2008.10.30 03:47:00 -
[103]
So far so good....
|
Cygnus DivumExuro
Gallente
|
Posted - 2008.10.30 03:47:00 -
[104]
bet folks are not thinking those IBM Blade Servers are not as cool as first thought!
|
Taius Pax
|
Posted - 2008.10.30 03:47:00 -
[105]
woot! it's back!
|
sp009
Caldari Organization Outcast
|
Posted - 2008.10.30 03:47:00 -
[106]
The Servers up everyone togather log in n see if it is really fix'd
|
Taius Pax
|
Posted - 2008.10.30 03:48:00 -
[107]
Originally by: Cygnus DivumExuro bet folks are not thinking those IBM Blade Servers are not as cool as first thought!
was that double negative intentional?
|
Noriko Sakai
Gallente DC1 Coalition
|
Posted - 2008.10.30 03:48:00 -
[108]
Server up ;-)
|
Saardinen
|
Posted - 2008.10.30 03:49:00 -
[109]
I'm just waiting for the postmortem. *nailbites*
|
Dinsdale Pirannha
Gallente
|
Posted - 2008.10.30 03:51:00 -
[110]
I have worked for a large company (think 3 letters) and we hosted many, many customers' web sites. Very rarely, we would have outages. All hell would break loose, even when we did not own the software/hardware/network.
In the case of the problem being traced back to something my company did, somebody would get fired. It is simply incomprehensible to me that ANY business would mess with their active database during regular business hours (that is the 23 hours/day in this case). And trust me, the only way CCP had a failure was if something WAS CHANGED.
You want to make changes that can't be done in the one hour you have allocated every day, you SCHEDULE A CHANGE WINDOW. You give everyone at least a week's heads up, and you bring down the server at a time which impacts the fewest people.
But this ad hoc outages are ridiculous, and would never happen if CCP actually followed some kind of discipline that every other company follows where its customers need to access information online.
Can you imagine what would happen if your bank decided to upgrade their database at 2:00 pm on a Wednesday? BTW, it is standard practice for banks, and most large firms, to schedule network outages from 12:01 am to 4:00 am on Sundays. That of course would not work for CCP, given the nature of their business, but there are times where impact would be minimized on their customer base.
I have been playing Eve for 6 months and am stunned at the lack or professionalism of their technical staff. The CIO should be fired.
|
|
Elaron
Jericho Fraction The Star Fraction
|
Posted - 2008.10.30 03:56:00 -
[111]
Originally by: Dinsdale Pirannha <snipped a rant>
How about you wait for the post mortem before you get on your high horse? By past experience Valar & co are pretty good at explaining the causes of these unplanned outages.
|
|
CCP Mitnal
C C P
|
Posted - 2008.10.30 03:57:00 -
[112]
Originally by: AdioHyperion
Originally by: CCP Valar I'll post a little post-mortem here in a few.
Do what?
Valar will explain what happened
I believe it will state that the servers were not at fault for those knocking them.
Mitnal Community Representative CCP Games, EVE Online Email / Netfang |
|
Xaniff
|
Posted - 2008.10.30 03:58:00 -
[113]
Originally by: Dinsdale Pirannha
In the case of the problem being traced back to something my company did, somebody would get fired. It is simply incomprehensible to me that ANY business would mess with their active database during regular business hours (that is the 23 hours/day in this case). And trust me, the only way CCP had a failure was if something WAS CHANGED.
You want to make changes that can't be done in the one hour you have allocated every day, you SCHEDULE A CHANGE WINDOW. You give everyone at least a week's heads up, and you bring down the server at a time which impacts the fewest people.
But this ad hoc outages are ridiculous, and would never happen if CCP actually followed some kind of discipline that every other company follows where its customers need to access information online.
I have been playing Eve for 6 months and am stunned at the lack or professionalism of their technical staff. The CIO should be fired.
I think the problem has been more of a hardware issue than software. And there was that problem with a local ISP yesterday which may have contributed.
|
Zach Forrester
|
Posted - 2008.10.30 03:59:00 -
[114]
Originally by: CCP Mitnal
Originally by: AdioHyperion
Originally by: CCP Valar I'll post a little post-mortem here in a few.
Do what?
Valar will explain what happened
I believe it will state that the servers were not at fault for those knocking them.
XD I'm gonna die, I know it. I honestly didn't mean it, whatever I did.
|
Ghost Goat
|
Posted - 2008.10.30 03:59:00 -
[115]
Originally by: Dinsdale Pirannha I have worked for a large company (think 3 letters) and we hosted many, many customers' web sites. Very rarely, we would have outages. All hell would break loose, even when we did not own the software/hardware/network.
In the case of the problem being traced back to something my company did, somebody would get fired. It is simply incomprehensible to me that ANY business would mess with their active database during regular business hours (that is the 23 hours/day in this case). And trust me, the only way CCP had a failure was if something WAS CHANGED.
You want to make changes that can't be done in the one hour you have allocated every day, you SCHEDULE A CHANGE WINDOW. You give everyone at least a week's heads up, and you bring down the server at a time which impacts the fewest people.
But this ad hoc outages are ridiculous, and would never happen if CCP actually followed some kind of discipline that every other company follows where its customers need to access information online.
Can you imagine what would happen if your bank decided to upgrade their database at 2:00 pm on a Wednesday? BTW, it is standard practice for banks, and most large firms, to schedule network outages from 12:01 am to 4:00 am on Sundays. That of course would not work for CCP, given the nature of their business, but there are times where impact would be minimized on their customer base.
I have been playing Eve for 6 months and am stunned at the lack or professionalism of their technical staff. The CIO should be fired.
well you can say that , or you can say wooooooooooooooo omgomgogmg the server is up !11!11!1111 /me do the happy dance ,after realizing what i just did go hide in the corner in shame .
skill changed i can go to sleep a happy man now ...
but we still need the damn skill que .
ghost training is a goner , no excuses now .
|
|
CCP Valar
|
Posted - 2008.10.30 04:01:00 -
[116]
With my outfit still smoking a bit, fresh from some firefighting, I bring you... THE POST MORTEM
The server crash tonight was a result of our attempts to prevent a server crash earlier today. Around 21:20 this evening, we had an automatic alert go off, warning us that a RAMSAN was critically low on disk space. In an attempt to fix this, we shrank the data file on it and started an index defrag, to free up space in the datafile.... crisis averted... or so we thought.
At 2 AM, a full backup of the database started, but the index defragmentation of the biggest, most critical table in the database was still underway. While a full backup of the database is being performed, the transaction log is not truncated on transaction log backups and with the increased activity that comes with the index defrag, the transaction log quickly grew to fill up both RAMSANs... This is what lead to the server crash.
When I got a phone call from the on-call person, the server was already down. I proceeded to do a fail-over of the database server, shrink the transaction log files and the datafiles on the RAMSANs. When I had done this, I attempted to start the server, but it took 3 startup attempts before nodes started registering themselves in the database on time, likely due to the "warming up" the database has to do after a failover.
I'm truly sorry for the inconvenience this caused you and hope you can enjoy playing for the rest of the night. ---- Virtual World Database Administrator Operations department CCP Games |
|
Pr1ncess Alia
Caldari Perkone
|
Posted - 2008.10.30 04:02:00 -
[117]
(scene: front of an office building. press conference setting.)
front door opens and late middle aged man dressed in a business suit walks out
CEO: *ahem* I just crapped my pants.
crowd mumbles and whispers. a few scratch their heads.
CEO: That is all for now, thank you. We won't be taking questions at this time. Feel free to talk amongst yourselves.
flash bulbs go off. Business man walks back into the office building.
i kid i kid! Thanks for gettin er back up and running
|
Zach Forrester
|
Posted - 2008.10.30 04:03:00 -
[118]
Originally by: CCP Valar With my outfit still smoking a bit, fresh from some firefighting, I bring you... THE POST MORTEM
The server crash tonight was a result of our attempts to prevent a server crash earlier today. Around 21:20 this evening, we had an automatic alert go off, warning us that a RAMSAN was critically low on disk space. In an attempt to fix this, we shrank the data file on it and started an index defrag, to free up space in the datafile.... crisis averted... or so we thought.
At 2 AM, a full backup of the database started, but the index defragmentation of the biggest, most critical table in the database was still underway. While a full backup of the database is being performed, the transaction log is not truncated on transaction log backups and with the increased activity that comes with the index defrag, the transaction log quickly grew to fill up both RAMSANs... This is what lead to the server crash.
When I got a phone call from the on-call person, the server was already down. I proceeded to do a fail-over of the database server, shrink the transaction log files and the datafiles on the RAMSANs. When I had done this, I attempted to start the server, but it took 3 startup attempts before nodes started registering themselves in the database on time, likely due to the "warming up" the database has to do after a failover.
I'm truly sorry for the inconvenience this caused you and hope you can enjoy playing for the rest of the night.
Okay, so it wasn't my fault. ^^ *walks away a free man* XD I swear I thought I was gonna be hunted down there.
|
Syberbolt8
Gallente The Scope
|
Posted - 2008.10.30 04:05:00 -
[119]
Originally by: Zach Forrester
Originally by: CCP Valar With my outfit still smoking a bit, fresh from some firefighting, I bring you... THE POST MORTEM
The server crash tonight was a result of our attempts to prevent a server crash earlier today. Around 21:20 this evening, we had an automatic alert go off, warning us that a RAMSAN was critically low on disk space. In an attempt to fix this, we shrank the data file on it and started an index defrag, to free up space in the datafile.... crisis averted... or so we thought.
At 2 AM, a full backup of the database started, but the index defragmentation of the biggest, most critical table in the database was still underway. While a full backup of the database is being performed, the transaction log is not truncated on transaction log backups and with the increased activity that comes with the index defrag, the transaction log quickly grew to fill up both RAMSANs... This is what lead to the server crash.
When I got a phone call from the on-call person, the server was already down. I proceeded to do a fail-over of the database server, shrink the transaction log files and the datafiles on the RAMSANs. When I had done this, I attempted to start the server, but it took 3 startup attempts before nodes started registering themselves in the database on time, likely due to the "warming up" the database has to do after a failover.
I'm truly sorry for the inconvenience this caused you and hope you can enjoy playing for the rest of the night.
Okay, so it wasn't my fault. ^^ *walks away a free man* XD I swear I thought I was gonna be hunted down there.
We can hunt you down anyway if you like... shouldn't be much of an issue. Im Looking for a new Home |
Stuart Bruegel
Gallente
|
Posted - 2008.10.30 04:09:00 -
[120]
Originally by: CCP Valar With my outfit still smoking a bit, fresh from some firefighting, I bring you... THE POST MORTEM
<snip>
Gotta love backups. I swear they break things far more often than you have to use them.
Thanks for the detailed post-mortem! Those of us in the business appreciate it.
Go get some sleep. :-)
|
|
Xaniff
|
Posted - 2008.10.30 04:11:00 -
[121]
Originally by: Zach Forrester It tried to fetch the data, then I got booted off the server and told the socket was closed.
That wouldn't cause the server to crash. No worries.
|
|
CCP Mitnal
C C P
|
Posted - 2008.10.30 04:33:00 -
[122]
Glue removed.
Fly safe y'all!
Mitnal Community Representative CCP Games, EVE Online Email / Netfang |
|
Sammie10
|
Posted - 2008.10.30 04:37:00 -
[123]
was the backup a scheduled task or the result of someone thinking it would be a good time to run a backup?
|
21 Salvager
|
Posted - 2008.10.30 04:49:00 -
[124]
Edited by: 21 Salvager on 30/10/2008 04:49:36 Server Down 2: Electric Boogaloo?
My fleet of 4 just got disconnected.
|
Bohoba
Caldari HolyKnights
|
Posted - 2008.10.30 06:40:00 -
[125]
Is Eve still down ,, am at work for another 30 min or so and Eve Offline shows it not up ??
10.5 hours a day do you have what it takes ?
|
AleRiperKilt
|
Posted - 2008.10.30 13:26:00 -
[126]
Originally by: CCP Valar While a full backup of the database is being performed, the transaction log is not truncated on transaction log backups and with the increased activity that comes with the index defrag, the transaction log quickly grew to fill up both RAMSANs... This is what lead to the server crash.
And this Ladies and Gentleman is what happens when you run your database in Microsoft Software. They just don't know how to design software to handle critical uptime situations.
I wonder if the database server went down with a BSOD when it ran out of space.
--- "I live in Los Angeles, where driving is non-consensual pvp" - Arric Rohr |
Phaige
Minmatar Reaver Construction Services
|
Posted - 2008.10.30 16:31:00 -
[127]
Originally by: Taius Pax
Originally by: Bidermaier I was mining when they server went down. Should i worry about my Hulk?
Langoliers probably got it
*nom nom nom nom nom nom* (Phaige pulls out a new napkin and begins shreding it) *nom nom nom nom nom nom
-----------------------------------------------
You may be a King or a little Street Sweeper, but sooner or later you dance wi' de' Reaper! |
Tipz NexAstrum
Celestial Horizon Corp. Celestial Industrial Alliance
|
Posted - 2008.10.30 17:59:00 -
[128]
"It's 3 AM and your exotic dancers are safely asleep, but there's a phone in CCP and its ringing. SomethingÆs happening in the server. Your petition will decide who answers that call. Whether it's someone who already knows the database, knows the servers, someone tested and ready to fix in this complicated cluster. It's 3 AM and your exotic dancers are safely asleep, who do you want answering the phone?"
Approved by the committee to elect CCP Valar as completely awesome
Originally by: CCP Navigator People who think I am joking or talking big are going to understand very quickly that there will be order in these forums.
|
Elaron
Jericho Fraction The Star Fraction
|
Posted - 2008.10.30 18:10:00 -
[129]
Originally by: AleRiperKilt They just don't know how to design software to handle critical uptime situations.
I'd hardly classify a game as a 'critical uptime situation'. And even ignoring that, it's been a while since database gremlins have been the primary cause for an outage.
|
PROTOCOL
|
Posted - 2008.10.30 19:11:00 -
[130]
Edited by: PROTOCOL on 30/10/2008 19:14:45
Quote: And this Ladies and Gentleman is what happens when you run your database in Microsoft Software. They just don't know how to design software to handle critical uptime situations.
Man, you should tell the guys over at the Nasdaq that, they might not know. Every trade processed on the nasdaq goes though MSSQL. One of many large companies who rely on it to get the job done.
|
|
|
|
|
Pages: 1 2 3 4 5 :: [one page] |