Pages: 1 2 3 4 5 6 7 8 :: [one page] |
|
Author |
Thread Statistics | Show CCP posts - 13 post(s) |
|
CCP Falcon
444
|
Posted - 2012.11.04 01:11:00 -
[1] - Quote
Tranquility and our web services were taken offline for an emergency reboot at 01:05 GMT on November 4th.
We are currently investigating ongoing server issues. At present the ETA for Tranquility to be back online is 1.5 hours.
This thread will be updated when we have more information. We apologize for any inconvenience caused for the unscheduled downtime.
UPDATE - 03:55 - Tranquility is back online for testing purposes and is currently not accepting connections. CCP Falcon -á-á||-á-áEVE Community Team -á|| -á-áEVE Illuminati -á-á||-á-á@CCP_Falcon
-á-- Disciple Of The Delicious Tea -- |
|
Thomas Gallant
Choke-Hold
11
|
Posted - 2012.11.04 01:15:00 -
[2] - Quote
Cool, glad it's being worked on.
Edit: first, and that's good because I guess... I can sell ad space here or something? not really sure of the point of being first, but I'm going to grab me one of these "first"s for later, in case I need one. |
Disciple Amphal
Royal Amarr Institute Amarr Empire
7
|
Posted - 2012.11.04 01:15:00 -
[3] - Quote
It'd be awesome is all the data was corrupted/destroyed and we had to start from scratch! |
James Amril-Kesh
RAZOR Alliance
1148
|
Posted - 2012.11.04 01:15:00 -
[4] - Quote
Because of Falcon? http://themittani.com/features/local-problem A simple fix to the local intel problem |
Surfin's PlunderBunny
Sebiestor Tribe Minmatar Republic
3406
|
Posted - 2012.11.04 01:16:00 -
[5] - Quote
Artist rendition of what happened "Little ginger moron" ~David Hasselhoff-á |
Solaris Ecladia
League of Non-Aligned Worlds Nulli Secunda
25
|
Posted - 2012.11.04 01:16:00 -
[6] - Quote
I want to post in this. |
kaspa101
The Generic Pirate Corporation Fusion.
0
|
Posted - 2012.11.04 01:16:00 -
[7] - Quote
you said 1.5 hrs over 30minutes ago on twitter.. wtf? now add another 30? ITS THE GOONS AT WORK! RUN FOR THE HILLS! |
Mrs Doubtfire
Quam Singulari Suddenly Spaceships.
32
|
Posted - 2012.11.04 01:17:00 -
[8] - Quote
From Twitter:
EVE Online GÇÅ@EveOnline
This is looking to be a potential hardware issue. More updates soon as we learn more. Sorry for the current lack of pew pew!
Please eleborate.
How on earth would a single isolated hardware issue, be a problem to your servers? I would expect your systems to be redundant?? |
Jaison Savrin
Remnants of the Forgotten Seekers of the Unseen
79
|
Posted - 2012.11.04 01:17:00 -
[9] - Quote
We believe in you CCP. We can play other games while you fix our addiction. |
Alara IonStorm
3387
|
Posted - 2012.11.04 01:17:00 -
[10] - Quote
Surfin's PlunderBunny wrote: Jokes on them, I have a Mushroom. |
|
Mourning Souls
Red Federation RvB - RED Federation
20
|
Posted - 2012.11.04 01:19:00 -
[11] - Quote
Err, wasn't us I swear. |
ISquishWorms
171
|
Posted - 2012.11.04 01:20:00 -
[12] - Quote
Too much dust on your servers? Dear Santa, all I would like for-áChristmas 2013-áare some snowballs and something to fire them from please, thank you. |
Skippy Usenet
Imperial Academy Amarr Empire
3
|
Posted - 2012.11.04 01:20:00 -
[13] - Quote
This is why I hate monthly subscriptions. |
Mechaet
Thunderwaffe Goonswarm Federation
37
|
Posted - 2012.11.04 01:20:00 -
[14] - Quote
Mrs Doubtfire wrote:From Twitter:
EVE Online GÇÅ@EveOnline
This is looking to be a potential hardware issue. More updates soon as we learn more. Sorry for the current lack of pew pew!
Please eleborate.
How on earth would a single isolated hardware issue, be a problem to your servers? I would expect your systems to be redundant?? If the RAMSAN took a dump, then something VeryBad happened to a system that is supposed to be self-redundant. |
Hottspitta jR
Knights of Azrael The Azrael Alliance
1
|
Posted - 2012.11.04 01:21:00 -
[15] - Quote
Mrs Doubtfire wrote:From Twitter:
EVE Online GÇÅ@EveOnline
This is looking to be a potential hardware issue. More updates soon as we learn more. Sorry for the current lack of pew pew!
Please eleborate.
How on earth would a single isolated hardware issue, be a problem to your servers? I would expect your systems to be redundant??
Even the most redundant systems have their moment's. You can never make something 100% solid. Can only try your best to achieve. This is pretty damn rare... Doesn't happen like this every year... Hottspitta jR / Harbinger'of'Life |
Da'iel Zehn
Evil Frosty's Premium Liqours and Fine Wines
3
|
Posted - 2012.11.04 01:21:00 -
[16] - Quote
*takes a seat on floor and rests against wall while waiting* |
Benny Ohu
Chaotic Tranquility Casoff
387
|
Posted - 2012.11.04 01:21:00 -
[17] - Quote
Fix the portrait server first, the only portraits I can see are Surfin's and Alara's and they're ugly as sin
Mourning Souls wrote:Err, wasn't us I swear. Someone actually shot the primary for once and the server died in shock |
recky markaira
Southern Cross Empire Flying Dangerous
1
|
Posted - 2012.11.04 01:22:00 -
[18] - Quote
may the schwartz be with you! |
Mavej
Viziam Amarr Empire
0
|
Posted - 2012.11.04 01:22:00 -
[19] - Quote
ISquishWorms wrote:Too much dust on your servers?
That is good. |
Junko Asagiri
0ne Percent. Transmission Lost
0
|
Posted - 2012.11.04 01:22:00 -
[20] - Quote
toasting, thanks for the updates |
|
|
Chribba
Otherworld Enterprises Otherworld Empire
5396
|
Posted - 2012.11.04 01:23:00 -
[21] - Quote
Keep up the good work!
Also, you growling pilots can say "I was there, for the big outage of Nov'2012".
/c
|
|
Matthias Duran
Red Federation RvB - RED Federation
29
|
Posted - 2012.11.04 01:23:00 -
[22] - Quote
For the record, RvB asked for CCP's permission before we did our 10,000 rifter thing, and they said it would be ok and supposedly had the server reinforced for it. Obviously it was not reinforced enough. |
Asari Tadaruwa
Fweddit I Whip My Slaves Back and Forth
6
|
Posted - 2012.11.04 01:24:00 -
[23] - Quote
hi |
nortelslug
Ion Manufacturing and Development Systems Freemen Alliance
3
|
Posted - 2012.11.04 01:24:00 -
[24] - Quote
Hottspitta jR wrote:Mrs Doubtfire wrote:From Twitter:
EVE Online GÇÅ@EveOnline
This is looking to be a potential hardware issue. More updates soon as we learn more. Sorry for the current lack of pew pew!
Please eleborate.
How on earth would a single isolated hardware issue, be a problem to your servers? I would expect your systems to be redundant?? Even the most redundant systems have there moment's. You can never make something 100% solid. Can only try your best to achieve. This is pretty damn rare... Doesn't happen like this every year...
This.
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end. |
James Amril-Kesh
RAZOR Alliance
1148
|
Posted - 2012.11.04 01:26:00 -
[25] - Quote
nortelslug wrote:The world did not end. No, but we don't have that much time until it does. http://themittani.com/features/local-problem A simple fix to the local intel problem |
Captain Hurrdurr
Red Federation RvB - RED Federation
2
|
Posted - 2012.11.04 01:27:00 -
[26] - Quote
Mourning Souls wrote:Err, wasn't us I swear.
|
Musashibou Benkei
Combined Imperial Fleet JIHADASQUAD
5
|
Posted - 2012.11.04 01:27:00 -
[27] - Quote
Where's CCP Tuxford? I'm sure he's behind this............................again |
rodyas
Tie Fighters Inc
822
|
Posted - 2012.11.04 01:28:00 -
[28] - Quote
Is it Windows 8's fault? I'm not shitposting. |
Thomas Gallant
Choke-Hold
11
|
Posted - 2012.11.04 01:29:00 -
[29] - Quote
100% uptime is like the speed of light, the closer you get to it, the harder it becomes 99.999% up-time is a ton harder than 99.99 up-time, and 100%? you have to never have any downtime ever, til the end of time, and thats... a lofty goal.
Though I don't think anyone here is expecting a 100% up-time, things do happen after all. Though if you're expecting 99.8 up-time and getting 99.5, I guess that's 0.3 of disappointment there. |
Rengerel en Distel
Amarr Science and Industry
494
|
Posted - 2012.11.04 01:29:00 -
[30] - Quote
Matthias Duran wrote:For the record, RvB asked for CCP's permission before we did our 10,000 rifter thing, and they said it would be ok and supposedly had the server reinforced for it. Obviously it was not reinforced enough.
So it's true that blob pvp will be the death of eve?
|
|
David Nardieus
Alpha Celestial Resources
0
|
Posted - 2012.11.04 01:30:00 -
[31] - Quote
First post in EVE forums!!! |
Rocketfish
Fearless Bandits SpaceMonkey's Alliance
0
|
Posted - 2012.11.04 01:30:00 -
[32] - Quote
Two concepts: Co Location Instant Failover
I can understand downtime for the game server. But the webserver should be easily failover able |
Nagapito
Calamitous-Intent
18
|
Posted - 2012.11.04 01:30:00 -
[33] - Quote
Its just me or the date/time of the post is not equal to the server time? |
Robus Muvila
GoonWaffe Goonswarm Federation
78
|
Posted - 2012.11.04 01:30:00 -
[34] - Quote
my Dusk app just told me my skill queue just finished. Oh God....
OH GOD...
AAAAAAAAAAAAAAAAAAAAH....
http://themittani.com - Because EvE has needed a proper news site for ages |
|
CCP Guard
C C P C C P Alliance
2956
|
Posted - 2012.11.04 01:32:00 -
[35] - Quote
Mrs Doubtfire wrote:From Twitter:
EVE Online GÇÅ@EveOnline
This is looking to be a potential hardware issue. More updates soon as we learn more. Sorry for the current lack of pew pew!
Please eleborate.
How on earth would a single isolated hardware issue, be a problem to your servers? I would expect your systems to be redundant??
We've yet to do a full post mortem internally about the details. I'd probably cause some sort of real world downtime if I tried to explain the technical details with my insights, but we'll give you more details later.
:P CCP Guard | EVE Community Developer |-á@ccp_guard |
|
Kelseru
Extreme Dimensions
0
|
Posted - 2012.11.04 01:33:00 -
[36] - Quote
Robus Muvila wrote:my Dusk app just told me my skill queue just finished. Oh God....
OH GOD...
AAAAAAAAAAAAAAAAAAAAH....
Your telling me... I got home at 1:37 to add more skills to my que that was ending at 1:48 |
Andski
GoonWaffe Goonswarm Federation
5455
|
Posted - 2012.11.04 01:33:00 -
[37] - Quote
nortelslug wrote:This.
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end.
A backup Internet? ~*a-áproud belligerent undesirable*~ |
Thomas Gallant
Choke-Hold
11
|
Posted - 2012.11.04 03:41:00 -
[38] - Quote
Robus Muvila wrote:my Dusk app just told me my skill queue just finished. Oh God....
OH GOD...
AAAAAAAAAAAAAAAAAAAAH....
imagine a clock of death, but instead of counting down to your death, it counts up to however many skillpoints you've lost (or well, not earned I guess)
Ah, that's not helping much is it? |
Gizznitt Malikite
Agony Unleashed Agony Empire
708
|
Posted - 2012.11.04 03:42:00 -
[39] - Quote
update? |
Elyi Gallente
X-Tech Corp
0
|
Posted - 2012.11.04 03:42:00 -
[40] - Quote
Just hurry up we wanna play lol!!!!!! |
|
xwolfi
3
|
Posted - 2012.11.04 03:42:00 -
[41] - Quote
Rocketfish wrote:Two concepts: Co Location Instant Failover
I can understand downtime for the game server. But the webserver should be easily failover able
Well we can all give our little genius advice about how CCP should do this and that, but the problem is that they clearly don't have the need amazon.com has for exemple (not as many client) and has more need than your sister's blog (much more clients). So they're stuck like that between using huge and complicated failover mechanics they would need once a year, and not doing anything at all.
We have the same problem every winter in Paris: we've got only like 5 snowplough for 12 millions inhabitants because we see snow once every two years... why would the city invest in an overkill setup ? But when like last year the snow falls during 7 days, then we're totally screwed and lost. No choice, it'll never improve unless we have a WoW-like userbase. |
Fiona Gallagher
Brutor Tribe Minmatar Republic
0
|
Posted - 2012.11.04 03:42:00 -
[42] - Quote
Do i forsee any gifts CCP making us wait for that hour in half ??? extra skills points or free newbie stuff |
Norrin Ellis
Venture Racing
85
|
Posted - 2012.11.04 03:42:00 -
[43] - Quote
Because of [CCP] Falcon... CEO, Venture Racing Senior Banker, EVE Online Hold'Em |
James Amril-Kesh
RAZOR Alliance
1149
|
Posted - 2012.11.04 03:43:00 -
[44] - Quote
Andski wrote:nortelslug wrote:This.
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end. A backup Internet? Might as well just replace it with a strawberry for equivalent weight. http://themittani.com/features/local-problem A simple fix to the local intel problem |
Surfin's PlunderBunny
Sebiestor Tribe Minmatar Republic
3409
|
Posted - 2012.11.04 03:43:00 -
[45] - Quote
I wanted to log in because I was going to do something but now I forgot what it was "Little ginger moron" ~David Hasselhoff-á |
Robyn Green
EG CORP Talocan United
2
|
Posted - 2012.11.04 03:43:00 -
[46] - Quote
Mrs Doubtfire wrote: Please eleborate.
How on earth would a single isolated hardware issue, be a problem to your servers? I would expect your systems to be redundant??
Last time one of their server blades caught fire and melted. I have yet to hear of a story where fire and electronics mixed well. |
Tyr Styrkar
Roden Industries It's Not Fair
0
|
Posted - 2012.11.04 03:43:00 -
[47] - Quote
Yass Servers back up in 1 min!! |
Andski
GoonWaffe Goonswarm Federation
5455
|
Posted - 2012.11.04 03:43:00 -
[48] - Quote
Elyi Gallente wrote:Just hurry up we wanna play lol!!!!!!
Then go play LoL? ~*a-áproud belligerent undesirable*~
TheMittani.com |
Remiel Pollard
Devlin Security Devlin Alliance
19
|
Posted - 2012.11.04 03:43:00 -
[49] - Quote
rodyas wrote:Is it Windows 8's fault?
This would explain a lot.
You guys aren't using cloud storage for EVE data, are you? That would be a BAD CCP. I am 12 and what is this?? |
Gil vanGorne
Infinite Improbability Inc Mordus Angels
0
|
Posted - 2012.11.04 03:43:00 -
[50] - Quote
Oh man!! I was looking forward to some birthday kills before hitting the pub.
Ah well, stuff happens! |
|
Rocketfish
Fearless Bandits SpaceMonkey's Alliance
0
|
Posted - 2012.11.04 03:43:00 -
[51] - Quote
1 minute and counting!! |
Helena Russell Makanen
Deep Core Mining Inc. Caldari State
162
|
Posted - 2012.11.04 03:43:00 -
[52] - Quote
Status: Starting up (34 seconds)
Less than one second Less than one second Less than one second lol "If a miner needs to go to the bathroom, for instance, I ask that they dock up first, or at the very least ask the Supreme Protector for permission to go."-á --á James 315 - aka - the miner bumper |
Xeromax Tadaruwa
UNNILHEXIUM PLUTONIUM-239 CYBORG ENGINEERING
0
|
Posted - 2012.11.04 03:44:00 -
[53] - Quote
Just tried logging in...gave message Starting up (24 sec) |
James Amril-Kesh
RAZOR Alliance
1149
|
Posted - 2012.11.04 03:44:00 -
[54] - Quote
Fiona Gallagher wrote:Do i forsee any gifts CCP making us wait for that hour in half ??? extra skills points or free newbie stuff No, as far as I know this has never happened except for one case where the servers were down for over 3 days. http://themittani.com/features/local-problem A simple fix to the local intel problem |
Tinja Soikutsu
Minmatar Ship Construction Services Ushra'Khan
237
|
Posted - 2012.11.04 03:44:00 -
[55] - Quote
THIS IS WHY ECM NEEDS TO BER NERFED NAOW! GOONZ ECM SPAMMED TEH SERVERS!!! BANZORZ THEM ALL!!!!!!!! |
Rojo Solette
Protogenoi Industries
0
|
Posted - 2012.11.04 03:44:00 -
[56] - Quote
I Love CCP keep up the good work Im sure your all doing your best to fix these. on another where can i get that qaufe?
|
Jeep Rubicon
Jeep Enterprise
0
|
Posted - 2012.11.04 03:45:00 -
[57] - Quote
Obviously this was caused by highsec mining. once again, those subscription paying hippies have ruined the game for 20% of the rest.
|
Reticle
Sight Picture
74
|
Posted - 2012.11.04 03:46:00 -
[58] - Quote
Chribba wrote:Keep up the good work!
Also, you growling pilots can say "I was there, for the big outage of Nov'2012".
/c I was there for the 1.5 day outage that resulted in getting presents |
Thomas Gallant
Choke-Hold
11
|
Posted - 2012.11.04 03:46:00 -
[59] - Quote
I'm going to take that starting up in 30 seconds message with a VERY large grain of salt, maybe even two. Ah wait, my doctor said I needed to cut down on salt, for my blood pressure.
*repeatedly tries to log in* |
Theij Musashi
Concordiat Tribal Band
0
|
Posted - 2012.11.04 03:46:00 -
[60] - Quote
Server starting up in 5.....4....3....2...1, Server starting up in 5...4...3...2...1, Server starting up in 5...4...3...2...1. Groundhog Day anyone? |
|
Tyr Styrkar
Roden Industries It's Not Fair
0
|
Posted - 2012.11.04 03:47:00 -
[61] - Quote
Who ever knew there could be so many 5 seconds. |
Kelseru
Extreme Dimensions
1
|
Posted - 2012.11.04 03:47:00 -
[62] - Quote
Server status: Not accepting connectoins Lawl |
James Amril-Kesh
RAZOR Alliance
1149
|
Posted - 2012.11.04 03:47:00 -
[63] - Quote
Connecting... connecting.... connecting... connecting... connecting... http://themittani.com/features/local-problem A simple fix to the local intel problem |
Water
Don't Be a Menace
2
|
Posted - 2012.11.04 03:47:00 -
[64] - Quote
I don't want free SP for this. 500k wouldn't make a dent in my pursuit of my second Carrier V.
All I ask is for a few Gravimetric sites in place of the crappy Ladar sites my home system seems to think I love so very much.
Oh, and a Ragnarok. Apparently those are the best mining ships these days, and those Gravimetrics you want to give me won't mine themselves. |
Alywyn Shrike
EVE University Ivy League
0
|
Posted - 2012.11.04 03:47:00 -
[65] - Quote
I'm so cold, so very cold..... |
Rocketfish
Fearless Bandits SpaceMonkey's Alliance
0
|
Posted - 2012.11.04 03:48:00 -
[66] - Quote
Stupid cluster...not accepting connection. way to troll me CCP |
PO3T
Black Dawn Rising
0
|
Posted - 2012.11.04 03:48:00 -
[67] - Quote
Well, at least we can post on the forum again ^^ |
Helena Russell Makanen
Deep Core Mining Inc. Caldari State
162
|
Posted - 2012.11.04 03:49:00 -
[68] - Quote
Alywyn Shrike wrote:I'm so cold, so very cold.....
Hug and rub to warm you up.
"If a miner needs to go to the bathroom, for instance, I ask that they dock up first, or at the very least ask the Supreme Protector for permission to go."-á --á James 315 - aka - the miner bumper |
Water
Don't Be a Menace
2
|
Posted - 2012.11.04 03:49:00 -
[69] - Quote
Alywyn Shrike wrote:I'm so cold, so very cold.....
That's because we keep podding you guys =D |
Daemon Ceed
Tea And Sympathy Ltd. Liability Reckless Ambition
308
|
Posted - 2012.11.04 03:49:00 -
[70] - Quote
nortelslug wrote:
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end.
Hundreds of millions? Not quite. You can get very close HA (the OS's would have to reboot) with a VMWare cluster running your hosts and redundant SAN's connected to the cluster. I spoke to a Dev @ Eve Vegas and the issue running on VMWare ESXi was that when a node migrates from one server to another it either hangs on re-building the node. It seems more of a software issue than anything else, but if they really wanted to I'm sure they could find a solution to the problem.
Plainly put, relying on physical hosts to run everything on bare metal leads to long downtimes. Utilize virtualization, snapshotted data storage or continuous replication, and you can effectively ensure 99.99% update and razor thin RTO/RPO's for a few hundred thousand for a medium sized business. Not hundreds of millions. I do it at my job every day and have never had a time where systems weren't live within 5 minutes or less during a catastrophic failure. We also use Site Recovery so with a single click of a button we can bring our systems online at a secondary site within minutes should we our primary datacenter gets cratered.
The Sandbox = Play however the hell you want. |
|
Escobar Noreaga
Red Federation RvB - RED Federation
3
|
Posted - 2012.11.04 03:51:00 -
[71] - Quote
The RvB event broke it, 10000 rifters literally blotted out the sun, the sun went supernova and jita was caught in the wormhole created by said event.
Reports state that the millions of scam bots cried out at the injustice and the Universe answered.
RIP |
Kenneth O'Hara
Bareback Pornstars Fade 2 Black
3367
|
Posted - 2012.11.04 03:51:00 -
[72] - Quote
I think someone "accidently" kicked one of the extension cords for the servers and now they are trying to find out which one is unplugged. Best thread ever!!!
Stick around. I'm full of bad ideas. ~Isaac Clarke |
Korwiin
Dracos Dozen Eve Engineering
0
|
Posted - 2012.11.04 03:51:00 -
[73] - Quote
nortelslug wrote:
This.
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end.
Hardware vendors love customers that assume this is true. |
Divine Chaoss
Leeole's Legion
0
|
Posted - 2012.11.04 03:52:00 -
[74] - Quote
Daemon Ceed wrote:nortelslug wrote:
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end.
Hundreds of millions? Not quite. You can get very close HA (the OS's would have to reboot) with a VMWare cluster running your hosts and redundant SAN's connected to the cluster. I spoke to a Dev @ Eve Vegas and the issue running on VMWare ESXi was that when a node migrates from one server to another it either hangs on re-building the node. It seems more of a software issue than anything else, but if they really wanted to I'm sure they could find a solution to the problem. Plainly put, relying on physical hosts to run everything on bare metal leads to long downtimes. Utilize virtualization, snapshotted data storage or continuous replication, and you can effectively ensure 99.99% update and razor thin RTO/RPO's for a few hundred thousand for a medium sized business. Not hundreds of millions. I do it at my job every day and have never had a time where systems weren't live within 5 minutes or less during a catastrophic failure. We also use Site Recovery so with a single click of a button we can bring our systems online at a secondary site within minutes should we our primary datacenter gets cratered.
I think my brain just crashed |
Xeromax Tadaruwa
UNNILHEXIUM PLUTONIUM-239 CYBORG ENGINEERING
0
|
Posted - 2012.11.04 03:55:00 -
[75] - Quote
Starting up...(110 sec) |
Gyala Frey
Cryogenic Operations Distorted Percepts
0
|
Posted - 2012.11.04 03:55:00 -
[76] - Quote
And I just resubbed today after being gone over a year. Bad omen? |
Kaivar Lancer
General Exports
230
|
Posted - 2012.11.04 03:55:00 -
[77] - Quote
Do we get free SP? :) |
Karea Riscinda
Kobol Defense Force Intrepid Crossing
3
|
Posted - 2012.11.04 03:56:00 -
[78] - Quote
All hardware will break down. It's inevitable. But the important thing is that CCP is fixing the problem, and even more, they're upfront and honest about it with us. A lot of games, if they encounter a problem, will clam up and not say anything in an effort to avoid bad publicity.
Not only is EVE one of the most stable games I've ever had the privilege of playing on, but they're upfront about whats happening when something does go wrong. Kudos to you, CCP, and hope the problem is resolved soon! |
The Doctor Galferrin
Skyel Industries Subspace Exploration Agency
1
|
Posted - 2012.11.04 03:56:00 -
[79] - Quote
Gyala Frey wrote:And I just resubbed today after being gone over a year. Bad omen?
yeah you broke it man |
Trokiel
The Concilium Enterprises Spectrum Alliance
1
|
Posted - 2012.11.04 03:57:00 -
[80] - Quote
Well, at least this gave me enough time to go into the kitchen and make a huge batch of chili and then go outside for some fresh air! |
|
Malchristus
Pator Tech School Minmatar Republic
7
|
Posted - 2012.11.04 03:57:00 -
[81] - Quote
Daemon Ceed wrote:nortelslug wrote:
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end.
Hundreds of millions? Not quite. You can get very close HA (the OS's would have to reboot) with a VMWare cluster running your hosts and redundant SAN's connected to the cluster. I spoke to a Dev @ Eve Vegas and the issue running on VMWare ESXi was that when a node migrates from one server to another it either hangs on re-building the node. It seems more of a software issue than anything else, but if they really wanted to I'm sure they could find a solution to the problem. Plainly put, relying on physical hosts to run everything on bare metal leads to long downtimes. Utilize virtualization, snapshotted data storage or continuous replication, and you can effectively ensure 99.99% update and razor thin RTO/RPO's for a few hundred thousand for a medium sized business. Not hundreds of millions. I do it at my job every day and have never had a time where systems weren't live within 5 minutes or less during a catastrophic failure. We also use Site Recovery so with a single click of a button we can bring our systems online at a secondary site within minutes should we our primary datacenter gets cratered.
Yes but do you get laid ........... ever? |
Helena Russell Makanen
Deep Core Mining Inc. Caldari State
162
|
Posted - 2012.11.04 03:57:00 -
[82] - Quote
Gyala Frey wrote:And I just resubbed today after being gone over a year. Bad omen?
Yes and all of Eve hates you.
"If a miner needs to go to the bathroom, for instance, I ask that they dock up first, or at the very least ask the Supreme Protector for permission to go."-á --á James 315 - aka - the miner bumper |
Ando Gart
Vault 303
0
|
Posted - 2012.11.04 03:58:00 -
[83] - Quote
Oh come on, youre keeping me up at 5 am.... |
Theo Ramone
School of Applied Knowledge Caldari State
5
|
Posted - 2012.11.04 03:58:00 -
[84] - Quote
Hottspitta jR wrote:Mrs Doubtfire wrote:From Twitter:
EVE Online GÇÅ@EveOnline
This is looking to be a potential hardware issue. More updates soon as we learn more. Sorry for the current lack of pew pew!
Please eleborate.
How on earth would a single isolated hardware issue, be a problem to your servers? I would expect your systems to be redundant?? Even the most redundant systems have their moment's. You can never make something 100% solid. Can only try your best to achieve. This is pretty damn rare... Doesn't happen like this every year...
Thats not entirely true.
Redundancy costs money. How redundant do you want to be? |
Helena Russell Makanen
Deep Core Mining Inc. Caldari State
162
|
Posted - 2012.11.04 03:58:00 -
[85] - Quote
Malchristus wrote:Daemon Ceed wrote:nortelslug wrote:
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end.
Hundreds of millions? Not quite. You can get very close HA (the OS's would have to reboot) with a VMWare cluster running your hosts and redundant SAN's connected to the cluster. I spoke to a Dev @ Eve Vegas and the issue running on VMWare ESXi was that when a node migrates from one server to another it either hangs on re-building the node. It seems more of a software issue than anything else, but if they really wanted to I'm sure they could find a solution to the problem. Plainly put, relying on physical hosts to run everything on bare metal leads to long downtimes. Utilize virtualization, snapshotted data storage or continuous replication, and you can effectively ensure 99.99% update and razor thin RTO/RPO's for a few hundred thousand for a medium sized business. Not hundreds of millions. I do it at my job every day and have never had a time where systems weren't live within 5 minutes or less during a catastrophic failure. We also use Site Recovery so with a single click of a button we can bring our systems online at a secondary site within minutes should we our primary datacenter gets cratered. Yes but do you get laid ........... ever?
ROFL good one!
"If a miner needs to go to the bathroom, for instance, I ask that they dock up first, or at the very least ask the Supreme Protector for permission to go."-á --á James 315 - aka - the miner bumper |
Gyala Frey
Cryogenic Operations Distorted Percepts
0
|
Posted - 2012.11.04 03:58:00 -
[86] - Quote
The Doctor Galferrin wrote:Gyala Frey wrote:And I just resubbed today after being gone over a year. Bad omen? yeah you broke it man
<--- Sad Panda |
Kalkoken Sukarala
Deep Core Mining Inc. Caldari State
0
|
Posted - 2012.11.04 03:58:00 -
[87] - Quote
0 seconds is a long time... |
Kelseru
Extreme Dimensions
1
|
Posted - 2012.11.04 03:58:00 -
[88] - Quote
Malchristus wrote:[quote=Daemon Ceed]
Yes but do you get laid ........... ever?
Are you kidding me? this man makes bank. He's got ladies crawling over eachother to get at him. Remember to be nice to the nerds. Chances are you will be working for one someday. |
Tiger Bite
Rock Lobster Enterprises
1
|
Posted - 2012.11.04 03:59:00 -
[89] - Quote
DEV & CCP,
I would like to report that the link at the log in screen for the eve client is broken... it links to:
https://https//forums.eveonline.com/default.aspx?g=posts&t=169175
It should link to:
https://forums.eveonline.com/default.aspx?g=posts&t=169175
Regards, Tiger Bite |
Ando Gart
Vault 303
0
|
Posted - 2012.11.04 03:59:00 -
[90] - Quote
Kalkoken Sukarala wrote:0 seconds is a long time... Waiting for 0 seconds is like dividing by 0. |
|
Takor Ma
EPSYLON FORCE Unclaimed.
3
|
Posted - 2012.11.04 03:59:00 -
[91] - Quote
WHYYYY IT NOT STARTINGGG!!!!!!!!!!!!!!!!!!!!!!! |
Robyn Green
EG CORP Talocan United
2
|
Posted - 2012.11.04 03:59:00 -
[92] - Quote
nortelslug wrote: This.
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
No player really knows, or ever really will know, what it costs for CCP to run all the equipment and so on that they do. Those sorts of things I imagine would be known only to the highest of the high at CCP. But hundreds of millions I imagine would be an over estimate. |
Gyala Frey
Cryogenic Operations Distorted Percepts
0
|
Posted - 2012.11.04 04:00:00 -
[93] - Quote
Ando Gart wrote:Kalkoken Sukarala wrote:0 seconds is a long time... Waiting for 0 seconds is like dividing by 0.
UNDEFINED |
Rocketfish
Fearless Bandits SpaceMonkey's Alliance
0
|
Posted - 2012.11.04 04:00:00 -
[94] - Quote
Daemon Ceed wrote:[quote=nortelslug] Hundreds of millions? Not quite. You can get very close HA (the OS's would have to reboot) with a VMWare cluster running your hosts and redundant SAN's connected to the cluster. I spoke to a Dev @ Eve Vegas and the issue running on VMWare ESXi was that when a node migrates from one server to another it either hangs on re-building the node. It seems more of a software issue than anything else, but if they really wanted to I'm sure they could find a solution to the problem.
Plainly put, relying on physical hosts to run everything on bare metal leads to long downtimes. Utilize virtualization, snapshotted data storage or continuous replication, and you can effectively ensure 99.99% update and razor thin RTO/RPO's for a few hundred thousand for a medium sized business. Not hundreds of millions. I do it at my job every day and have never had a time where systems weren't live within 5 minutes or less during a catastrophic failure. We also use Site Recovery so with a single click of a button we can bring our systems online at a secondary site within minutes should we our primary datacenter gets cratered.
+10 for Vmotion |
The Doctor Galferrin
Skyel Industries Subspace Exploration Agency
1
|
Posted - 2012.11.04 04:00:00 -
[95] - Quote
Gyala Frey wrote:The Doctor Galferrin wrote:Gyala Frey wrote:And I just resubbed today after being gone over a year. Bad omen? yeah you broke it man <--- Sad Panda
dont be sad have a cookie!! |
Sten Beldrulf
BrainDead Inc.
0
|
Posted - 2012.11.04 04:00:00 -
[96] - Quote
This thread is slowly becoming Jita 4-4 |
Vaude Villian
Strategic Metals The Obsidian Cartel
0
|
Posted - 2012.11.04 04:00:00 -
[97] - Quote
"The Cluster Is Currently Not Accepting Connections" PROGRESS!
http://ebengregory.wpengine.netdna-cdn.com/wp-content/uploads/2011/11/birdman-rubbing-hands.gif |
Clambumper June
Republic University Minmatar Republic
6
|
Posted - 2012.11.04 04:00:00 -
[98] - Quote
Trokiel wrote:Well, at least this gave me enough time to go into the kitchen and make a huge batch of chili and then go outside for some fresh air!
Should have used that Bean-o before eatting the chili. Farts are good for digestion, but bad for relationships and aroma therapy... |
oien cabrereas
Laborantem Societatis Tribal Band
3
|
Posted - 2012.11.04 04:00:00 -
[99] - Quote
Sten Beldrulf wrote:This post is slowly becoming Jita 4-4
LOL |
Rocketfish
Fearless Bandits SpaceMonkey's Alliance
0
|
Posted - 2012.11.04 04:01:00 -
[100] - Quote
W00t! I logged in! |
|
Jaiccar Alkalazulu
Miricom Scientific Rising Phoenix Alliance
0
|
Posted - 2012.11.04 04:01:00 -
[101] - Quote
2 players on line and not accepting any more connections lol i know they are killing my POS!!!!
|
Sara XIII
The Carnifex Corp
111
|
Posted - 2012.11.04 04:01:00 -
[102] - Quote
Thank God the iClone app is still working or I might be panicing right now.
Skill queue still ticking. Between Ignorance and Wisdom |
Helena Russell Makanen
Deep Core Mining Inc. Caldari State
162
|
Posted - 2012.11.04 04:01:00 -
[103] - Quote
Two players online but not accepting connections "If a miner needs to go to the bathroom, for instance, I ask that they dock up first, or at the very least ask the Supreme Protector for permission to go."-á --á James 315 - aka - the miner bumper |
Thomas Gallant
Choke-Hold
11
|
Posted - 2012.11.04 04:01:00 -
[104] - Quote
Ando Gart wrote:Kalkoken Sukarala wrote:0 seconds is a long time... Waiting for 0 seconds is like dividing by 0.
then multiply by imaginary infinity, and add the square root of negative Pi, and congratulations, you've just killed a calulator! |
Trokiel
The Concilium Enterprises Spectrum Alliance
1
|
Posted - 2012.11.04 04:02:00 -
[105] - Quote
Clambumper June wrote:Trokiel wrote:Well, at least this gave me enough time to go into the kitchen and make a huge batch of chili and then go outside for some fresh air! Should have used that Bean-o before eatting the chili. Farts are good for digestion, but bad for relationships and aroma therapy...
Nah, the farts are the fun part, it irritates the wife and annoys her dog. |
Sikmaa
Galactic Shipyards Inc SONS of BANE
0
|
Posted - 2012.11.04 04:02:00 -
[106] - Quote
Daemon Ceed wrote:nortelslug wrote:
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end.
Hundreds of millions? Not quite. You can get very close HA (the OS's would have to reboot) with a VMWare cluster running your hosts and redundant SAN's connected to the cluster. I spoke to a Dev @ Eve Vegas and the issue running on VMWare ESXi was that when a node migrates from one server to another it either hangs on re-building the node. It seems more of a software issue than anything else, but if they really wanted to I'm sure they could find a solution to the problem. Plainly put, relying on physical hosts to run everything on bare metal leads to long downtimes. Utilize virtualization, snapshotted data storage or continuous replication, and you can effectively ensure 99.99% update and razor thin RTO/RPO's for a few hundred thousand for a medium sized business. Not hundreds of millions. I do it at my job every day and have never had a time where systems weren't live within 5 minutes or less during a catastrophic failure. We also use Site Recovery so with a single click of a button we can bring our systems online at a secondary site within minutes should we our primary datacenter gets cratered.
Right... go ahead and snapshot their database servers, let me know how that works out for you. When would you suggest they quiesce them? Every 5 mins?
Heh' "site recovery manager" I should be so lucky to have an installation small enough to be serviced by a software fail over system like that. |
bl00ds1n
Hazard Inc..
2
|
Posted - 2012.11.04 04:02:00 -
[107] - Quote
For when it just can't ever go down... ever...
http://h20223.www2.hp.com/NonStopComputing/cache/76391-0-0-0-121.html
I'm just saying...
|
|
CCP Falcon
446
|
Posted - 2012.11.04 04:03:00 -
[108] - Quote
Original Post Updated
CCP Falcon -á-á||-á-áEVE Community Team -á|| -á-áEVE Illuminati -á-á||-á-á@CCP_Falcon
-á-- Disciple Of The Delicious Tea -- |
|
Sten Beldrulf
BrainDead Inc.
0
|
Posted - 2012.11.04 04:03:00 -
[109] - Quote
Rocketfish wrote:W00t! I logged in!
LIES! |
Dirk Kouvo
The Silver Foxes
0
|
Posted - 2012.11.04 04:03:00 -
[110] - Quote
Congratulations on being the second useful post in 5 pages!
As to everyone else rather than thinking of it in terms of hours or minutes until EVE is back online lets try to consider it in terms of useless comments in this thread. Like my contribution here.
Cheers all & Work Hard CCP minions! |
|
Ando Gart
Vault 303
0
|
Posted - 2012.11.04 04:03:00 -
[111] - Quote
CCP Falcon wrote:Original Post Updated Quote: and is currently not accepting connections.
No kidding ;)
|
ZaBob
Twilight Labs Unsung Voices
272
|
Posted - 2012.11.04 04:04:00 -
[112] - Quote
Divine Chaoss wrote:
I think my brain just crashed
Checking... running diagnostics....
Bad news, man. It's hardware damage.
Just rest easy, I've sent Igor out to find a spare. |
Rocketfish
Fearless Bandits SpaceMonkey's Alliance
0
|
Posted - 2012.11.04 04:04:00 -
[113] - Quote
CCP Falcon wrote:Tranquility and our web services were taken offline for an emergency reboot at 01:05 GMT on November 4th.
We are currently investigating ongoing server issues. At present the ETA for Tranquility to be back online is 1.5 hours.
This thread will be updated when we have more information. We apologize for any inconvenience caused for the unscheduled downtime.
UPDATE - 03:55 GMT 04/11/12 - Tranquility is back online for testing purposes and is currently not accepting connections.
Can I help test? <--- not GLADOS |
oien cabrereas
Laborantem Societatis Tribal Band
3
|
Posted - 2012.11.04 04:04:00 -
[114] - Quote
CCP Falcon wrote:Original Post Updated
you got meee soo happy until i read the original post....... :( |
Brianna Bloodfang
Wormhole Hunters
0
|
Posted - 2012.11.04 04:04:00 -
[115] - Quote
now 3 players and no accept
|
Broomhilde
Brooklyn Sisters Industries
0
|
Posted - 2012.11.04 04:05:00 -
[116] - Quote
I want my EVE! |
Rocketfish
Fearless Bandits SpaceMonkey's Alliance
0
|
Posted - 2012.11.04 04:05:00 -
[117] - Quote
Sten Beldrulf wrote:Rocketfish wrote:W00t! I logged in! LIES!
To the forums...silly. |
Abditus Cularius
Clancularius Industries
82
|
Posted - 2012.11.04 04:05:00 -
[118] - Quote
Kelseru wrote:Remember to be nice to the nerds. Chances are you will be working for one someday.
The 1990's called. They'd like to let you know that this didn't work out, the nerds failed hard at running businesses, and every significant business is still run by the same type of person it has been since the industrial revolution.
|
Brianna Bloodfang
Wormhole Hunters
0
|
Posted - 2012.11.04 04:05:00 -
[119] - Quote
Disciple Amphal wrote:It'd be awesome is all the data was corrupted/destroyed and we had to start from scratch! that will suckz for all the high skill players |
|
ISD TYPE40
ISD Community Communications Liaisons
2685
|
Posted - 2012.11.04 04:05:00 -
[120] - Quote
Brianna Bloodfang wrote:now 3 players and no accept
CCP Falcon wrote:
UPDATE - 03:55 GMT 04/11/12 - Tranquility is back online for testing purposes and is currently not accepting connections.
Be patient, they are testing to make sure everything is stable ISD Type40 Lt. Commander Community Communication Liaisons (CCLs) Interstellar Services Department |
|
|
Malchristus
Pator Tech School Minmatar Republic
7
|
Posted - 2012.11.04 04:05:00 -
[121] - Quote
Robyn Green wrote:nortelslug wrote: This.
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
No player really knows, or ever really will know, what it costs for CCP to run all the equipment and so on that they do. Those sorts of things I imagine would be known only to the highest of the high at CCP. But hundreds of millions I imagine would be an over estimate.
You honestly, truly believe the hamster references are a joke? How sad!
CCP's new server equipment purchase tracked to HERE! |
Helena Russell Makanen
Deep Core Mining Inc. Caldari State
162
|
Posted - 2012.11.04 04:05:00 -
[122] - Quote
CCP Falcon wrote:Tranquility and our web services were taken offline for an emergency reboot at 01:05 GMT on November 4th.
We are currently investigating ongoing server issues. At present the ETA for Tranquility to be back online is 1.5 hours.
This thread will be updated when we have more information. We apologize for any inconvenience caused for the unscheduled downtime.
UPDATE - 03:55 GMT 04/11/12 - Tranquility is back online for testing purposes and is currently not accepting connections.
3 testers online - am impressed..... "If a miner needs to go to the bathroom, for instance, I ask that they dock up first, or at the very least ask the Supreme Protector for permission to go."-á --á James 315 - aka - the miner bumper |
chev cartman
The Scope Gallente Federation
0
|
Posted - 2012.11.04 04:05:00 -
[123] - Quote
Rock,Paper,Scissors,,,,,,,,,,ANYBODY???? |
Ando Gart
Vault 303
0
|
Posted - 2012.11.04 04:05:00 -
[124] - Quote
My exotic dancers are getting uncomfortable in the cargo hold.... |
oien cabrereas
Laborantem Societatis Tribal Band
3
|
Posted - 2012.11.04 04:05:00 -
[125] - Quote
Guys let see how many pages we can get before server are back online!!!!! |
Kelseru
Extreme Dimensions
1
|
Posted - 2012.11.04 04:05:00 -
[126] - Quote
The Doctor Galferrin wrote:Guttripper wrote:Since it is that time of year here in the States for political mudslinging...
So is this Obama's fault or Romney's fault? probably romneys fault i mean hell he may really be mittins!! lol
Nah. this has to be Bush's fault. either that or Clinton had an affair with the server. Maybe the server is now trying to decide what the definition of is is?
Oh wait no! This is the final culmination of the Watergate Scandal! |
Bandlean
I has a Stik
1
|
Posted - 2012.11.04 04:06:00 -
[127] - Quote
I might have actually taken that seriously if it wasn't HP Servers ..... |
Jax Spartan
Otaki Syndicate
0
|
Posted - 2012.11.04 04:06:00 -
[128] - Quote
Watching peope count the clock is just...hilarious. |
Alpheias
Euphoria Released Verge of Collapse
1619
|
Posted - 2012.11.04 04:06:00 -
[129] - Quote
TUUUUUUUUUXXXXFFFOOORRRDDD!
/James T. Kirk Allow me to be frank. You will not like me. You will not like me now, and you will not like men++ a good deal less as we go on. |
Kai Lightfoot
Blue Republic RvB - BLUE Republic
3
|
Posted - 2012.11.04 04:06:00 -
[130] - Quote
https://www.facebook.com/eveonline/posts/486656374698997
"RVB are idiots, they obviously live to **** people off, so instead of everyone going WarDec on them which is what they want, CCP should simply nuke their corp and everyone it. Corp, Ships, Characters...everything and see what they can do with that"
Everyone, everywhere should wardec RvB if CCP don't do the honourable thing and purge all 5500+ RvB characters.
|
|
Rocketfish
Fearless Bandits SpaceMonkey's Alliance
0
|
Posted - 2012.11.04 04:06:00 -
[131] - Quote
ISD TYPE40 wrote:Brianna Bloodfang wrote:now 3 players and no accept
CCP Falcon wrote:
UPDATE - 03:55 GMT 04/11/12 - Tranquility is back online for testing purposes and is currently not accepting connections.
Be patient, they are testing to make sure everything is stable
They are stealing Sov. |
Clambumper June
Republic University Minmatar Republic
6
|
Posted - 2012.11.04 04:06:00 -
[132] - Quote
EVE up for testing after massive hardware death. Thank you for waiting while we found the only 3 not drunk CCP employees to test. Mind you two of them are janitors that were clenaing toilets minutes ago. |
Lord Ryan
True Xero
753
|
Posted - 2012.11.04 04:07:00 -
[133] - Quote
Quality you just can't buy it for $15 a month
I haven't quit posting because you won. The product is no longer worth commenting on. Do not assume-áanything above this line-áwas typed by me. Nerf the Truth, it's inconvenient.
|
Brianna Bloodfang
Wormhole Hunters
0
|
Posted - 2012.11.04 04:07:00 -
[134] - Quote
Rocketfish wrote:ISD TYPE40 wrote:Brianna Bloodfang wrote:now 3 players and no accept
CCP Falcon wrote:
UPDATE - 03:55 GMT 04/11/12 - Tranquility is back online for testing purposes and is currently not accepting connections.
Be patient, they are testing to make sure everything is stable They are stealing Sov.
I think they are stealing all the goonswarm and test i think |
The Doctor Galferrin
Skyel Industries Subspace Exploration Agency
1
|
Posted - 2012.11.04 04:07:00 -
[135] - Quote
Abditus Cularius wrote:Kelseru wrote:Remember to be nice to the nerds. Chances are you will be working for one someday. The 1990's called. They'd like to let you know that this didn't work out, the nerds failed hard at running businesses, and every significant business is still run by the same type of person it has been since the industrial revolution.
at least you managed to turn on the computer and log in so i guess all the cavemen didnt die off from being 'unsmart' |
Helena Russell Makanen
Deep Core Mining Inc. Caldari State
162
|
Posted - 2012.11.04 04:08:00 -
[136] - Quote
Dirk Kouvo wrote:Congratulations on being the second useful post in 5 pages! As to everyone else rather than thinking of it in terms of hours or minutes until EVE is back online lets try to consider it in terms of useless comments in this thread. Like my contribution here. Cheers all & Work Hard CCP minions!
Nice first post CCP alt.
"If a miner needs to go to the bathroom, for instance, I ask that they dock up first, or at the very least ask the Supreme Protector for permission to go."-á --á James 315 - aka - the miner bumper |
Andski
GoonWaffe Goonswarm Federation
5455
|
Posted - 2012.11.04 04:08:00 -
[137] - Quote
Kai Lightfoot wrote:https://www.facebook.com/eveonline/posts/486656374698997
"RVB are idiots, they obviously live to **** people off, so instead of everyone going WarDec on them which is what they want, CCP should simply nuke their corp and everyone it. Corp, Ships, Characters...everything and see what they can do with that"
Everyone, everywhere should wardec RvB if CCP don't do the honourable thing and purge all 5500+ RvB characters.
You're now Public Enemy No. 1, it seems. Welcome to the spotlight. ~*a-áproud belligerent undesirable*~
TheMittani.com |
Kenneth O'Hara
Bareback Pornstars Fade 2 Black
3367
|
Posted - 2012.11.04 04:08:00 -
[138] - Quote
Is there any word to what exactly was the hardware issue? Best thread ever!!!
Stick around. I'm full of bad ideas. ~Isaac Clarke |
Clambumper June
Republic University Minmatar Republic
6
|
Posted - 2012.11.04 04:08:00 -
[139] - Quote
Kelseru wrote:The Doctor Galferrin wrote:Guttripper wrote:Since it is that time of year here in the States for political mudslinging...
So is this Obama's fault or Romney's fault? probably romneys fault i mean hell he may really be mittins!! lol Nah. this has to be Bush's fault. either that or Clinton had an affair with the server. Maybe the server is now trying to decide what the definition of is is? Oh wait no! This is the final culmination of the Watergate Scandal!
Clinton Quote "Let em stick this cigar in your USB port..." |
Zero Remus
Shallow White Industries
0
|
Posted - 2012.11.04 04:08:00 -
[140] - Quote
QUICK EVERYONE RUSH TO LOG IN.
I want to see if we can get some black Friday style trampling deaths when connections can be accepted again. |
|
Jaiccar Alkalazulu
Miricom Scientific Rising Phoenix Alliance
0
|
Posted - 2012.11.04 04:09:00 -
[141] - Quote
Clambumper June wrote:EVE up for testing after massive hardware death. Thank you for waiting while we found the only 3 not drunk CCP employees to test. Mind you two of them are janitors that were clenaing toilets minutes ago.
Awesome i want to be a walmart greeter
|
Kai Lightfoot
Blue Republic RvB - BLUE Republic
3
|
Posted - 2012.11.04 04:09:00 -
[142] - Quote
Andski wrote:Kai Lightfoot wrote:https://www.facebook.com/eveonline/posts/486656374698997
"RVB are idiots, they obviously live to **** people off, so instead of everyone going WarDec on them which is what they want, CCP should simply nuke their corp and everyone it. Corp, Ships, Characters...everything and see what they can do with that"
Everyone, everywhere should wardec RvB if CCP don't do the honourable thing and purge all 5500+ RvB characters.
You're now Public Enemy No. 1, it seems. Welcome to the spotlight.
Yup, we're now better at being Goons than Goons, you should dec us too. |
The Doctor Galferrin
Skyel Industries Subspace Exploration Agency
1
|
Posted - 2012.11.04 04:10:00 -
[143] - Quote
Kai Lightfoot wrote:https://www.facebook.com/eveonline/posts/486656374698997
"RVB are idiots, they obviously live to **** people off, so instead of everyone going WarDec on them which is what they want, CCP should simply nuke their corp and everyone it. Corp, Ships, Characters...everything and see what they can do with that"
Everyone, everywhere should wardec RvB if CCP don't do the honourable thing and purge all 5500+ RvB characters.
oh dont be mad because they declined your application!! lol |
oien cabrereas
Laborantem Societatis Tribal Band
3
|
Posted - 2012.11.04 04:10:00 -
[144] - Quote
Dear CCP for this downtime would you guys be soo kind and give us snowballs :D |
Davka Estemaire
Consolidated Holdings Tangled Webs
2
|
Posted - 2012.11.04 04:10:00 -
[145] - Quote
i bet those 3 scam bots in jita are wondering where everyone is |
Kaivar Lancer
General Exports
230
|
Posted - 2012.11.04 04:10:00 -
[146] - Quote
I'd like some free SP. :) |
Kenneth O'Hara
Bareback Pornstars Fade 2 Black
3367
|
Posted - 2012.11.04 04:10:00 -
[147] - Quote
Where are the whips? make them work faster!!!! Gods, they must all be minmatards! Best thread ever!!!
Stick around. I'm full of bad ideas. ~Isaac Clarke |
Helena Russell Makanen
Deep Core Mining Inc. Caldari State
162
|
Posted - 2012.11.04 04:10:00 -
[148] - Quote
Kenneth O'Hara wrote:Is there any word to what exactly was the hardware issue?
Read the posts like everyone else?
"If a miner needs to go to the bathroom, for instance, I ask that they dock up first, or at the very least ask the Supreme Protector for permission to go."-á --á James 315 - aka - the miner bumper |
Gyala Frey
Cryogenic Operations Distorted Percepts
0
|
Posted - 2012.11.04 04:11:00 -
[149] - Quote
Zero Remus wrote:QUICK EVERYONE RUSH TO LOG IN.
I want to see if we can get some black Friday style trampling deaths when connections can be accepted again.
I almost lol'ed |
Kai Lightfoot
Blue Republic RvB - BLUE Republic
3
|
Posted - 2012.11.04 04:11:00 -
[150] - Quote
The Doctor Galferrin wrote:Kai Lightfoot wrote:https://www.facebook.com/eveonline/posts/486656374698997
"RVB are idiots, they obviously live to **** people off, so instead of everyone going WarDec on them which is what they want, CCP should simply nuke their corp and everyone it. Corp, Ships, Characters...everything and see what they can do with that"
Everyone, everywhere should wardec RvB if CCP don't do the honourable thing and purge all 5500+ RvB characters.
oh dont be mad because they declined your application!! lol
Don't be mad when you look below my character name and see I'm in RvB... |
|
Brianna Bloodfang
Wormhole Hunters
0
|
Posted - 2012.11.04 04:11:00 -
[151] - Quote
Davka Estemaire wrote:i bet those 3 scam bots in jita are wondering where everyone is
ROFL thats who is testing the server lol trying to scam no one |
Skippy Usenet
Imperial Academy Amarr Empire
3
|
Posted - 2012.11.04 04:12:00 -
[152] - Quote
ISD TYPE40 wrote:Be patient, they are testing to make sure everything is stable
ISD Type40 said something and didn;t lock the thread! |
Nyx Artemis
Hounds Of War WHY so Seri0Us
2
|
Posted - 2012.11.04 04:12:00 -
[153] - Quote
A guy i know once said something amazing and i wish to share this with you all.
SHUT UP I KILL YOU !! |
Kalkoken Sukarala
Deep Core Mining Inc. Caldari State
0
|
Posted - 2012.11.04 04:12:00 -
[154] - Quote
I'm in! |
Dan Daaman
State Protectorate Caldari State
0
|
Posted - 2012.11.04 04:12:00 -
[155] - Quote
Thats it, I'm losing isk, i want a free month, a gift or something! WTF? |
Juna Aurilen
Androse Trinket Haus
0
|
Posted - 2012.11.04 04:13:00 -
[156] - Quote
Servers are up! |
oien cabrereas
Laborantem Societatis Tribal Band
3
|
Posted - 2012.11.04 04:13:00 -
[157] - Quote
Omg forum post OVER 9000!! .......maybe not :P |
Jax Spartan
Otaki Syndicate
0
|
Posted - 2012.11.04 04:13:00 -
[158] - Quote
Im in as well
|
Helena Russell Makanen
Deep Core Mining Inc. Caldari State
162
|
Posted - 2012.11.04 04:13:00 -
[159] - Quote
IN! "If a miner needs to go to the bathroom, for instance, I ask that they dock up first, or at the very least ask the Supreme Protector for permission to go."-á --á James 315 - aka - the miner bumper |
The Doctor Galferrin
Skyel Industries Subspace Exploration Agency
1
|
Posted - 2012.11.04 04:13:00 -
[160] - Quote
Nyx Artemis wrote:A guy i know once said something amazing and i wish to share this with you all. SHUT UP I KILL YOU !!
no no he said, "silence!! i keel you" |
|
Jaiccar Alkalazulu
Miricom Scientific Rising Phoenix Alliance
0
|
Posted - 2012.11.04 04:13:00 -
[161] - Quote
Davka Estemaire wrote:i bet those 3 scam bots in jita are wondering where everyone is
We are all just AFK
|
Jenn aSide
Smokin Aces.
362
|
Posted - 2012.11.04 04:14:00 -
[162] - Quote
Suck it, Im in too! |
TheInquisitor Charante
Federal Navy Academy Gallente Federation
0
|
Posted - 2012.11.04 04:14:00 -
[163] - Quote
Any update about when server will be back online?? It is still offline......
-Alone Wolf Lookin for a Wolfpack- |
Eli Hakomairos
Alpha Syndicate
0
|
Posted - 2012.11.04 04:14:00 -
[164] - Quote
Study all week for exams and log in for some addiction quenching on a Saturday night. Nothing better than this....oh wait.
From what i have seen CCP is fantastic about keeping their server up, and this doesnt seem to happen often, so no real reason to redicule them over them it.
...Of course, i will gladly play along to the angered toon of no connection if CCP is handing out some week old halloween goodies for the server issues. |
Onie Auduin
Neo Organized Operations Buisness
0
|
Posted - 2012.11.04 04:14:00 -
[165] - Quote
Sikmaa wrote:
Right... go ahead and snapshot their database servers, let me know how that works out for you. When would you suggest they quiesce them? Every 5 mins?
Heh' "site recovery manager" I should be so lucky to have an installation small enough to be serviced by a software fail over system like that.
Having worked for large data centers before, even virtual technology has errors. Ever see how horribly wrong a VMWare server can get when it fails on an update? Not pretty! Never mind what all that will do to a database server. |
Thomas Gallant
Choke-Hold
11
|
Posted - 2012.11.04 04:14:00 -
[166] - Quote
Kai Lightfoot wrote:The Doctor Galferrin wrote:Kai Lightfoot wrote:https://www.facebook.com/eveonline/posts/486656374698997
"RVB are idiots, they obviously live to **** people off, so instead of everyone going WarDec on them which is what they want, CCP should simply nuke their corp and everyone it. Corp, Ships, Characters...everything and see what they can do with that"
Everyone, everywhere should wardec RvB if CCP don't do the honourable thing and purge all 5500+ RvB characters.
oh dont be mad because they declined your application!! lol Don't be mad when you look below my character name and see I'm in RvB...
yeah, took me a few to notice that you were quoting someone on facebook, and not saying this yourself.
Anyway, I blame that Polaris corp, they're always causing trouble.
|
oien cabrereas
Laborantem Societatis Tribal Band
3
|
Posted - 2012.11.04 04:15:00 -
[167] - Quote
IM IN THANK YOU CCP I LOVE YOU now where are my free snowballs :D |
Sajuukkar
The Littlest Hobos En Garde
14
|
Posted - 2012.11.04 04:15:00 -
[168] - Quote
Servers up now. |
Az Tek
BREAKING-POINT Primal Force
3119
|
Posted - 2012.11.04 04:15:00 -
[169] - Quote
Disciple Amphal wrote:It'd be awesome is all the data was corrupted/destroyed and we had to start from scratch!
[WTB] All major name! David Rockefeller, Sept. 23, 1994-á "This present window of opportunity, during which a truly peaceful and interdependent world order might be built, will not be open for too long - We are on the verge of a global transformation. All we need is the right major crisis and the nations will accept the New World Order." |
Aloe Cloveris
The Greater Goon Clockwork Pineapple
99
|
Posted - 2012.11.04 04:16:00 -
[170] - Quote
This outage is an outrage and you might have heard of The Constitution which specifically says something about life, liberty and the pursuit of happiness and you've ruined my weekend and unless you want a battalion of Navy Seal snipers to invade your country for taking away my weekend (I work all week and pay TAXES and this is what you do with my weekend??!) I expect FULL reimbursement of the past 4 years subscription costs and some skillpoints for pain and suffering. You should have thought about this when your egg-headed liberal ivy tower computer nerds bought the hardware, but you didn't and now you're at the mercy of the full military might of the U.S. Armed Forces* so you'd better choose your next move carefully, I tell you what.
* Yes, I live in Canada but I know a blackbelt who does martial arts (the word 'martial' is an ancient Sanskrit word that roughly translates to 'war') and I don't know if you know but there exists a professional courtesy between warriors, so all I have to do is ask (because I pay taxes which pay the salaries of military planners), so yeah.
Gimme some SP. |
|
Daemon Ceed
Tea And Sympathy Ltd. Liability Reckless Ambition
308
|
Posted - 2012.11.04 04:16:00 -
[171] - Quote
Malchristus wrote:Daemon Ceed wrote:nortelslug wrote:
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end.
Hundreds of millions? Not quite. You can get very close HA (the OS's would have to reboot) with a VMWare cluster running your hosts and redundant SAN's connected to the cluster. I spoke to a Dev @ Eve Vegas and the issue running on VMWare ESXi was that when a node migrates from one server to another it either hangs on re-building the node. It seems more of a software issue than anything else, but if they really wanted to I'm sure they could find a solution to the problem. Plainly put, relying on physical hosts to run everything on bare metal leads to long downtimes. Utilize virtualization, snapshotted data storage or continuous replication, and you can effectively ensure 99.99% update and razor thin RTO/RPO's for a few hundred thousand for a medium sized business. Not hundreds of millions. I do it at my job every day and have never had a time where systems weren't live within 5 minutes or less during a catastrophic failure. We also use Site Recovery so with a single click of a button we can bring our systems online at a secondary site within minutes should we our primary datacenter gets cratered. Yes but do you get laid ........... ever?
Quite often. Though I sometimes wonder if its because how much money I make in this business rather than how good I look or my shining personality. The Sandbox = Play however the hell you want. |
SlayersTwin
Dark Underground Forces Wiki Conglomerates
0
|
Posted - 2012.11.04 04:17:00 -
[172] - Quote
lets go CCP i have many things to do tonight . ive been waiting for a few hours now. figure this out we know you can do it!!! |
Territorial Dosan
Santruss Co. Mining
0
|
Posted - 2012.11.04 04:17:00 -
[173] - Quote
Free SP anyone? Hint hint devs... :P |
|
CCP Falcon
446
|
Posted - 2012.11.04 04:17:00 -
[174] - Quote
Original post updated - Tranquility is back online and accepting connections! Spaceships for everyone!
CCP Falcon -á-á||-á-áEVE Community Team -á|| -á-áEVE Illuminati -á-á||-á-á@CCP_Falcon
-á-- Disciple Of The Delicious Tea -- |
|
Elderchild panda
Dark Neutron Star
0
|
Posted - 2012.11.04 04:18:00 -
[175] - Quote
Did I hear CCp say free plex for the trouble they have caused?? A free skill Points Thanks CCP |
Dirk Kouvo
The Silver Foxes
0
|
Posted - 2012.11.04 04:18:00 -
[176] - Quote
Kenneth O'Hara wrote:Is there any word to what exactly was the hardware issue?
A mouse from the research lab upstairs escaped and had many mini-mice inside of server 163 causing a short circuit that seems to have induced a stack overflow. Redundancy circuits would have kicked in but the minion viewing them happened to have had an Indian for lunch and was using the facilities so couldn't trigger the switch over in time. CCP will be writing a strongly worded letter to the proprietor of the restaurant at which he ate.
At or about the same time a fire broke out across the street. This wouldn't have been an issue but there is a strip club across the street and at least 3 women were evacuated before getting their blouses. This meant that CCP employees who usually are only exposed to digital boobies stampeded to the southern windows of the office. In the commotion two key programmers were injured and have been evacuated to the hospital - one with a sprained ankle and the other with a sprained other part.
This is only scuttle but or hearsay or perhaps even heresy so take it with a pinch of salt. I recommend taking the pinch of salt with some fries and those fries with a nice medium rare steak.
I hope this missive has at least been entertaining as I am confident it is about as useful as the original enquiry.
Regards,
Dirk "I look better in RL" Kouvo
|
Kenneth O'Hara
Bareback Pornstars Fade 2 Black
3367
|
Posted - 2012.11.04 04:19:00 -
[177] - Quote
Helena Russell Makanen wrote:Kenneth O'Hara wrote:Is there any word to what exactly was the hardware issue? Read the posts like everyone else? I did! No one from CCP has actually stated what the "hardware" issue is... I am a system/network admin and I deal with stuff like this with my clients. Just like to know the technical info. Best thread ever!!!
Stick around. I'm full of bad ideas. ~Isaac Clarke |
Water
Don't Be a Menace
2
|
Posted - 2012.11.04 04:20:00 -
[178] - Quote
Hold on, I am actually being serious here...
I'm missing fittings I applied before servers went down.
Where can I mash an 'I am angry' butan? |
Logicycle
Terra Incognita Intrepid Crossing
75
|
Posted - 2012.11.04 04:20:00 -
[179] - Quote
Back in business !!! |
Tinja Soikutsu
Minmatar Ship Construction Services Ushra'Khan
237
|
Posted - 2012.11.04 04:20:00 -
[180] - Quote
LMFAO god I Fing love MMO players... NOOOES TEH SERVERS CRASHED!
*rummages and rabbles around the forum*
Ohh hey there servers are about to go back online!
*clickclickclickclickclickclickclickclickclickclickclickclickclickclickclickclick*
commoooooon! go back u...
yes! the servers are back up gogogogogogoogogogogogoogogogoooo!!
OMG WTF happened to the servers?! |
|
Mourning Souls
Red Federation RvB - RED Federation
20
|
Posted - 2012.11.04 04:21:00 -
[181] - Quote
Back online, butt load of ships still in POS.
Get off the forums RVB and grab a ship. |
Alliria Seedspawn
Good Times Inc
11
|
Posted - 2012.11.04 04:22:00 -
[182] - Quote
CCP Falcon wrote:
UPDATE - 04:10 GMT 04/11/12 - Tranquility is online and accepting connections! Spaceships for everyone!
Are you able to break down the cause into dumb speak for us non-computer literate folks? |
Andski
GoonWaffe Goonswarm Federation
5455
|
Posted - 2012.11.04 04:24:00 -
[183] - Quote
Alliria Seedspawn wrote:CCP Falcon wrote:
UPDATE - 04:10 GMT 04/11/12 - Tranquility is online and accepting connections! Spaceships for everyone!
Are you able to break down the cause into dumb speak for us non-computer literate folks?
Flux capacitor overload ~*a-áproud belligerent undesirable*~
TheMittani.com |
Kenneth O'Hara
Bareback Pornstars Fade 2 Black
3367
|
Posted - 2012.11.04 04:24:00 -
[184] - Quote
Alliria Seedspawn wrote:CCP Falcon wrote:
UPDATE - 04:10 GMT 04/11/12 - Tranquility is online and accepting connections! Spaceships for everyone!
Are you able to break down the cause into dumb speak for us non-computer literate folks? or both? Best thread ever!!!
Stick around. I'm full of bad ideas. ~Isaac Clarke |
Ganthrithor
GoonWaffe Goonswarm Federation
450
|
Posted - 2012.11.04 04:25:00 -
[185] - Quote
So I assume this is happening in the offices, right?
http://i.imgur.com/VY8SK.jpg |
PuertoRock007 ImmortalOnes
The Stark Group
1
|
Posted - 2012.11.04 04:27:00 -
[186] - Quote
It'd be awesome is all the data was corrupted? Are you mad? |
oien cabrereas
Laborantem Societatis Tribal Band
3
|
Posted - 2012.11.04 04:30:00 -
[187] - Quote
When ccp say spaceships they ment it?
I want a nightmare pls..... |
Sarlot
Hedion University Amarr Empire
0
|
Posted - 2012.11.04 04:35:00 -
[188] - Quote
Well it's the end of daylight savings time here in the states so that lost hour or so is close to break even I'd say. |
Retmas
Grim Determination Nulli Secunda
14
|
Posted - 2012.11.04 04:37:00 -
[189] - Quote
i think we should all get faction noobships for this. -nods sagely- |
Territorial Dosan
Santruss Co. Mining
0
|
Posted - 2012.11.04 04:37:00 -
[190] - Quote
Ya know, 100k free SP for every hour you had the servers down?
Seems legit I think.... |
|
Octoven
Phoenix Productions Headshot Gaming
23
|
Posted - 2012.11.04 05:01:00 -
[191] - Quote
It would be nice to have a brief but more detailed explanation other than, "we are having hardware issues." I mean it doesn't need to be a full brief. Either way, glad to see it back up and online I haven't seen a crash this bad in a loooong time. CCP, please keep us informed with the issue in a blog or something. We are PC gamers and though most of us don't fully understand or appreciate the complexities in the creation of EVE, some of us do get the details even if they are a bit technical.
To use a crude metaphor, I can say my computer is having issues. Ok, well that doesnt say anything. I believe CCP is smart enough to know that it is either the ram or HD in a simplistic viewpoint without knowing the actual cause. So maybe like which portion of the hardware failed? |
Derek Ubering
The Scope Gallente Federation
0
|
Posted - 2012.11.04 05:10:00 -
[192] - Quote
Cool |
|
CCP Falcon
447
|
Posted - 2012.11.04 05:12:00 -
[193] - Quote
Octoven wrote:It would be nice to have a brief but more detailed explanation other than, "we are having hardware issues." I mean it doesn't need to be a full brief. Either way, glad to see it back up and online I haven't seen a crash this bad in a loooong time. CCP, please keep us informed with the issue in a blog or something. We are PC gamers and though most of us don't fully understand or appreciate the complexities in the creation of EVE, some of us do get the details even if they are a bit technical.
To use a crude metaphor, I can say my computer is having issues. Ok, well that doesnt say anything. I believe CCP is smart enough to know that it is either the ram or HD in a simplistic viewpoint without knowing the actual cause. So maybe like which portion of the hardware failed?
I'm speaking with Virtual Worlds & Operations at present and we're preparing a little more detail.
Please be patient, there are a lot of very tired Devs currently running on coffee and soda in the office and datacentre hehe
CCP Falcon -á-á||-á-áEVE Community Team -á|| -á-áEVE Illuminati -á-á||-á-á@CCP_Falcon
-á-- Disciple Of The Delicious Tea -- |
|
Kenneth O'Hara
Bareback Pornstars Fade 2 Black
3368
|
Posted - 2012.11.04 05:17:00 -
[194] - Quote
CCP Falcon wrote:Octoven wrote:It would be nice to have a brief but more detailed explanation other than, "we are having hardware issues." I mean it doesn't need to be a full brief. Either way, glad to see it back up and online I haven't seen a crash this bad in a loooong time. CCP, please keep us informed with the issue in a blog or something. We are PC gamers and though most of us don't fully understand or appreciate the complexities in the creation of EVE, some of us do get the details even if they are a bit technical.
To use a crude metaphor, I can say my computer is having issues. Ok, well that doesnt say anything. I believe CCP is smart enough to know that it is either the ram or HD in a simplistic viewpoint without knowing the actual cause. So maybe like which portion of the hardware failed? I'm speaking with Virtual Worlds & Operations at present and we're preparing a little more detail. Please be patient, there are a lot of very tired Devs currently running on coffee and soda in the office and datacentre hehe At least you're giving us a heads up and let us know that there is going to be a statement. Now how detailed is still TBD. Best thread ever!!!
Stick around. I'm full of bad ideas. ~Isaac Clarke |
|
CCP Falcon
447
|
Posted - 2012.11.04 05:30:00 -
[195] - Quote
Further details added in the original post
CCP Falcon -á-á||-á-áEVE Community Team -á|| -á-áEVE Illuminati -á-á||-á-á@CCP_Falcon
-á-- Disciple Of The Delicious Tea -- |
|
DarthNefarius
Minmatar Heavy Industries
429
|
Posted - 2012.11.04 05:41:00 -
[196] - Quote
CCP Falcon wrote:Please be patient, there are a lot of very tired Devs currently running on coffee and soda in the office and datacentre hehe
Since we got a bunch of DEVs all hopped up on caffine in the office now how about a surprise live EVENT in the US/AUS TZ! Meta-gaming for NULL SECCers: Whine on the forums like a little ***** until CCP gets sick of you and hands you everything you ask for just to shut you up.-á Typical NULL seccer whine: http://www.youtube.com/watch?v=6u299-o66wo&feature=related |
Wolfstorm
Knights of Free Space Tribal Band
29
|
Posted - 2012.11.04 06:00:00 -
[197] - Quote
I'm taking bets that a RAMSAN blew up in an nifty new way.... =) |
MinefieldS
1 Sick Duck Standss on something
158
|
Posted - 2012.11.04 06:12:00 -
[198] - Quote
CCP Falcon wrote:Tranquility and our web services were taken offline for an emergency reboot at 01:05 GMT on November 4th. We are currently investigating ongoing server issues. At present the ETA for Tranquility to be back online is 1.5 hours. This thread will be updated when we have more information. We apologize for any inconvenience caused for the unscheduled downtime.
- UPDATE - 03:55 GMT 04/11/12 - Tranquility is online for testing and is currently not accepting connections.
- UPDATE - 04:10 GMT 04/11/12 - Tranquility is online and accepting connections! Spaceships for everyone!
- UPDATE - 05:25 GMT 04/11/12 - Further information regarding the outage from Virtual Worlds Operations:
We cannot disclose any details at this moment but tonight we encountered an issue in a large part of our backend storage @ 23:05 GMT which caused an outage on multiple services.
This had an impact on EVE, Dust and our websites. Our Virtual World Operations team immediately started work on getting the storage and services online again.
Analysis is underway on the cause of the outage and backend storage redundancy failure.
- TQ was taken offline @ 01:05 due to ingame issues.
- Web services were brought online @ 03:10
- TQ was online again for players @ 04:12
It's all because of YOU!!!!!111!!!1111!!!!111122222233334455667889900 |
Mars Theran
Tribal Liberation Force Minmatar Republic
378
|
Posted - 2012.11.04 06:16:00 -
[199] - Quote
Andski wrote:nortelslug wrote:This.
100% uptime HA costs HUNDREDS OF MILLIONS of dollars, plus full hardware replacement in multiple datacenters at regular intervals + running a backup internet. For $200/month@400K players, it MIGHT be doable.
**** happens. Move on with your life and come back tomorrow. The world did not end. A backup Internet? More than one potential connection, meaning multiple available service providers hooked into the backend. I assume that is what he meant anyway. zubzubzubzubzubzubzubzub |
Mars Theran
Tribal Liberation Force Minmatar Republic
378
|
Posted - 2012.11.04 06:23:00 -
[200] - Quote
Trokiel wrote:Well, at least this gave me enough time to go into the kitchen and make a huge batch of chili and then go outside for some fresh air!
Well, you'll probably need fresh air after all that chili. zubzubzubzubzubzubzubzub |
|
ICkleSmash
Sundown Logistics SpaceMonkey's Alliance
0
|
Posted - 2012.11.04 06:29:00 -
[201] - Quote
You have all been had... TQ has burned in a deadly inferno and we are playing on SiSi. |
Clystan
Binaerie Heavy Industries
54
|
Posted - 2012.11.04 06:33:00 -
[202] - Quote
If it's of any interest - I noticed that searches for places started returning zero results about 1/2 hour before the outage. |
Maelystra
Super Mining Bros - 3D
1
|
Posted - 2012.11.04 07:37:00 -
[203] - Quote
Fiona Gallagher wrote:Do i forsee any gifts CCP making us wait for that hour in half ??? extra skills points or free newbie stuff hmmm maybe?
Quote:UPDATE - 04:10 GMT 04/11/12 - Tranquility is online and accepting connections! Spaceships for everyone!
Granted he didn't say 'free' spaceships for everyone... |
Aprudena Gist
GoonWaffe Goonswarm Federation
15
|
Posted - 2012.11.04 07:40:00 -
[204] - Quote
you guys are terrible at your jobs of redundancy and keeping servers working |
Maelystra
Super Mining Bros - 3D
1
|
Posted - 2012.11.04 07:42:00 -
[205] - Quote
Aprudena Gist wrote:you guys are terrible at your jobs of redundancy and keeping servers working Errrr...ok I only remember two times in 3 years that the servers went down unexpectedly. Wtf are you talking about? |
Squall5668
Mythos Corp HELL4S
0
|
Posted - 2012.11.04 09:49:00 -
[206] - Quote
Aprudena Gist wrote:you guys are terrible at your jobs of redundancy and keeping servers working >>I have set up a domain with 5 PCs, so you all suck
Ok... |
Ptraci
3 R Corporation The Irukandji
680
|
Posted - 2012.11.04 11:13:00 -
[207] - Quote
Er guys you might find it useful to buy some of this and put it near your servers. I mean, once in a while. |
Ruskarn Andedare
Lion Investments
0
|
Posted - 2012.11.04 11:29:00 -
[208] - Quote
Can't personally complain too much - the outage reminded me to go to bed |
Shawnm339
Apex Overplayed Coalition Fatal Ascension
72
|
Posted - 2012.11.04 11:30:00 -
[209] - Quote
Ok It is 1128am here in blighty having just finished a lovely pair of bacon cobs with the prerequisite tomato sauce and a nice cup of coffee I boot up Eve in the hopes of maybe wasting a couple of hours to see my Eve is not accepting connections..I assumed the problem listed in this thread had been resolved, any confirm or deny?
Ninja edit restarted the client and I'm in |
Tang Tso
Brutor Tribe Minmatar Republic
5
|
Posted - 2012.11.04 12:03:00 -
[210] - Quote
Bah i log in after a few days off for chemo therapy and i think my client is broken. Spend 30 minutes in launcher console and repair til I come here lol. And also for the record my cancer didnt cause this. |
|
Darvaleth Sigma
Draconis Coalition The Draconis Federation
20
|
Posted - 2012.11.04 12:46:00 -
[211] - Quote
Apparently hisec acted as lowsec leading up to the downtime; so concord did nothing, when people logged out they just sat there... I imagine there would have been massacres. Give a man a match and you warm him for a day.
Set a man on fire and he's warm for the rest of his life! |
Darkheart Inflecto
Cold Moon Destruction Talocan United
1
|
Posted - 2012.11.04 13:17:00 -
[212] - Quote
Backend storage? IBM? |
Lugia3
Shydow Imperium
44
|
Posted - 2012.11.04 15:51:00 -
[213] - Quote
Can I have a cookie? Holeysheet1 for CSNM https://forums.eveonline.com/default.aspx?g=posts&t=168477&find=unread |
Mr Pragmatic
7
|
Posted - 2012.11.04 15:57:00 -
[214] - Quote
Eve is literally dying now. Maybe this world is another planet's hell. -Aldous Huxley
|
|
CCP Explorer
C C P C C P Alliance
1027
|
Posted - 2012.11.04 18:14:00 -
[215] - Quote
Mrs Doubtfire wrote:From Twitter:
EVE Online GÇÅ@EveOnline
This is looking to be a potential hardware issue. More updates soon as we learn more. Sorry for the current lack of pew pew!
Please eleborate.
How on earth would a single isolated hardware issue, be a problem to your servers? I would expect your systems to be redundant?? We have yet to fully investigate this incident but it appears that the redundant systems failed as well. Erlendur S. Thorsteinsson | Software Director | EVE Online, CCP Games | Follow on: Twitter / Google+ |
|
|
CCP Explorer
C C P C C P Alliance
1027
|
Posted - 2012.11.04 18:15:00 -
[216] - Quote
Matthias Duran wrote:For the record, RvB asked for CCP's permission before we did our 10,000 rifter thing, and they said it would be ok and supposedly had the server reinforced for it. Obviously it was not reinforced enough. That was dealt with hours before the outage happened. Erlendur S. Thorsteinsson | Software Director | EVE Online, CCP Games | Follow on: Twitter / Google+ |
|
|
CCP Explorer
C C P C C P Alliance
1027
|
Posted - 2012.11.04 18:16:00 -
[217] - Quote
Musashibou Benkei wrote:Where's CCP Tuxford? I'm sure he's behind this............................again Sorry, but he was not the man behind the button this time Erlendur S. Thorsteinsson | Software Director | EVE Online, CCP Games | Follow on: Twitter / Google+ |
|
|
CCP Explorer
C C P C C P Alliance
1027
|
Posted - 2012.11.04 18:25:00 -
[218] - Quote
Octoven wrote:It would be nice to have a brief but more detailed explanation other than, "we are having hardware issues." I mean it doesn't need to be a full brief. Either way, glad to see it back up and online I haven't seen a crash this bad in a loooong time. CCP, please keep us informed with the issue in a blog or something. We are PC gamers and though most of us don't fully understand or appreciate the complexities in the creation of EVE, some of us do get the details even if they are a bit technical.
To use a crude metaphor, I can say my computer is having issues. Ok, well that doesnt say anything. I believe CCP is smart enough to know that it is either the ram or HD in a simplistic viewpoint without knowing the actual cause. So maybe like which portion of the hardware failed? We have yet to complete the investigation on what happened. Erlendur S. Thorsteinsson | Software Director | EVE Online, CCP Games | Follow on: Twitter / Google+ |
|
|
CCP Explorer
C C P C C P Alliance
1027
|
Posted - 2012.11.04 18:26:00 -
[219] - Quote
Wolfstorm wrote:I'm taking bets that a RAMSAN blew up in an nifty new way.... =) The issue was storage related. Erlendur S. Thorsteinsson | Software Director | EVE Online, CCP Games | Follow on: Twitter / Google+ |
|
|
CCP Explorer
C C P C C P Alliance
1027
|
Posted - 2012.11.04 18:26:00 -
[220] - Quote
Clystan wrote:If it's of any interest - I noticed that searches for places started returning zero results about 1/2 hour before the outage. That was indeed the first symptom. Erlendur S. Thorsteinsson | Software Director | EVE Online, CCP Games | Follow on: Twitter / Google+ |
|
|
Kenneth O'Hara
Bareback Pornstars Fade 2 Black
3424
|
Posted - 2012.11.04 19:53:00 -
[221] - Quote
CCP Explorer wrote:Clystan wrote:If it's of any interest - I noticed that searches for places started returning zero results about 1/2 hour before the outage. That was indeed the first symptom. Ah okay, now this is all starting to make a little more sense. I'm guessing the services used to pull information from the databases failed or decided to go on strike. Or, the storage system decided to freak out for whatever reason that is stll being investigated. I know most of the information is pulled from our HDDs (Hard Disk Drives) like ship, station, planets, moons, etc. models and textures. Im guessing is more along the line of all the meta data that is handled by the servers like player, market, corp, alliance, etc databases stored on the server HDDs and backup HDDs. It makes sense to me at least and I thank everyone at CCP currently looking into this for us.
Good luck in figuring it all out. Best thread ever!!!
Stick around. I'm full of bad ideas. ~Isaac Clarke |
Ranzabar
Vertical Ventures Unlimited Corp
17
|
Posted - 2012.11.04 20:02:00 -
[222] - Quote
I had to talk to my wife for like, hours. It was aweful Keep your expectations tiny and you won't be so winey |
Sephira Galamore
Inner Beard Society
39
|
Posted - 2012.11.04 20:19:00 -
[223] - Quote
Kenneth O'Hara wrote:CCP Explorer wrote:Clystan wrote:If it's of any interest - I noticed that searches for places started returning zero results about 1/2 hour before the outage. That was indeed the first symptom. Ah okay, now this is all starting to make a little more sense. I'm guessing the services used to pull information from the databases failed or decided to go on strike. Or, the storage system decided to freak out for whatever reason that is stll being investigated. I know most of the information is pulled from our HDDs (Hard Disk Drives) like ship, station, planets, moons, etc. models and textures. Im guessing is more along the line of all the meta data that is handled by the servers like player, market, corp, alliance, etc databases stored on the server HDDs and backup HDDs. It makes sense to me at least and I thank everyone at CCP currently looking into this for us. Good luck in figuring it all out. IIRC 99.7% of all data queries can be answered using the RAM. Which explains why it actually ran _somehow_ for a while, til they shut it down.
And I would assume the RAM handling stuff on a demand basis.. e.g. when something is needed the first time, it gets retrieved from the HDD and then stored in the RAM while there's still space. When the RAM is getting used up, there'll be some strategy to decide which data to release, likely the items with the oldest last query are dropped first. (I hope you don't mind, Explorer, but assuming is fun!) |
Kenneth O'Hara
Bareback Pornstars Fade 2 Black
3425
|
Posted - 2012.11.04 20:46:00 -
[224] - Quote
Sephira Galamore wrote:Kenneth O'Hara wrote:CCP Explorer wrote:Clystan wrote:If it's of any interest - I noticed that searches for places started returning zero results about 1/2 hour before the outage. That was indeed the first symptom. Ah okay, now this is all starting to make a little more sense. I'm guessing the services used to pull information from the databases failed or decided to go on strike. Or, the storage system decided to freak out for whatever reason that is stll being investigated. I know most of the information is pulled from our HDDs (Hard Disk Drives) like ship, station, planets, moons, etc. models and textures. Im guessing is more along the line of all the meta data that is handled by the servers like player, market, corp, alliance, etc databases stored on the server HDDs and backup HDDs. It makes sense to me at least and I thank everyone at CCP currently looking into this for us. Good luck in figuring it all out. IIRC 99.7% of all data queries can be answered using the RAM. Which explains why it actually ran _somehow_ for a while, til they shut it down. And I would assume the RAM handling stuff on a demand basis.. e.g. when something is needed the first time, it gets retrieved from the HDD and then stored in the RAM while there's still space. When the RAM is getting used up, there'll be some strategy to decide which data to release, likely the items with the oldest last query are dropped first. (I hope you don't mind, Explorer, but assuming is fun!) Oh yeah, definitely. It just depends on what they find out upon investigation. HDDs have a way higher failure rate than RAM. If it is a hardware failue, Im leaning towards this scenario. It could be one of the rare occurances where the RAM has indeed failed but not likely. It could just be how the services handle the data in memory and got confused. No likely but it could be along the lines of a stack overflow or a cache overflow. Hell, someone might have turned heuristics on in the antivirus settings which through everything into quarantine. Best thread ever!!!
Stick around. I'm full of bad ideas. ~Isaac Clarke |
Miner Idiot
0
|
Posted - 2012.11.04 22:41:00 -
[225] - Quote
to bring the whole data center up time percentages into respective (if you've not already done the calcs) there is a rating called Nines ... "four nines" - "five nines", that data centers try to pimp themselves as being. Kind of a rating that attracts clients to use their service. (like ours)
Four nines is 99.99% and works out to be 52.6 (rounded) minutes down time per year ! Five nines would be 99.999% and that is only 5.26 minutes per year ! yep - Six would be ~31 seconds/per year !
Now, lets say all your hardware is uber l33t and is touched by the hand of gaud and will never go down. You can't say the same for you OC3 data link to the internet backbone. You have two of them btw ... each from a different provider coming into the building via a different route, on a different side of the building, and some thing happens to the primary and you switch over to the secondary, only to find out that your secondary has core switch routing issues... There goes your five nines out the window and you're eating away at the four nines.
I'm telling you, It was so real ... I was there !
I drank WHAT ? |
Sephira Galamore
Inner Beard Society
40
|
Posted - 2012.11.04 23:12:00 -
[226] - Quote
I do remember the nines... Even some joke about 6 nines... 0.999999% :p |
KIller Wabbit
The Scope Gallente Federation
89
|
Posted - 2012.11.04 23:18:00 -
[227] - Quote
Shawnm339 wrote:Ok It is 1128am here in blighty having just finished a lovely pair of bacon cobs with the prerequisite tomato sauce and a nice cup of coffee I boot up Eve in the hopes of maybe wasting a couple of hours to see my Eve is not accepting connections..I assumed the problem listed in this thread had been resolved, any confirm or deny?
Ninja edit restarted the client and I'm in
I love the web! So... I'm curious, can you describe " bacon cobs with the prerequisite tomato sauce" in more detail?
(mods forgive the off topic, but I just have to know!)
Tidbit for the incident - I noticed attempts to mail someone kept coming back with "this person doesn't exist". When I tried mailing myself, with same result, I relogged - which of course didn't change things. This was about 2 hours before the universe came to a screeching halt. |
Othran
Brutor Tribe Minmatar Republic
249
|
Posted - 2012.11.04 23:28:00 -
[228] - Quote
KIller Wabbit wrote:
I love the web! So... I'm curious, can you describe " bacon cobs with the prerequisite tomato sauce" in more detail?
(mods forgive the off topic, but I just have to know!)
Bacon on a large crusty bread roll with Heinz tomato ketchup. |
Shaishi Otichoda
Science and Trade Institute Caldari State
0
|
Posted - 2012.11.05 06:33:00 -
[229] - Quote
Miner Idiot wrote:to bring the whole data center up time percentages into respective (if you've not already done the calcs) there is a rating called Nines ... "four nines" - "five nines", that data centers try to pimp themselves as being. Kind of a rating that attracts clients to use their service. (like ours)
Four nines is 99.99% and works out to be 52.6 (rounded) minutes down time per year ! Five nines would be 99.999% and that is only 5.26 minutes per year !
What is this blasphemy?! I have always delivered what I promised: nine fives. |
Blondie Amelana
The CodeX Alliance Executive Holdings Corporation The CodeX Alliance
0
|
Posted - 2012.11.06 18:18:00 -
[230] - Quote
Ok, so I have already put in a petition about this, but after eve came back online I proceeded with selling a bunch of stuff at Jita. I am guessing that because of the downtime my offerings were selling at a fairly fast clip, but I noticed that my wallet never changed to reflect these sales. Has this happened to anyone else? |
|
ctx2007
Wychwood and Wells Beer needs you
171
|
Posted - 2012.11.06 19:01:00 -
[231] - Quote
Ranzabar wrote:I had to talk to my wife for like, hours. It was aweful
My sympathies to you ... I was asleep lucky |
Kenneth O'Hara
Bareback Pornstars Fade 2 Black
3685
|
Posted - 2012.11.06 19:12:00 -
[232] - Quote
Othran wrote:KIller Wabbit wrote:
I love the web! So... I'm curious, can you describe " bacon cobs with the prerequisite tomato sauce" in more detail?
(mods forgive the off topic, but I just have to know!)
Bacon on a large crusty bread roll with Heinz tomato ketchup. Bacon is freakin' awesome!!!
And to keep this on topic, You can fix all of the computer issues but laying strips of bacon across all of the components. The goal is to let the awesomeness of bacon seep in through osmosis. It will in turn increase bandwidth and electron flow rates through the circuits and thus improving performance. It will also repair any damages immediately. It will run a little hotter but the bacon serves as a nice conducter and release of heat.
If this doesn't work, than you all obviously have no idea what you're doing. Best thread ever!!!
Stick around. I'm full of bad ideas. ~Isaac Clarke |
Atum
Eclipse Industrials STR8NGE BREW
71
|
Posted - 2012.11.08 04:52:00 -
[233] - Quote
Been a couple days now... anything learned from the charred wreckage? |
Lors Dornick
Kallisti Industries Solar Assault Fleet
299
|
Posted - 2012.11.09 09:37:00 -
[234] - Quote
Atum wrote:Been a couple days now... anything learned from the charred wreckage? The community team are probably trying to get the virtual worlds team to say something more publishable than "our logs show nothing".
And based on my experience with server techs, they're in for a tough mission ;)
CCP Eterne: Silly player, ALL devs are evil.
|
Atum
Eclipse Industrials STR8NGE BREW
71
|
Posted - 2012.11.09 15:11:00 -
[235] - Quote
Lors Dornick wrote:The community team are probably trying to get the virtual worlds team to say something more publishable than "our logs show nothing".
And based on my experience with server techs, they're in for a tough mission ;)
+1 I'm always looking for root cause info on what causes outages... my job, literally, is to make sure yarrsters are kept cool and fed. |
|
|
|
Pages: 1 2 3 4 5 6 7 8 :: [one page] |