| Pages: [1] 2 3 4 :: one page |
|
|
| Author |
Thread Statistics | Show CCP posts - 4 post(s) |
|
CCP Red Button
   |
Posted - 2011.02.24 09:00:00 -
[1]
Edited by: CCP Red Button on 24/02/2011 09:03:21
As you no doubt noticed things were not exactly according to schedule yesterday and I think an explanation is in order.
Yesterdays startup issues were triggered by the application of a service pack to SQL server during regular downtime. That altered performance of the database by a small margin which triggered timing issues in the EVE server code during the startup phase causing startups to fail. These issues persisted even after reverting the application of the service pack and were only successfully resolved after several hours of troubleshooting.
We were successfully able to reproduce these conditions in our test environment and since yesterday we have developed a hotfix to address this issue which has proven successful in testing done last night and this morning. We are planning to deploy this hotfix to TQ during downtime today with the aim of preventing this type of incident in the future.
Please accept our sincere appologies for the downtime this caused yesterday
-Red
------
Hmmm... wonder where this cable goes 0_o |
|
Mashie Saldana
Minmatar
Veto Corp
|
Posted - 2011.02.24 09:03:00 -
[2]
Must... resist... pushing the red button.
Well at least you got it fixed before I got home from work.
|
Lost Hamster
Hamster Holding Corp
|
Posted - 2011.02.24 09:05:00 -
[3]
Nice work. 
--------------------------------------------------------------------------------------------
Shields are like pants, they're supposed to come off. Armor is like the condom once its gone ur ****ed |
Shoopa Whoopa
|
Posted - 2011.02.24 09:08:00 -
[4]
Normally I miss good stuff.
This time I missed downtime. 
|
Cygnus Zhada
|
Posted - 2011.02.24 09:08:00 -
[5]
Thanks for your time/effort to keep us updated. Here's a thought though; whenever there's an update to your OS why not applying it to Sisi first to see if everything's ok, test that for 2 days and if all seems well THEN update TQ?
---
Stultorum infinitus est numerus.
EVE tutorials
|
Kuni Wah
|
Posted - 2011.02.24 09:08:00 -
[6]
yea stupid question, why was it not tested on SiSi first?
|
Louis deGuerre
Gallente
Malevolence.
Imperial 0rder
|
Posted - 2011.02.24 09:13:00 -
[7]
Keeping your customers informed like this is good, keep up the good work. 
-----
Malevolence. is recruiting. Dive into the world of 0.0 !
|
Alotta Baggage
Amarr
Imperial Manufactorum
Armada Assail
|
Posted - 2011.02.24 09:18:00 -
[8]
Remember when a certain dev accidently kicked TQ's plug out of the socket?
 Originally by: Magnus Andronicus
ur character looks like a f***ing clown dude.
|
Efraya
Minmatar
|
Posted - 2011.02.24 09:32:00 -
[9]
Thanks for letting us know, lots of other companies just say sorry with no explanation. We get a sorry and a technical explanation!
Signature removed for not being EVE related. Zymurgist |
Aeronwen Carys
|
Posted - 2011.02.24 09:57:00 -
[10]
Originally by: Kuni Wah
yea stupid question, why was it not tested on SiSi first?
If you read the post properly you would notice that the problem arose due to an automatic update to SQL that happened to take place at the same time as our downtime, not much CCP can do about that. Personally I think they did an admirable job and its nice to see someone from CCP actually coming back to us as customers and informing us of exactly WHY there was a problem.
|
|
|
|
CCP Explorer
|
Posted - 2011.02.24 10:06:00 -
[11]
Originally by: Cygnus Zhada
Thanks for your time/effort to keep us updated. Here's a thought though; whenever there's an update to your OS why not applying it to Sisi first to see if everything's ok, test that for 2 days and if all seems well THEN update TQ?
This was applied to SiSi's DB server and tested on SiSi and all other test servers that use that same DB server.
Erlendur S. Thorsteinsson
Software Director
EVE Online, CCP Games |
|
Karia Sur
|
Posted - 2011.02.24 10:28:00 -
[12]
Edited by: Karia Sur on 24/02/2011 10:31:03
so 4 hours lost yesterday (ok, 3 1/2), another 1/2 hour today and probably another 3 hours at least next tuesday when the next update is applied....this lost paid time is certainly begining to mount up.
EDIT: and you need to adjust the login screen message and the ingame DT message to reflect todays extension before you get grief in roughly 60 mins time.
|
Chiana Moro
Sons Of 0din
Fatal Ascension
|
Posted - 2011.02.24 10:46:00 -
[13]
Content of this post matches the happyness of avatar perfectly. ^^
|
Mashie Saldana
Minmatar
Veto Corp
|
Posted - 2011.02.24 10:49:00 -
[14]
Originally by: Karia Sur
Edited by: Karia Sur on 24/02/2011 10:31:03
so 4 hours lost yesterday (ok, 3 1/2), another 1/2 hour today and probably another 3 hours at least next tuesday when the next update is applied....this lost paid time is certainly begining to mount up.
EDIT: and you need to adjust the login screen message and the ingame DT message to reflect todays extension before you get grief in roughly 60 mins time.
Good thing you got an extra 3.5h of gametime a week for free then since the DT was changed from 1h to 30 min.
|
Caerfinon
Caldari
Blue Republic
|
Posted - 2011.02.24 11:00:00 -
[15]
Originally by: CCP Red Button
Please accept our sincere appologies for the downtime this caused yesterday
Accepted, and thanks for taking the time to let us know.
Cheers |
shawata
|
Posted - 2011.02.24 11:09:00 -
[16]
I guess some people are never happy no matter what... others, show no appreciation for everything thats being done for us...
As for me, i find that CCP does their best and given the complexity of the game and server, i say Bravo to them.
I thank you CCP for all the work and the backup-team you have to make our world fun & enjoyable.
|
Jack Paladin
Sev3rance
|
Posted - 2011.02.24 11:15:00 -
[17]
Thanks for the update CCP, keep up the good work.
But seriously .... if JITA happened to 'vanish' during one these 'updates' I highly doubt anyone would notice ^^
|
Acac Sunflyier
Gallente
Ketsui ga Katai
|
Posted - 2011.02.24 11:17:00 -
[18]
Edited by: Acac Sunflyier on 24/02/2011 11:18:19
There was no ctrl z for this was there?
Has this error been affecting other things or was it just a start up conniption?
|
pan Ompa
Air Cess
|
Posted - 2011.02.24 11:25:00 -
[19]
Oh no, not again 
|
Hack Harrison
Caldari
|
Posted - 2011.02.24 11:27:00 -
[20]
Originally by: Aeronwen Carys
Originally by: Kuni Wah
yea stupid question, why was it not tested on SiSi first?
If you read the post properly you would notice that the problem arose due to an automatic update to SQL that happened to take place at the same time as our downtime, not much CCP can do about that. Personally I think they did an admirable job and its nice to see someone from CCP actually coming back to us as customers and informing us of exactly WHY there was a problem.
Umm - no... You do not automatically apply a patch to a server if you have even a semi-competent sysadmin. Servers are manually patched - Windows Updates MAY automatically occur for home users but in a corporate environment they are generally more tightly controlled...
|
|
|
Bumblefck
Kerensky Initiatives
|
Posted - 2011.02.24 11:27:00 -
[21]
So what the frack has happened today, then? This game's not going to play tiself, you know  
? |
Gibbo5771
|
Posted - 2011.02.24 11:28:00 -
[22]
see you in 4 hours
|
Dirk Decibel
|
Posted - 2011.02.24 11:28:00 -
[23]
Originally by: Louis deGuerre
Keeping your customers informed like this is good, keep up the good work.
It is, now if they would only manage to post info like this in the right subforum.... Like say, "Information Portal"? 
|
twotimintim
|
Posted - 2011.02.24 11:30:00 -
[24]
Ah dang.... Guess the ol' market orders will sit around stale while I'm at work.
Poor server.... Good luck with repairs...
|
PryMary
|
Posted - 2011.02.24 11:30:00 -
[25]
ummm where was todays notice about extended downtime??? Oh right during downtime
|
Pokey Nipples
Minmatar
Volition Cult
-Mostly Harmless-
|
Posted - 2011.02.24 11:30:00 -
[26]
They dont say whats going on - people grief
They tell us whats going on - people think they know better - and grief
They sort out a hot fix within 12 hours to hopefully stop this from happening (ie Reducing the probability of more crashes and lost time significantly) - people grief cos it will cost them 30 mins now....
Seriously guys - c'mon.... Very few MMO-RPGs out there have this level of openess and service levels... As always - frustration is a sign that we love the game and wanna play it when we can... But get off their backs... just once in a while?
I was happy to read they had a hot fix and stuff sorted so fast - Thumbs up from me 
|
Harvey Darvey
|
Posted - 2011.02.24 11:33:00 -
[27]
Originally by: CCP Red Button
Edited by: CCP Red Button on 24/02/2011 09:03:21
Yesterdays startup issues were triggered by the application of a service pack to SQL server during regular downtime.
Thanks for the update and explaination. Good work in resolving the issue.
~~ I imagine it's using microsoft's sql server. Curse microsoft for the constant sql server service pack update. If their products are any good , they won't keep on patching and fixing stuff with their almost daily service pack across their product.
|
tpwh21
|
Posted - 2011.02.24 11:33:00 -
[28]
would you not save yourselves alot of time if you made sisi a more accurate mirror of TQ?
I have been wondering this for a long time. As you always often seem to rush patching TQ when the code hasn't been properly tested on SISI.
I understand that SISI is not a full mirror of TQ - but surely a rethink is in order... Perhaps a more exact mirror with far less data copied?
It seems like there must be a solution that would allow for less firefighting and headscratching - and save you staff alot of stress and aggro.
Just saying.....
|
Gillaboo
|
Posted - 2011.02.24 11:38:00 -
[29]
Grats on the troubleshoot, and thank you.
--------------------------------------------------------
This space For Rent. |
DarkTemplarCrimsonWolf
Amarr
|
Posted - 2011.02.24 11:38:00 -
[30]
if the server is up in 25 min it's ok if however its up in 4 hours.... I will eat a baby O.O.
|
|
|
|
|
| |
|
| Pages: [1] 2 3 4 :: one page |
| First page | Previous page | Next page | Last page |