| Pages: 1 2 3 4 :: [one page] |
|
|
| Author |
Thread Statistics | Show CCP posts - 4 post(s) |
|
CCP Red Button
   |
Posted - 2011.02.24 09:00:00 -
[1]
Edited by: CCP Red Button on 24/02/2011 09:03:21
As you no doubt noticed things were not exactly according to schedule yesterday and I think an explanation is in order.
Yesterdays startup issues were triggered by the application of a service pack to SQL server during regular downtime. That altered performance of the database by a small margin which triggered timing issues in the EVE server code during the startup phase causing startups to fail. These issues persisted even after reverting the application of the service pack and were only successfully resolved after several hours of troubleshooting.
We were successfully able to reproduce these conditions in our test environment and since yesterday we have developed a hotfix to address this issue which has proven successful in testing done last night and this morning. We are planning to deploy this hotfix to TQ during downtime today with the aim of preventing this type of incident in the future.
Please accept our sincere appologies for the downtime this caused yesterday
-Red
------
Hmmm... wonder where this cable goes 0_o |
|
Mashie Saldana
Minmatar
Veto Corp
|
Posted - 2011.02.24 09:03:00 -
[2]
Must... resist... pushing the red button.
Well at least you got it fixed before I got home from work.
|
Lost Hamster
Hamster Holding Corp
|
Posted - 2011.02.24 09:05:00 -
[3]
Nice work. 
--------------------------------------------------------------------------------------------
Shields are like pants, they're supposed to come off. Armor is like the condom once its gone ur ****ed |
Shoopa Whoopa
|
Posted - 2011.02.24 09:08:00 -
[4]
Normally I miss good stuff.
This time I missed downtime. 
|
Cygnus Zhada
|
Posted - 2011.02.24 09:08:00 -
[5]
Thanks for your time/effort to keep us updated. Here's a thought though; whenever there's an update to your OS why not applying it to Sisi first to see if everything's ok, test that for 2 days and if all seems well THEN update TQ?
---
Stultorum infinitus est numerus.
EVE tutorials
|
Kuni Wah
|
Posted - 2011.02.24 09:08:00 -
[6]
yea stupid question, why was it not tested on SiSi first?
|
Louis deGuerre
Gallente
Malevolence.
Imperial 0rder
|
Posted - 2011.02.24 09:13:00 -
[7]
Keeping your customers informed like this is good, keep up the good work. 
-----
Malevolence. is recruiting. Dive into the world of 0.0 !
|
Alotta Baggage
Amarr
Imperial Manufactorum
Armada Assail
|
Posted - 2011.02.24 09:18:00 -
[8]
Remember when a certain dev accidently kicked TQ's plug out of the socket?
 Originally by: Magnus Andronicus
ur character looks like a f***ing clown dude.
|
Efraya
Minmatar
|
Posted - 2011.02.24 09:32:00 -
[9]
Thanks for letting us know, lots of other companies just say sorry with no explanation. We get a sorry and a technical explanation!
Signature removed for not being EVE related. Zymurgist |
Aeronwen Carys
|
Posted - 2011.02.24 09:57:00 -
[10]
Originally by: Kuni Wah
yea stupid question, why was it not tested on SiSi first?
If you read the post properly you would notice that the problem arose due to an automatic update to SQL that happened to take place at the same time as our downtime, not much CCP can do about that. Personally I think they did an admirable job and its nice to see someone from CCP actually coming back to us as customers and informing us of exactly WHY there was a problem.
|
|
|
|
CCP Explorer
|
Posted - 2011.02.24 10:06:00 -
[11]
Originally by: Cygnus Zhada
Thanks for your time/effort to keep us updated. Here's a thought though; whenever there's an update to your OS why not applying it to Sisi first to see if everything's ok, test that for 2 days and if all seems well THEN update TQ?
This was applied to SiSi's DB server and tested on SiSi and all other test servers that use that same DB server.
Erlendur S. Thorsteinsson
Software Director
EVE Online, CCP Games |
|
Karia Sur
|
Posted - 2011.02.24 10:28:00 -
[12]
Edited by: Karia Sur on 24/02/2011 10:31:03
so 4 hours lost yesterday (ok, 3 1/2), another 1/2 hour today and probably another 3 hours at least next tuesday when the next update is applied....this lost paid time is certainly begining to mount up.
EDIT: and you need to adjust the login screen message and the ingame DT message to reflect todays extension before you get grief in roughly 60 mins time.
|
Chiana Moro
Sons Of 0din
Fatal Ascension
|
Posted - 2011.02.24 10:46:00 -
[13]
Content of this post matches the happyness of avatar perfectly. ^^
|
Mashie Saldana
Minmatar
Veto Corp
|
Posted - 2011.02.24 10:49:00 -
[14]
Originally by: Karia Sur
Edited by: Karia Sur on 24/02/2011 10:31:03
so 4 hours lost yesterday (ok, 3 1/2), another 1/2 hour today and probably another 3 hours at least next tuesday when the next update is applied....this lost paid time is certainly begining to mount up.
EDIT: and you need to adjust the login screen message and the ingame DT message to reflect todays extension before you get grief in roughly 60 mins time.
Good thing you got an extra 3.5h of gametime a week for free then since the DT was changed from 1h to 30 min.
|
Caerfinon
Caldari
Blue Republic
|
Posted - 2011.02.24 11:00:00 -
[15]
Originally by: CCP Red Button
Please accept our sincere appologies for the downtime this caused yesterday
Accepted, and thanks for taking the time to let us know.
Cheers |
shawata
|
Posted - 2011.02.24 11:09:00 -
[16]
I guess some people are never happy no matter what... others, show no appreciation for everything thats being done for us...
As for me, i find that CCP does their best and given the complexity of the game and server, i say Bravo to them.
I thank you CCP for all the work and the backup-team you have to make our world fun & enjoyable.
|
Jack Paladin
Sev3rance
|
Posted - 2011.02.24 11:15:00 -
[17]
Thanks for the update CCP, keep up the good work.
But seriously .... if JITA happened to 'vanish' during one these 'updates' I highly doubt anyone would notice ^^
|
Acac Sunflyier
Gallente
Ketsui ga Katai
|
Posted - 2011.02.24 11:17:00 -
[18]
Edited by: Acac Sunflyier on 24/02/2011 11:18:19
There was no ctrl z for this was there?
Has this error been affecting other things or was it just a start up conniption?
|
pan Ompa
Air Cess
|
Posted - 2011.02.24 11:25:00 -
[19]
Oh no, not again 
|
Hack Harrison
Caldari
|
Posted - 2011.02.24 11:27:00 -
[20]
Originally by: Aeronwen Carys
Originally by: Kuni Wah
yea stupid question, why was it not tested on SiSi first?
If you read the post properly you would notice that the problem arose due to an automatic update to SQL that happened to take place at the same time as our downtime, not much CCP can do about that. Personally I think they did an admirable job and its nice to see someone from CCP actually coming back to us as customers and informing us of exactly WHY there was a problem.
Umm - no... You do not automatically apply a patch to a server if you have even a semi-competent sysadmin. Servers are manually patched - Windows Updates MAY automatically occur for home users but in a corporate environment they are generally more tightly controlled...
|
|
|
Bumblefck
Kerensky Initiatives
|
Posted - 2011.02.24 11:27:00 -
[21]
So what the frack has happened today, then? This game's not going to play tiself, you know  
? |
Gibbo5771
|
Posted - 2011.02.24 11:28:00 -
[22]
see you in 4 hours
|
Dirk Decibel
|
Posted - 2011.02.24 11:28:00 -
[23]
Originally by: Louis deGuerre
Keeping your customers informed like this is good, keep up the good work.
It is, now if they would only manage to post info like this in the right subforum.... Like say, "Information Portal"? 
|
twotimintim
|
Posted - 2011.02.24 11:30:00 -
[24]
Ah dang.... Guess the ol' market orders will sit around stale while I'm at work.
Poor server.... Good luck with repairs...
|
PryMary
|
Posted - 2011.02.24 11:30:00 -
[25]
ummm where was todays notice about extended downtime??? Oh right during downtime
|
Pokey Nipples
Minmatar
Volition Cult
-Mostly Harmless-
|
Posted - 2011.02.24 11:30:00 -
[26]
They dont say whats going on - people grief
They tell us whats going on - people think they know better - and grief
They sort out a hot fix within 12 hours to hopefully stop this from happening (ie Reducing the probability of more crashes and lost time significantly) - people grief cos it will cost them 30 mins now....
Seriously guys - c'mon.... Very few MMO-RPGs out there have this level of openess and service levels... As always - frustration is a sign that we love the game and wanna play it when we can... But get off their backs... just once in a while?
I was happy to read they had a hot fix and stuff sorted so fast - Thumbs up from me 
|
Harvey Darvey
|
Posted - 2011.02.24 11:33:00 -
[27]
Originally by: CCP Red Button
Edited by: CCP Red Button on 24/02/2011 09:03:21
Yesterdays startup issues were triggered by the application of a service pack to SQL server during regular downtime.
Thanks for the update and explaination. Good work in resolving the issue.
~~ I imagine it's using microsoft's sql server. Curse microsoft for the constant sql server service pack update. If their products are any good , they won't keep on patching and fixing stuff with their almost daily service pack across their product.
|
tpwh21
|
Posted - 2011.02.24 11:33:00 -
[28]
would you not save yourselves alot of time if you made sisi a more accurate mirror of TQ?
I have been wondering this for a long time. As you always often seem to rush patching TQ when the code hasn't been properly tested on SISI.
I understand that SISI is not a full mirror of TQ - but surely a rethink is in order... Perhaps a more exact mirror with far less data copied?
It seems like there must be a solution that would allow for less firefighting and headscratching - and save you staff alot of stress and aggro.
Just saying.....
|
Gillaboo
|
Posted - 2011.02.24 11:38:00 -
[29]
Grats on the troubleshoot, and thank you.
--------------------------------------------------------
This space For Rent. |
DarkTemplarCrimsonWolf
Amarr
|
Posted - 2011.02.24 11:38:00 -
[30]
if the server is up in 25 min it's ok if however its up in 4 hours.... I will eat a baby O.O.
|
|
|
MrCaptAwsm
|
Posted - 2011.02.24 11:39:00 -
[31]
WTS Hamsters 1m
|
NIJofleyUK
|
Posted - 2011.02.24 11:39:00 -
[32]
Well at least things are looking up and the bugs are getting investigated in a timely manner, OK so we had a few hours downtime yesterday, think of it this way, they know what the problem is and are fixing it. Fingers crossed tho :P (Had to back peddle a little)
|
TwitchyB
Jian Products Engineering Group
Atlas.
|
Posted - 2011.02.24 11:39:00 -
[33]
Edited by: TwitchyB on 24/02/2011 11:39:46
Good job CCP. Keep up the good work n'all that. Issues arise all the time (they're called issues because you dont plan for them of course), its just great to see that you jump on them quick time and get a resolution asap to keep all us happy spacelings happy.
Cheers for the explanation even if it is a little above my head
|
cpu939
Gallente
Strategic Syndicate
-Mostly Harmless-
|
Posted - 2011.02.24 11:40:00 -
[34]
Originally by: Mashie Saldana
Must... resist... pushing the red button.
Well at least you got it fixed before I got home from work.
/me walks up and pushes the red button, I'm now hoping for a ccp cookie.
i'm hoping that this patch will work lol
01010011 01110100 01110010 01100001 01110100 01100101 01100111 01101001 01100011 00100000 01010011 01111001 01101110 01100100 01101001 01100011 01100001 01110100 01100101 00100000 01001101 01100101 01 |
Glando Nikal
|
Posted - 2011.02.24 11:43:00 -
[35]
Thank you CCP for keeping us informed even if i don't understand half of what you said, i get the idea. I have been playing WOW for a long time as well as eve and this game for all it's complexity has nowwhere near the number of issues that WOW does. so you guys are doing something right.
|
Servjen
Gallente
Giant Industrials
|
Posted - 2011.02.24 11:43:00 -
[36]
I'm happy thy took the time to tell us what had happend and what they ar planning to do about it. There a lot of MMO's who don't. Ofcourse I wasn't al that happy yesterday but i could be worse, everyone remember the server move?
And beside, EvE is fun. always.
|
StyweBal
Mercenaries of Andosia
Northern Coalition.
|
Posted - 2011.02.24 11:43:00 -
[37]
MICROSOFT
Always a good choice.
|
PrimalSins
|
Posted - 2011.02.24 11:43:00 -
[38]
My only problem with this is once again we get told about extended DT during DT.....it take sweet F*** all time to quickly put up on the screen that DT would be extended so people could plan for these things.....this is where the griefing comes from save yourselves alot of stress and annoyance by letting everyone know in advance
|
SLAPNASTY McTAVISH
|
Posted - 2011.02.24 11:44:00 -
[39]
Ok, thanks for letting us know, can you tell us if everything is running to schedule or are we all gonna be sitting here at four this afternoon, still waiting for this fix to work and the server to start up?
|
Erik Boyd
|
Posted - 2011.02.24 11:45:00 -
[40]
Those of us in the southern hemisphere continue to suffer through even more DT. There has been nothing but downtime for us in our local prime time since the release of Incursion. Sure it's fine for our northern cousin's, but spare a thought for those of us who still can't log-in during the evening/night to enjoy the game
|
|
|
Harkethas
Caldari
School of Applied Knowledge
|
Posted - 2011.02.24 11:45:00 -
[41]
I think CCP do an AMAZING job - I work as a sysadmin patching stuff and very often a patch that is fine in testing fails seriously in production - sometimes stuff just breaks - what is important is having a team of highly skilled guys and gals who can fix it in record time - like yesterday! Of course it was frustrating to have the game offline, but it was fixed ULTRA fast and we were back on in a few hours.
To all those who do the "well, you should do it this way, you should use this OS/Database/Patching mechanism" - If you can do better, go ahead and make a forutne with the most reliable MMO in the world - oh, you can't, oh right, shut up and leave CCP alone then ;)
_______________________________________________
|
Morgenholt Blue
Swift Redemption
|
Posted - 2011.02.24 11:46:00 -
[42]
Originally by: PrimalSins
My only problem with this is once again we get told about extended DT during DT.....it take sweet F*** all time to quickly put up on the screen that DT would be extended so people could plan for these things.....this is where the griefing comes from save yourselves alot of stress and annoyance by letting everyone know in advance
http://www.eveonline.com/news.asp?a=single&nid=4412&tid=1
09:52:58
|
ckolon
|
Posted - 2011.02.24 11:46:00 -
[43]
Edited by: ckolon on 24/02/2011 11:47:13
Info is great but can you be up front with us and tell me if I'm going to have to sit through another night of downtime? The period has already been extended - are we going to see the same thing as last night, with each 30 minute extension followed by another? If so, then so be it - but please just say so now so I know not to waste my time waiting all night.
|
Melisz
|
Posted - 2011.02.24 11:47:00 -
[44]
oops !? again? No......
don't let us wait 4 hours .... 
|
capn gump
ElitistOps
Pandemic Legion
|
Posted - 2011.02.24 11:47:00 -
[45]
Dear Australian Players
Sucks to be you
Regards,
CCP
|
Kehro Urgus
Gallente
Wolves Of Legend
|
Posted - 2011.02.24 11:47:00 -
[46]
Here we go again...
|
wick51
|
Posted - 2011.02.24 11:48:00 -
[47]
The guys at ccp are doing there best to keep this game running and in top shape. At least they let us know as fast as hey can whats going on. SO QUIT YOUR WHINING CHILDREN! 
|
Kezon Delacorte
|
Posted - 2011.02.24 11:48:00 -
[48]
Ok you can have another half hour today...
HOWEVER...if its another 4 hours my wife and kids and the dog will have a bad day.
So do your bit for domestic tranquility and start up promptly.
|
hammack unt
|
Posted - 2011.02.24 11:48:00 -
[49]
Originally by: CCP Explorer
Originally by: Cygnus Zhada
Thanks for your time/effort to keep us updated. Here's a thought though; whenever there's an update to your OS why not applying it to Sisi first to see if everything's ok, test that for 2 days and if all seems well THEN update TQ?
This was applied to SiSi's DB server and tested on SiSi and all other test servers that use that same DB server.
So does this mean that you guy are finally going to pull your finger out your ass and mirror sisi?
|
Hyperion O'Coeus
|
Posted - 2011.02.24 11:49:00 -
[50]
Thank you for the heads up and the quick troubleshooting. Obviously there are some differences between you live cluster and the test cluster. It would be great if you can take the time, research and resolve it so future deployments will go more smoothly.
Kind Regards,
-H
|
|
|
Monica belle
|
Posted - 2011.02.24 11:49:00 -
[51]
Originally by: Pokey Nipples
They dont say whats going on - people grief
They tell us whats going on - people think they know better - and grief
They sort out a hot fix within 12 hours to hopefully stop this from happening (ie Reducing the probability of more crashes and lost time significantly) - people grief cos it will cost them 30 mins now....
Seriously guys - c'mon.... Very few MMO-RPGs out there have this level of openess and service levels... As always - frustration is a sign that we love the game and wanna play it when we can... But get off their backs... just once in a while?
I was happy to read they had a hot fix and stuff sorted so fast - Thumbs up from me
u said it ;-)
|
Carli Gray
|
Posted - 2011.02.24 11:50:00 -
[52]
I would like DT to maybe change times at least sometimes......
I know it has probably been like this since the birth of the game but 11:00 is right in prime time for my timezone. Any extended dt means a very late night if I can be bothered to hang around. 3 hours of game time a day is just not enough to do certain things...
Thanks for the updates I am greatful.
For the players saying that someone shouldn't complain. Well it is a game you subscribe to so dt should be kept to an absolute minimum if at all. Other games can do it so no reason this game should be any different.
|
Mens Desire
|
Posted - 2011.02.24 11:51:00 -
[53]
Originally by: NIJofleyUK
Well at least things are looking up and the bugs are getting investigated in a timely manner, OK so we had a few hours downtime yesterday, think of it this way, they know what the problem is and are fixing it. Fingers crossed tho :P (Had to back peddle a little)
To bad this hotfix will most likely break the undock command
|
Lex Dante
|
Posted - 2011.02.24 11:51:00 -
[54]
Originally by: Erik Boyd
Those of us in the southern hemisphere continue to suffer through even more DT.
Agreed. It's not just the annoyance of not being able to play week nights either, it's the inability to coordinate any kind of group efforts in game due to the lack of notice. Finding out there's extended DT 4 minutes after the server is supposed to come back is what makes people frustrated.
|
Blutomus Maximus
|
Posted - 2011.02.24 11:51:00 -
[55]
Originally by: shawata
... others, show no appreciation for everything thats being done for us...
Yes, I absolutely feel the need to express appreciation for the loss of an entire day's play in this tz every time something goes wrong during a downtime and when there are extended downtimes. Perhaps for most of you this happens while you're at school/work, or sleeping, and you have no appreciation for the inconvenience this causes for others. But then, all you have to do is resist the urge to open these threads, or if you can't do that, at least resist the urge to respond to posts that aren't made to you, and you've lost nothing at all. Fat chance, right? For those who suggest moving to a different TZ or ending subscriptions if we're not happy, your views are noted, and hope you too can run to another country the next time you're displeased with something.
http://www.ezy-english.com/ |
Tarithell
Rim Collection RC
Test Alliance Please Ignore
|
Posted - 2011.02.24 11:52:00 -
[56]
i bet with my friends that the problem was with hamsters pee'd on the ccp server machine but i lost 
|
Dako Semi
|
Posted - 2011.02.24 11:52:00 -
[57]
Well.
I am shure you of ccp working as good as posible. so i think we shout all understand that sometimes problems occure.
Ty for informing us tho.
Best regards
Dako Semi
|
Space Miyabi
|
Posted - 2011.02.24 11:53:00 -
[58]
Any database (like Microsoft SQL server) that works only in Microsoft Operating Systems, is fail to me.
CCP database is in a Microsoft Windows OS.
Also Microsoft does not allow users to modify and read tables if anyone has acceded to that table at the same time. Writers block readers and readers block writers.
This will delay the tasks on a heavily used environment like EvE Online in OLTP.
http://en.wikipedia.org/wiki/Online_transaction_processing
|
HolyChase
|
Posted - 2011.02.24 11:53:00 -
[59]
automatic updates on production server with 65k clients online?
WHO are you?
blonde girls with pink laptops?
|
TraderJade
Caldari
Secure Production Research and Trading
|
Posted - 2011.02.24 11:54:00 -
[60]
what is it with people whining about not testing all the time?
Do you honestly think ccp applies patches when they haven't tested them? People should really think before posting stuff they have no clue on. No-one likes it when there are issues with TQ and i'm sure CCP get just as frustrated as the users and work hard to get it up and running quickly so maybe next time you think about posting whine threads... go outside and get some fresh air and calm down first
|
|
|
Mr Kidd
|
Posted - 2011.02.24 11:54:00 -
[61]
Edited by: Mr Kidd on 24/02/2011 11:54:21
Dear CCP,
Return to your scripted 1 hour DT. If you can get the service up and running sooner, great! If not that's ok too. But telling us we now have a 30min DT and then extending your DT's longer, which appear to becoming more frequent as I would expect especially around expansions, is just frustrating your player base. Give yourselves the hour and rake in the kudos from the players as you get the server up before DT more times than not.
- Mr. Kidd
|
Da Chaos
|
Posted - 2011.02.24 11:54:00 -
[62]
LAst post ..... ?
|
iWhoopU
|
Posted - 2011.02.24 11:55:00 -
[63]
Yesterdays DT resulted in the loss of some very delicate settings and savings, to name one... my saved fittings.
I had a very nice unscannable tengu fitting which i sadly lost.
I wasn't pleased.
|
prospector oen
|
Posted - 2011.02.24 11:55:00 -
[64]
so messy and 2 hours of dt again
|
Whitehound
The Whitehound Corporation
Frontline Assembly Point
|
Posted - 2011.02.24 11:55:00 -
[65]
Wantz free stuff!
--
|
ckolon
|
Posted - 2011.02.24 11:55:00 -
[66]
Originally by: wick51
The guys at ccp are doing there best to keep this game running and in top shape. At least they let us know as fast as hey can whats going on. SO QUIT YOUR WHINING CHILDREN!
You should keep your Wick dry. I'm not being derisive about people's efforts, I'm asking them to be realistic about timeframes and communicate that to the marks, I mean punters, rather than have a rolling extension occur like last night. For example, after the first 30 minutes it would have been patently obvious to them last night that the issue was not going to be resolved in another 30 minutes - or an hour. It's about managing people's expectations not doing the impossible. People (at least reasonable people) don't expect the impossible - they just want clarity.
|
Dye Stiff
|
Posted - 2011.02.24 11:55:00 -
[67]
Originally by: Harkethas
very often a patch that is fine in testing fails seriously in production - sometimes stuff just breaks
There is always a reason it breaks if its fine in test and fails in prod its usually due to the biggest difference between prod and test and that is the physical hardware its on, most test systems are not identical to prod systems things like syncronous data replication or BCV volumes do not normally get setup in test but can and do make a difference to O/S patches.
Its a matter of cost if you want true test enviroments then your test bed has to be a complete mirror of production warts and all. This gets expensive but were I work it has been done as heavy fines have to be paid for a downtime exceeding 30 minutes.
|
CeaiFanSan
Aegis Brotherhood of the State
|
Posted - 2011.02.24 11:56:00 -
[68]
First off i would like to say a big thankyyou to CCP, as i live in GMT +10 my game time falls in Downtime, so with the server not starting up i couldnt play.....so why am i not on here complaining? cause the hard work and optimizations they are putting in has so far cut DT in half. quit complaining about 1 mistake and think how much MORE 'paid game time' you are acctually getting thanks to there great work.
|
GaUpon
|
Posted - 2011.02.24 11:56:00 -
[69]
I would rather CCP saying the extended downtime will be like 4 hours than saying 15 mins, and after that, another 30mins, 1 hour, finally we can't estimate
|
Isabell Horus
|
Posted - 2011.02.24 11:59:00 -
[70]
woo, up early :D
|
|
|
EveTestDummy
|
Posted - 2011.02.24 11:59:00 -
[71]
Originally by: tpwh21
would you not save yourselves alot of time if you made sisi a more accurate mirror of TQ?
I have been wondering this for a long time. As you always often seem to rush patching TQ when the code hasn't been properly tested on SISI.
I understand that SISI is not a full mirror of TQ - but surely a rethink is in order... Perhaps a more exact mirror with far less data copied?
It seems like there must be a solution that would allow for less firefighting and headscratching - and save you staff alot of stress and aggro.
Just saying.....
OK, I don't normally get involved with the Forums, but I do have one thing that really annoys me, and that is poor spelling.
tpwh21 - I'm picking on you because you did it twice,
FFS People "A LOT" is 2 words not one.
CCP, can you add automatic spell checking to the forums
|
T00NCES
|
Posted - 2011.02.24 11:59:00 -
[72]
This is why we should use Oracle DB's....... What did we learn. :P
Well, From a data center engineers standpoint....... You guys are rocking...
Oh look its back up. People can stop crying now.
|
pan Ompa
Air Cess
|
Posted - 2011.02.24 11:59:00 -
[73]
Let's rock!
|
AOpen World
|
Posted - 2011.02.24 12:00:00 -
[74]
Thanks for the update and technical explanation Red. Gonna be disabling auto updates now huh? XD
|
Aethebe0rn
Caldari
|
Posted - 2011.02.24 12:00:00 -
[75]
Thanks CCP!
Wow and online at 11:59 - Nice going!
-----------------------------------------------
|
Ice sayangku
|
Posted - 2011.02.24 12:01:00 -
[76]
Originally by: capn gump
Dear Australian Players
Sucks to be you
Regards,
CCP
Originally by: Blutomus Maximus
Originally by: shawata
... others, show no appreciation for everything thats being done for us...
Yes, I absolutely feel the need to express appreciation for the loss of an entire day's play in this tz every time something goes wrong during a downtime and when there are extended downtimes. Perhaps for most of you this happens while you're at school/work, or sleeping, and you have no appreciation for the inconvenience this causes for others. But then, all you have to do is resist the urge to open these threads, or if you can't do that, at least resist the urge to respond to posts that aren't made to you, and you've lost nothing at all. Fat chance, right? For those who suggest moving to a different TZ or ending subscriptions if we're not happy, your views are noted, and hope you too can run to another country the next time you're displeased with something.
tl;dr ,suggestion bare whit it coz it happens of the lets say 200 day's a year you can play how any times ? or perhaps the number of years you play 
|
Badger Molester
The Greater Goon
Clockwork Pineapple
|
Posted - 2011.02.24 12:01:00 -
[77]
Originally by: Space Miyabi
Use of the word 'fail' as an adjective.
Your credibility: ruined.
|
SLAPNASTY McTAVISH
|
Posted - 2011.02.24 12:01:00 -
[78]
Originally by: SLAPNASTY McTAVISH
Ok, thanks for letting us know, can you tell us if everything is running to schedule or are we all gonna be sitting here at four this afternoon, still waiting for this fix to work and the server to start up?
In answer to my own question, the answer is a resounding YES, things do indeed seem to be running to schedule, the server is up and so far no issues, well done CCP.
|
Strider Hiryu
Kangaroos With Frickin Lazerbeams
The KWFL Republic
|
Posted - 2011.02.24 12:01:00 -
[79]
Hello CCP
I am from australia.
I want to play the game tonight.
kthanx
PS. Free distributable SP to australian players that are missing out alot.
I like beer and cheese... |
Cobra Gaterau
|
Posted - 2011.02.24 12:01:00 -
[80]
Rooooooooooooooooooad house!!" But seriously,the game is very complicated so you can only imagine the coding and server maintenance that's needed on a daily basis just to keep it all going.They fix things as they come and are constantly getting ahead of themselves to stop problems before they even arise. I've played others that just" um opps" and be done with it. I mean,**** happends.So seriously,quit the whining already for those that do and be glad it wasn't down longer ffs Rooooooooad house
|
|
|
ckolon
|
Posted - 2011.02.24 12:01:00 -
[81]
Thanks guys
|
Space Miyabi
|
Posted - 2011.02.24 12:02:00 -
[82]
Originally by: T00NCES
This is why we should use Oracle DB's....... What did we learn. :P
Well, From a data center engineers standpoint....... You guys are rocking...
Oh look its back up. People can stop crying now.
This is true :)
|
Bear Paws
|
Posted - 2011.02.24 12:03:00 -
[83]
Quote:
Yesterdays DT resulted in the loss of some very delicate settings and savings, to name one... my saved fittings. I had a very nice unscannable tengu fitting which i sadly lost.
You do know you can export your saved fittings to your PC right? Plus you can then open them in EFT alter them if required and then import them back to into you EVE acount.
You failed to save the fit, so your fault you lost it
|
Matahashi
Amarr
The Assassins.
|
Posted - 2011.02.24 12:05:00 -
[84]
Edited by: Matahashi on 24/02/2011 12:06:48
Originally by: Carli Gray
I know it has probably been like this since the birth of the game but 11:00 is right in prime time for my timezone. Any extended dt means a very late night if I can be bothered to hang around. 3 hours of game time a day is just not enough to do certain things...
Well do some cleaning, walk the dog, take a shower :p you know IRL stuff.
And my guess it wount change since it's dev's don't want to work night time's, even tho it's pretty dark at Iceland during daytime now in the winter.
4 min past DT and logged in 0 players o-O-o
|
mercury V
|
Posted - 2011.02.24 12:06:00 -
[85]
since 11/22/2010 with extended down times and emergency server resets you have screwed me out of 8 days game timr is this a legal way to steal when i subscribed i read that there would only be 1-2 updates per year now 2 days in a row i get this crap when i can be most active on this game ----W.T.F---- please send ingame messages warning of these extended downtimes so i can make better plans for my online fun
|
Snake Scarmon
|
Posted - 2011.02.24 12:07:00 -
[86]
Well done guys, i would rather put up with an extended downtime and have it running properly anytime. And thanks for letting us know what it was all about, big thumbs up here.
|
Maximus Aerelius
Minmatar
PROPHET OF ENIGMA
|
Posted - 2011.02.24 12:09:00 -
[87]
Originally by: Pokey Nipples
They dont say whats going on - people grief
They tell us whats going on - people think they know better - and grief
They sort out a hot fix within 12 hours to hopefully stop this from happening (ie Reducing the probability of more crashes and lost time significantly) - people grief cos it will cost them 30 mins now....
Seriously guys - c'mon.... Very few MMO-RPGs out there have this level of openess and service levels... As always - frustration is a sign that we love the game and wanna play it when we can... But get off their backs... just once in a while?
I was happy to read they had a hot fix and stuff sorted so fast - Thumbs up from me
Here here Pokey! I've been playing EVE for 7.5 years now and it's come a long long way from Castor and at least they aren't releasing expansions over Bank Holidays any more as well :0). Always a lesson to learn and sometimes you can test and test till you're blue in the face and as soon as your go live *boom* it all goes pear shaped. But I DO love CCP's honesty in owning up and telling us all with complete transparency just WTF happened and when we can expect to be back IG!
Keep it up CCP, most of us love ya!
|
Lotus Alunis
|
Posted - 2011.02.24 12:11:00 -
[88]
Originally by: capn gump
Dear Australian Players
Sucks to be you
Regards,
CCP
This.
|
Durentis
|
Posted - 2011.02.24 12:11:00 -
[89]
Originally by: CCP Red Button
Yesterdays startup issues were triggered by the application of a service pack to SQL server during regular downtime. That altered performance of the database by a small margin which triggered timing issues in the EVE server code during the startup phase causing startups to fail.
Thanks much for the info.
If this hasn't driven home the point through hindsight, allow me to make a suggestion. Service packs and similar updates should never be applied just because they're available. If there's something specific you absolutely can't do without from the service pack, test it thoroughly offline and then push it live after you sort out any kinks. Good times to test and apply service packs whether you need them or not are when you upgrade/replace infrastructure site-wide and have to install stuff anyway.
Reminds me of recent office/windows upgrades in my workplace.. hundreds of thousands of dollars spent upgrading software that gives zero return while they neglect maintenance and nickel and dime workers. |
Tyburn Stannis
Caldari
Xenon Salvage Inc.
|
Posted - 2011.02.24 12:19:00 -
[90]
Show me where anybody from CCP said it was an automatic SQL patch? It was a Service Pack which was applied during DT.
"waaah, 30 mins more again" well, I was aware last night that there would be 30 mins tacked on today, sorry I can't remember if that was a log-in message, or something official from the forums, or CCP on twitbook. But it doesn't take a lot of brain power to figure out that they'd do some extra tidying up today having spent yesterday just getting it working ASAP in response to the raging hordes.
And as for the people complaining that DT is always in their prime evening playing time... folks if you CHOOSE to play a game produced in a timezone 10 hours offset from you, that's your problem, not ours.
2011. The time of "me, me, me, now, now, now, not my responsibility, not my responsibility"
|
|
|
|
CCP Red Button
|
Posted - 2011.02.24 12:21:00 -
[91]
Originally by: HolyChase
automatic updates on production server with 65k clients online?
WHO are you?
blonde girls with pink laptops?
For the record this was a controlled deployment of SQL server SP2 CU2 not an automatic update. We don't apply windows updates automatically to our production environment, they are always applied in a controlled manner on a predetermined schedule. If the updates are critical however we will apply them asap but that only happens during downtime. The modus operandi is absolutely no changes made when Tranquility is live.
Btw. Don't hate on my pink laptop, I think its cool :)
-Red
------
Hmmm... wonder where this cable goes 0_o |
|
Nahoski
|
Posted - 2011.02.24 12:24:00 -
[92]
Good work CCP, i got the win 7 x64 bit sp 1 thrown at me today too ans sql update as well which screwed a few drivers over so i had to re-install some drivers after the updates, i know the pain.. great work at assessing the problem and hot fixing it.. it don`t bother me about game downtime or extensions to Downtime, you got it fixed enough said and yes databases are tough cookies to manage build and continually stress test..
|
Lex Dante
|
Posted - 2011.02.24 12:32:00 -
[93]
Originally by: Tyburn Stannis
And as for the people complaining that DT is always in their prime evening playing time... folks if you CHOOSE to play a game produced in a timezone 10 hours offset from you, that's your problem, not ours.
So why not just keep out of it and let those of us who feel this way register our concerns?
|
Badger Molester
The Greater Goon
Clockwork Pineapple
|
Posted - 2011.02.24 12:37:00 -
[94]
Originally by: Lex Dante
Originally by: Tyburn Stannis
And as for the people complaining that DT is always in their prime evening playing time... folks if you CHOOSE to play a game produced in a timezone 10 hours offset from you, that's your problem, not ours.
So why not just keep out of it and let those of us who feel this way register our concerns?
When you make a complaint you need to be mature enough to accept a logical response to that complaint.
|
ion Utama
|
Posted - 2011.02.24 12:52:00 -
[95]
**** TIME KICK PUPPYS
|
Dinta Zembo
|
Posted - 2011.02.24 12:54:00 -
[96]
Originally by: Mashie Saldana
Originally by: Karia Sur
Edited by: Karia Sur on 24/02/2011 10:31:03
so 4 hours lost yesterday (ok, 3 1/2), another 1/2 hour today and probably another 3 hours at least next tuesday when the next update is applied....this lost paid time is certainly begining to mount up.
EDIT: and you need to adjust the login screen message and the ingame DT message to reflect todays extension before you get grief in roughly 60 mins time.
Good thing you got an extra 3.5h of gametime a week for free then since the DT was changed from 1h to 30 min.
These 1-hour downtimes almost never lasted an hour anyway.
|
|
CCP Red Button
|
Posted - 2011.02.24 12:57:00 -
[97]
Originally by: Durentis
If this hasn't driven home the point through hindsight, allow me to make a suggestion. Service packs and similar updates should never be applied just because they're available. If there's something specific you absolutely can't do without from the service pack, test it thoroughly offline and then push it live after you sort out any kinks. Good times to test and apply service packs whether you need them or not are when you upgrade/replace infrastructure site-wide and have to install stuff anyway.
I do agree and we follow that general rule. The reason for applying this service pack and cumulative update was to address a crash bug in SQL server that has affected us sporadically for quite some time now and been the root cause for a few EVE server crashes, a couple of them very recent. We have had a case open with Microsoft support for about nine months but this has proven tricky to reproduce and provide a fix for but that finally came through and was included in this last cumulative update that was released last month.
------
Hmmm... wonder where this cable goes 0_o |
|
Gnulpie
Minmatar
Miner Tech
|
Posted - 2011.02.24 13:00:00 -
[98]
Thanks for the details.
That is good communication and customer service! |
Jack Gilligan
1st Cavalry Division
|
Posted - 2011.02.24 13:15:00 -
[99]
Originally by: CCP Red Button
Originally by: Durentis
If this hasn't driven home the point through hindsight, allow me to make a suggestion. Service packs and similar updates should never be applied just because they're available. If there's something specific you absolutely can't do without from the service pack, test it thoroughly offline and then push it live after you sort out any kinks. Good times to test and apply service packs whether you need them or not are when you upgrade/replace infrastructure site-wide and have to install stuff anyway.
I do agree and we follow that general rule. The reason for applying this service pack and cumulative update was to address a crash bug in SQL server that has affected us sporadically for quite some time now and been the root cause for a few EVE server crashes, a couple of them very recent. We have had a case open with Microsoft support for about nine months but this has proven tricky to reproduce and provide a fix for but that finally came through and was included in this last cumulative update that was released last month.
Speaking as someone who has been in IT and a sysadmin for 17 years now, the Prime Directive is: Thou Shalt NOT install an UNPATCHED version of anything :)
|
Mitherien
|
Posted - 2011.02.24 13:28:00 -
[100]
I'll complain about all the complaints you guys get and thank you for all your hard work.
Dominating EVE one belt at a time. |
|
|
Russell4
Gallente
Moonshine Industries
|
Posted - 2011.02.24 13:29:00 -
[101]
Originally by: CCP Red Button
Originally by: HolyChase
automatic updates on production server with 65k clients online?
WHO are you?
blonde girls with pink laptops?
For the record this was a controlled deployment of SQL server SP2 CU2 not an automatic update. We don't apply windows updates automatically to our production environment, they are always applied in a controlled manner on a predetermined schedule. If the updates are critical however we will apply them asap but that only happens during downtime. The modus operandi is absolutely no changes made when Tranquility is live.
Btw. Don't hate on my pink laptop, I think its cool :)
-Red
We all have Pink Laptops, rite? 
|
sableye
principle of motion
|
Posted - 2011.02.24 14:27:00 -
[102]
Originally by: EveTestDummy
Originally by: tpwh21
would you not save yourselves alot of time if you made sisi a more accurate mirror of TQ?
I have been wondering this for a long time. As you always often seem to rush patching TQ when the code hasn't been properly tested on SISI.
I understand that SISI is not a full mirror of TQ - but surely a rethink is in order... Perhaps a more exact mirror with far less data copied?
It seems like there must be a solution that would allow for less firefighting and headscratching - and save you staff alot of stress and aggro.
Just saying.....
OK, I don't normally get involved with the Forums, but I do have one thing that really annoys me, and that is poor spelling.
tpwh21 - I'm picking on you because you did it twice,
FFS People "A LOT" is 2 words not one.
CCP, can you add automatic spell checking to the forums
nothing worse than some idiot who constantly points it out because he declared himself the sole authoirty on the english lanaguage or just follows some other group who say they are.
-----------------------------------------
View The North Star! In All Its Glory!! |
Bumblefck
Kerensky Initiatives
|
Posted - 2011.02.24 14:54:00 -
[103]
Edited by: Bumblefck on 24/02/2011 14:55:18
Originally by: sableye
nothing worse than some idiot who constantly points it out because he declared himself the sole authoirty on the english lanaguage or just follows some other group who say they are.
Spell checking: it costs nothing, and your readers like it!Ö
? |
sableye
principle of motion
|
Posted - 2011.02.24 14:56:00 -
[104]
Originally by: Bumblefck
Edited by: Bumblefck on 24/02/2011 14:55:18
Originally by: sableye
nothing worse than some idiot who constantly points it out because he declared himself the sole authoirty on the english lanaguage or just follows some other group who say they are.
Spell checking: it costs nothing, and your readers like it!Ö
all data has a cost of transmit.
-----------------------------------------
View The North Star! In All Its Glory!! |
Bumblefck
Kerensky Initiatives
|
Posted - 2011.02.24 15:03:00 -
[105]
Originally by: sableye
Spell checking: it costs nothing, and your readers like it!Ö
all data has a cost of transmit.
Sarcasm: it's not for everyone!Ö
? |
Barakkus
|
Posted - 2011.02.24 17:12:00 -
[106]
Originally by: T00NCES
This is why we should use Oracle DB's....... What did we learn. :P
Well, From a data center engineers standpoint....... You guys are rocking...
Oh look its back up. People can stop crying now.
Oracle is an overpriced POS.
PostgreSQL ftw.
-
-
[SERVICE] Corp Standings For POS anchoring
|
BearUkraine
Gallente
Light Style
|
Posted - 2011.02.24 18:37:00 -
[107]
Originally by: Gnulpie
Thanks for the details.
That is good communication and customer service!
+1
Fully agree. That is what I expect from nice guys. It seems that CCP is trying to be better) Nicely done!!!
|
Hack Harrison
Caldari
|
Posted - 2011.02.25 03:15:00 -
[108]
Originally by: Space Miyabi
Any database (like Microsoft SQL server) that works only in Microsoft Operating Systems, is fail to me.
CCP database is in a Microsoft Windows OS.
Also Microsoft does not allow users to modify and read tables if anyone has acceded to that table at the same time. Writers block readers and readers block writers.
This will delay the tasks on a heavily used environment like EvE Online in OLTP.
http://en.wikipedia.org/wiki/Online_transaction_processing
Hey Genius - most databases do this - it is called locking - read up on optimistic vs pessimistic locking (SQL Server does optimistic).
Also - look up what the nolock query hint does (clue - it is called a dirty read which CCP DO)
|
Rockette
Amarr
New Eve mining Organisation - MD
New Eve Mining manufacturing Organisation
|
Posted - 2011.02.25 11:29:00 -
[109]
Well CCP Red Button you get a "Green Button" from me
10/10 for the info and thanks to all who fixed the problem.
Hmm did i just inadvertently thank MicroSoft Oh Dear Now I
Self desrtuct all my ships as punishment
 |
Mag's
the united
Negative Ten.
|
Posted - 2011.02.25 19:45:00 -
[110]
It didn't affect me at all, but thanks for the info it was very insightful.
Originally by: Allestin Villimar
Also, if your bookmarks are too far out, they can and will ban you for it.
Originally by: Torothanax
Low population in w systems makes afk cloaking unattractive. |
|
|
Gaellia Bonaventure
|
Posted - 2011.02.25 21:08:00 -
[111]
I'm mostly dumb so I don't understand all the techo-jargon. But I DO appreciate the heartfelt apology and the effort to keep me informed re: the downtime.
Thank you! :)
|
|
|
| |
|
| Pages: 1 2 3 4 :: [one page] |