Monitor this thread via RSS [?]
 
sepopen EVE General Discussion
    sepopen Announcement:UNSCHEDULED SERVER DOWNTIME - 2016-03-27

» Click here to find additional results for this topic using Google
 Monitor this thread via RSS [?]
 
Author Thread Statistics | Show CCP posts - 6 post(s)
CCP Falcon
CCP Falcon





Take me to the EVE-Online forum thread View author posting habits View only posts by author
Posted - 2016.03.27 10:48:55 - [1] - Quote

Hey guys,

We're currently investigating an issue with Tranquility after a mass disconnect, and hope to be back online as soon as possible.

This thread will be updated as more information becomes available.

UPDATES:

10:45 UTC - TRANQUILITY IS DOWN WHILE WE INVESTIGATE A DATABASE ISSUE


CCP Falcon || EVE Universe Community Manager || @CCP_Falcon

Happy Birthday To FAWLTY7! <3

CCP Falcon
CCP Falcon





Take me to the EVE-Online forum thread View author posting habits View only posts by author
Posted - 2016.03.27 11:03:53 - [2] - Quote

Requiem Jofama wrote:
First day of summertime, all drops exactly 1h before DT.
Did someone forget to set the new servers to UTC? ^^


Nahhh... We'd never do a thing like that...

... Big smile

CCP Falcon || EVE Universe Community Manager || @CCP_Falcon

Happy Birthday To FAWLTY7! <3

CCP Explorer
CCP Explorer
C C P
C C P Alliance





Take me to the EVE-Online forum thread View author posting habits View only posts by author
Posted - 2016.03.27 12:12:20 - [3] - Quote

Requiem Jofama wrote:
First day of summertime, all drops exactly 1h before DT. Did someone forget to set the new servers to UTC? ^^
Pretty much. All machines in TQ Tech III were set to "UTC Dublin, Edingburg, Lisbon, London", which wasn't the UTC we wanted. EVE Time is UTC (-¦0) all year round but when different machines have different ideas about the time then things break. Sad

Erlendur S. Thorsteinsson | Senior Development Director | EVE Online // CCP Games | @CCP_Explorer

CCP Explorer
CCP Explorer
C C P
C C P Alliance





Take me to the EVE-Online forum thread View author posting habits View only posts by author
Posted - 2016.03.27 12:18:50 - [4] - Quote

Eagles Beak wrote:
Noone haven't suggested it yet so i call it.

Did you remember to feed the hamster before easter? ^^
We're flying chocolate into the datacenter right now!

Erlendur S. Thorsteinsson | Senior Development Director | EVE Online // CCP Games | @CCP_Explorer

CCP Explorer
CCP Explorer
C C P
C C P Alliance





Take me to the EVE-Online forum thread View author posting habits View only posts by author
Posted - 2016.03.27 12:20:54 - [5] - Quote

Kaskarov wrote:
Bought and tried to redeem via alt some multiple pilot training certificates just before dat DT - aurum spent, Certificates dissappeared from redeem system and didnt appear at station =(
Please contact Customer Support.

Erlendur S. Thorsteinsson | Senior Development Director | EVE Online // CCP Games | @CCP_Explorer

CCP Explorer
CCP Explorer
C C P
C C P Alliance





Take me to the EVE-Online forum thread View author posting habits View only posts by author
Posted - 2016.03.27 13:56:40 - [6] - Quote

Indahmawar Fazmarai wrote:
CCP Explorer wrote:
Requiem Jofama wrote:
First day of summertime, all drops exactly 1h before DT. Did someone forget to set the new servers to UTC? ^^
Pretty much. All machines in TQ Tech III were set to "UTC Dublin, Edingburg, Lisbon, London", which wasn't the UTC we wanted. EVE Time is UTC (-¦0) all year round but when different machines have different ideas about the time then things break. Sad
Don't worry, we love you. CCP wouldn't be the same without a "CCP Bigthumbs" to mess things each now and then... Big smile
I blame British Summer Time (BST) Blinkhttps://www.youtube.com/watch?v=84aWtseb2-4

To explain a bit, since the original post mentions "database issues": At no point was any data at risk and "99.9%" of the cluster just uses UTC regardless of timezones. In the vast majority of cases if the timezone is incorrect on a blade the only impact is that server-side logging from the nodes on that blade are off by the timezone error.

But there is one important component that uses the local time, and that's the SQL Server Agent scheduling. TQ's daily auto-reboot is one part the cluster itself, which was planning for 11:00 UTC, and one part the daily downtime jobs, which the database planned for 11:00 local time, which this morning was 10:00 UTC. When the downtime jobs ran on the live cluster, it crashed.

Erlendur S. Thorsteinsson | Senior Development Director | EVE Online // CCP Games | @CCP_Explorer

   
 
Copyright © 2006-2024, Chribba - OMG Labs. All Rights Reserved. - perf 0,05s, ref 20241126/2151
EVE-Online™ and Eve imagery © CCP.

bitcoin: 1CHRiBBArqpw5Yz7x5KS2RRtN5ubEn5gF

COPYRIGHT NOTICE
EVE Online, the EVE logo, EVE and all associated logos and designs are the intellectual property of CCP hf. All artwork, screenshots, characters, vehicles, storylines, world facts or other recognizable features of the intellectual property relating to these trademarks are likewise the intellectual property of CCP hf. EVE Online and the EVE logo are the registered trademarks of CCP hf. All rights are reserved worldwide. All other trademarks are the property of their respective owners. CCP hf. has granted permission to EVE-Search.com to use EVE Online and all associated logos and designs for promotional and information purposes on its website but does not endorse, and is not in any way affiliated with, EVE-Search.com. CCP is in no way responsible for the content on or functioning of this website, nor can it be liable for any damage arising from the use of this website.