Pages: [1] 2 3 4 5 6 7 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 6 post(s) |
|

CCP Wrangler

|
Posted - 2007.08.03 17:01:00 -
[1]
The database people has been nice enough to let us know just what is going on with the server and why we have experienced so many issues recently:
The SQL server has been crashing regularly now due to a SQL Server internal scheduler stall. This causes the server to stop responding and eventually results in a failover.
We have been diagnosing this as much as possible, we have an open support request at Microsoft and we have gotten senior consultant from a company called Miracle to look over the errorlogs and traces with us, with no luck at all. After yesterdays ä5 minute to downtimeô crash, we gathered very valuable data on the issue and that will hopefully help us to fully understand the issue, find out whats causing it and fix it.
Wrangler Community Manager EVE Online
Contact Support - Contact Moderators - Report Bug - Submit News Leads - Knowledge Base Player Guide - Policies - Join ISD - Fan Submissions - DevFinder LiteÖ |
|

Jim McGregor
|
Posted - 2007.08.03 17:01:00 -
[2]
Now you are posting stuff you dont understand again. :)
I dont get it either, but... ok, sounds good.  ---
Originally by: CCP Wrangler You're not supposed to feel like you're logging in to a happy, happy, fluffy, fluffy lala land filled with fun and adventures, thats what hello kitty online is for.
|
|

CCP Wrangler

|
Posted - 2007.08.03 17:03:00 -
[3]
Originally by: Jim McGregor
Now you are posting stuff you dont understand again. :)
I dont get it either, but... ok, sounds good. 
Well, I didn't write it. 
Wrangler Community Manager EVE Online
Contact Support - Contact Moderators - Report Bug - Submit News Leads - Knowledge Base Player Guide - Policies - Join ISD - Fan Submissions - DevFinder LiteÖ |
|

Shari Vegas
Minmatar Ctrl Alt Elites
|
Posted - 2007.08.03 17:04:00 -
[4]
Did you check to make sure that the server is on?
I mean, after this morning's forgetting to turn the auto-start back on...
I give it 50/50.
|

Xoria Krint
5th Avenue
|
Posted - 2007.08.03 17:04:00 -
[5]
Come an Wrangler. You don't have to delete my posts :\
Anyway. Thanks for the info.
|
|

CCP Wrangler

|
Posted - 2007.08.03 17:05:00 -
[6]
Originally by: Xoria Krint Come an Wrangler. You don't have to delete my posts :\
Anyway. Thanks for the info.
I corrected the typo, but if it makes you happy... EVERYONE! I MADE A TYPO AND XORIA CORRECTED ME!!!!  
Wrangler Community Manager EVE Online
Contact Support - Contact Moderators - Report Bug - Submit News Leads - Knowledge Base Player Guide - Policies - Join ISD - Fan Submissions - DevFinder LiteÖ |
|

Xoria Krint
5th Avenue
|
Posted - 2007.08.03 17:07:00 -
[7]
Originally by: CCP Wrangler
I corrected the typo, but if it makes you happy... EVERYONE! I MADE A TYPO AND XORIA CORRECTED ME!!!!  
Now thats better. All the spotlights on me. 
|

Shari Vegas
Minmatar Ctrl Alt Elites
|
Posted - 2007.08.03 17:09:00 -
[8]
Originally by: CCP Wrangler
Originally by: Xoria Krint Come an Wrangler. You don't have to delete my posts :\
Anyway. Thanks for the info.
I corrected the typo, but if it makes you happy... EVERYONE! I MADE A TYPO AND XORIA CORRECTED ME!!!!  
Where's my answer?
Not like you don't have time to kill, what with that arduous task of not fixing the server ahead of you. :P
|
|

CCP Wrangler

|
Posted - 2007.08.03 17:10:00 -
[9]
Originally by: Shari Vegas Did you check to make sure that the server is on?
I mean, after this morning's forgetting to turn the auto-start back on...
I give it 50/50.
Yes, this was because of what I posted and not because we forgot to push a button.
Wrangler Community Manager EVE Online
Contact Support - Contact Moderators - Report Bug - Submit News Leads - Knowledge Base Player Guide - Policies - Join ISD - Fan Submissions - DevFinder LiteÖ |
|

Shari Vegas
Minmatar Ctrl Alt Elites
|
Posted - 2007.08.03 17:11:00 -
[10]
Originally by: CCP Wrangler
Originally by: Shari Vegas Did you check to make sure that the server is on?
I mean, after this morning's forgetting to turn the auto-start back on...
I give it 50/50.
Yes, this was because of what I posted and not because we forgot to push a button.
Just double checking.
Right then, I'm done giving you guff. Off to bed with me to get some sleep for work tonight.
|
|

Sleepkevert
Paradox v2.0 Interstellar Alcohol Conglomerate
|
Posted - 2007.08.03 17:16:00 -
[11]
Thanks for the info, always good to know what happend
The eve-o community half guessed it tough, it was a tie between SQL server crash, and hamsters not getting enough food 
Why did it crash, public eve-o poll: 1.Mysql server crashed again 2.[rand_alliance] Deployed lag tactics 3.Hamsters ran out of food 4.Someone tripped over the powercord of TQ 5.DEV H4X!!11!1! 6.Eris did it by mining!
|

Dred'Pirate Jesus
Amarr Ministry of War
|
Posted - 2007.08.03 17:17:00 -
[12]
This have anything to do with not getting standing gains on missions last night near DT?
Originally by: David Hackworth ò If you find yourself in a fair fight, you didn't plan your mission properly.
|

Jimer Lins
Gallente Sanctuary
|
Posted - 2007.08.03 17:17:00 -
[13]
Wrangler, when this happens - is there an apparently random spike of memory usage on the SQL server, followed by it becoming unresponsive, then failing over?
SEARCh- we find sites for you! |

Agent Li
|
Posted - 2007.08.03 17:18:00 -
[14]
http://www.microsoft.com/technet/prodtechnol/sql/2005/diagandcorrecterrs.mspx ------------------
"Don't be afraid to take advantage of your enemy's weaknesses. Becasuse winning is everything after all." |
|

CCP Wrangler

|
Posted - 2007.08.03 17:18:00 -
[15]
Originally by: Dred'Pirate Jesus This have anything to do with not getting standing gains on missions last night near DT?
We had the same problem yesterday just before downtime, but if it is what caused you to not get a standing gain or not is not something I can answer.
Wrangler Community Manager EVE Online
Contact Support - Contact Moderators - Report Bug - Submit News Leads - Knowledge Base Player Guide - Policies - Join ISD - Fan Submissions - DevFinder LiteÖ |
|
|

CCP Wrangler

|
Posted - 2007.08.03 17:19:00 -
[16]
Originally by: Jimer Lins Wrangler, when this happens - is there an apparently random spike of memory usage on the SQL server, followed by it becoming unresponsive, then failing over?
I have no clue.
Wrangler Community Manager EVE Online
Contact Support - Contact Moderators - Report Bug - Submit News Leads - Knowledge Base Player Guide - Policies - Join ISD - Fan Submissions - DevFinder LiteÖ |
|

Alatari
Winterdawn
|
Posted - 2007.08.03 17:20:00 -
[17]
Originally by: CCP Wrangler The database people has been nice enough to let us know just what is going on with the server and why we have experienced so many issues recently:
Thanks for giving us this information. 
-- You can't do that with a Planet. |

Jimer Lins
Gallente Sanctuary
|
Posted - 2007.08.03 17:20:00 -
[18]
Originally by: CCP Wrangler
Originally by: Jimer Lins Wrangler, when this happens - is there an apparently random spike of memory usage on the SQL server, followed by it becoming unresponsive, then failing over?
I have no clue.
Was curious because I've seen something similar in another large-scale SQL application (not the size of EVE, obviously) and it's been hard to run to ground.
SEARCh- we find sites for you! |

Shari Vegas
Minmatar Ctrl Alt Elites
|
Posted - 2007.08.03 17:21:00 -
[19]
Originally by: CCP Wrangler
I have no clue.
Thanks for giving us this information.
(Ok, ok, really, I'm heading to bed now. :P)
Originally by: CCP Wrangler
I have no clue.
|

Dred'Pirate Jesus
Amarr Ministry of War
|
Posted - 2007.08.03 17:24:00 -
[20]
Originally by: CCP Wrangler
Originally by: Dred'Pirate Jesus This have anything to do with not getting standing gains on missions last night near DT?
We had the same problem yesterday just before downtime, but if it is what caused you to not get a standing gain or not is not something I can answer.
Oh and on a side note a distribution agent gave me 7 combat missions in a row! All of them were 'The Space Telescope'
Thanks for the answer anyways.. I know you guys are working hard to fix it.. 
Originally by: David Hackworth ò If you find yourself in a fair fight, you didn't plan your mission properly.
|
|

Sathamarid
|
Posted - 2007.08.03 17:27:00 -
[21]
Originally by: Agent Li http://www.microsoft.com/technet/prodtechnol/sql/2005/diagandcorrecterrs.mspx
You're basically suggesting that ccp doesn't know how to use google. Which is unlikely and a little rude. If it's true tho, please cancel my acct and give my stuff to the needy!
|

Kalindra Mortis
Amarr AEGIS LEGION
|
Posted - 2007.08.03 17:39:00 -
[22]
Can't update my client.. i get the incompatible version message but no downloading... Can't download from website either, i get a 404 error
|

Katana Seiko
Made in Germany
|
Posted - 2007.08.03 17:39:00 -
[23]
I'd offer a solution: Stop the Trial-For-Free Program and give us affiliates back the income we once had for advertising for EVE!
-- The future begins now - in EVE we live it, in real life we create it!
Your sig is too big. Please keep it under 400x120 and less than 24000 bytes. -the sexiest moderator ([email protected] |

VentureRook
|
Posted - 2007.08.03 17:40:00 -
[24]
Edited by: VentureRook on 03/08/2007 17:43:35 I don't know if you will see this among the other posts, but this is what I do for a living. The bottom line is if you have a SQL Cluster issue and one of the servers simply will not stay up for some reason, you really want to take it out of the cluster. After all, you probably only have one server causing the problem.
It is true that you want to have at least two servers in the cluster - I know you are reluctant to go to one temporarily - but this is the reason you have a cluster i the first place. Take the fault one out and work on the fix urgently - but don't let the server keep crashing for the sake of having two servers in the cluster at all times.
Hmm, another thing. You mentioned that you had a ticket open with Microsoft. You can treat this as a Sev 1 ticket since it is having serious impact on your business. If Microsoft is not on the phone with you - and I mean right now, becuase this impacts your business - then you need to insist on speaking to someone that can fix the problem now. Trust me, they will help you right now if you are clear on the business impact.
|

Torshin
Prophets Of a Damned Universe
|
Posted - 2007.08.03 17:51:00 -
[25]
Is it some sort of perm-gen? -------------------------------------------
Backdoor Bandit - Unofficial leader of the new 'Post with your main or STFU' campaign. I'm Shinra and I'm the champion of Eve. |

Khanak Hryad
Amarr The Firestorm Cartel
|
Posted - 2007.08.03 17:53:00 -
[26]
Really going out on a limb here, but it sorta fits together (in my mind):
If there are SQL issues...and the next server update changes the SQL format(?)...
then wouldn't it make sense to just post a "server down for rennovation" message and update the SQL stuff right away?
is there any possibility of that being an issue/solution?
just thought I'd throw that out, though I know ya'll are talkin to people who work this for a living
|

EscapeArtist
Dirty Deeds Corp. Axiom Empire
|
Posted - 2007.08.03 17:58:00 -
[27]
Unlucky guys, I know how hard it is to diagnose database failures.
I work with DB2 every day, and know the vast number of levels that error can hide in.
Hopefully the server upgrades will help... Anyway good luck, running the biggest hard wasn't ever going to be easy.
|

z0rb4
f-EVE-r Endless Horizon
|
Posted - 2007.08.03 18:06:00 -
[28]
I'm not aiming to open a flamewar with dev team (It could be, uhm, stupid... :-), but my question is:
Are you planning to scale indefinitely with SQL server or are there plans to switch OS and SQL platform? (maybe on something else than PC-based servers)
Not to be arrogant, but in my experience, and given your outstanding (and growing) transaction rate, as long as EVE becomes larger cost-effectiveness of PC/MSSQL setup will decrease over and over in comparison to high-end solutions...
Regards
z0rb4
|

Zenethian
Caldari Fabulous Soulcatchers Apoapsis Multiversal Consortium
|
Posted - 2007.08.03 18:11:00 -
[29]
Switch to DB2. ;-)
|

Darth Vaders
Caldari Deep Core Mining Inc.
|
Posted - 2007.08.03 18:22:00 -
[30]
Edited by: Darth Vaders on 03/08/2007 18:22:33 Well i d say 2 things.
One is that somehow Microsoft programs are faulty. Maybe a Linux platform would cost you less and do it faster. (but maybe you d need a few of them Linux-geeks to make it work)
Another idea (yet very expencive) would be having a second server composed of clusters to work in the background hosting the world etc (like the RAID on hard disks) and if something goes wrong in server A cluster x then the image of cluster x on server B of it would take over.
_______________________________________________ As a side wish please remove the agent missions from Jita. |
|
|
|
|
Pages: [1] 2 3 4 5 6 7 :: one page |
First page | Previous page | Next page | Last page |