Pages: 1 [2] :: one page |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Bish Ounen
Gallente Omni-Core Freedom Fighters Ethereal Dawn
|
Posted - 2007.12.28 16:37:00 -
[31]
Originally by: Regat Kozovv
I should have been a little clearer, when I said SCSI is just an interface, I really mean that no one makes consumer-grade SCSI drives. =)
And yes, SCSI/SAS will outperform SATA any day. However, for Chirbba's budget, I do wonder if SATA would be more cost effective. Fiber Channel SANs and proper virtualization is great and would definitely be recommended. But who has the resources to do that? I guess we need Chirbba to post his specs.
On a related note, I was reading this just the other day: http://www.techreport.com/discussions.x/13849 Maybe we should buy him one! =)
Ahhh. Well yes. I think we can absolutely agree on that point, there really isn't any SCSI/SAS consumer-grade equipment out there. I do wonder though if Chribba hasn't simply outstripped the capabilities of most consumer-grade hardware. I mean, didn't he JUST replace this equipment about 2 months ago? That seems like an awfully short lifespan for any server, unless he just got a Lemon hard drive.
I suspect it may very well be time for him to just rent space in a proper datacenter. I'm sure there must be companies that specialize in high-availability/high-uptime web and data solutions that don't cost an arm and a leg to rent from?
I'd also like to see some stats on the type of traffic and throughput he gets on a daily basis. It would be easier to suggest solutions that way.
Also, that SUN system is kinda neat, but with all SATA drives I still don't think it would take the thrashing that EVE-Files must take. He's absolutely going to need a SAS RAID setup for his DB, or he's going to be swapping out drives every 2-3 months, if the last drives' survival time are any indication of his transaction levels.
------------------------------------------------- How much would it cost to roll back to RevII CCP?
|
Regat Kozovv
Caldari E X O D U S Imperial Republic Of the North
|
Posted - 2007.12.28 16:51:00 -
[32]
Edited by: Regat Kozovv on 28/12/2007 16:52:04
Originally by: Bish Ounen
Also, that SUN system is kinda neat, but with all SATA drives I still don't think it would take the thrashing that EVE-Files must take. He's absolutely going to need a SAS RAID setup for his DB, or he's going to be swapping out drives every 2-3 months, if the last drives' survival time are any indication of his transaction levels.
-------------------------------------------------
Good point. =)
Maybe use something like the Sun system as general file storage, and move the DB itself to a small, but high performance SAS solution like you described. Either way it'll take some cash.
|
flashfreaking
LFC FreeFall Securities
|
Posted - 2007.12.28 17:42:00 -
[33]
Well, at my job we'r currently using them Suns, and we're very happy about them, but as Chribba knows, the datatraffic on his server is way higher then ours, and the writing/reading is pretty intense, so SSD's seem to be the only way to save data, without having to replace broken drives every month. Disallowed sig graphic. Send an e-mail to [email protected] when it meets the forum signature guidelines. ~Saint |
Lysander Memnos
The Graduates Brutally Clever Empire
|
Posted - 2007.12.28 18:55:00 -
[34]
Replacing hard drives is the cheapest option, so that's the easiest course.
There are a couple things you could do to reduce/mitigate the database load (which might help some on drive lifespans):
- Optimize your sites to reduce the number of database calls (easy to say, hard to do)
- Split your databases among different drives
- Round-robin DNS with database replication (boy this would be fun to implement...not)
- Beg CCP for a RAMSAN loaner
|
|
Chribba
Otherworld Enterprises Otherworld Empire
|
Posted - 2007.12.28 19:02:00 -
[35]
Well hdd is replaced so all fine there, but for some reason the nightly backup of the db isn't really restoring ok - which is why everything is still not working as intended, am trying both left and right to get the backup to restore properly.
Secure 3rd party service ■ the Love project |
|
Linerra Tedora
Amarr Boot To The Head Plunder-Bears
|
Posted - 2007.12.28 19:10:00 -
[36]
hmm couldn't it be possible, to use a ram drive to load up the database from a set of raid drives.
So that accessing the database, is no trouble on the harddrive, and only uses the harddrive when writing data into the base. I guess most of his hits come from people reading parts instead of adding new stuff to the database.
|
|
Chribba
Otherworld Enterprises Otherworld Empire
|
Posted - 2007.12.28 22:07:00 -
[37]
Holding my breath that it will hold a little while longer now (or at least until a new drive arrive). Things "should" be back and working, some files (about 5) was uploaded after the backup of the db was made - those files have been deleted and needs to be re-uploaded.
Sorry for the downtime pilots, let me know of anything not working.
Secure 3rd party service ■ the Love project |
|
Cergorach
Amarr The Helix Foundation
|
Posted - 2007.12.28 22:30:00 -
[38]
[curious]How big is this database?[/curious]
|
|
Chribba
Otherworld Enterprises Otherworld Empire
|
Posted - 2007.12.28 22:36:00 -
[39]
Originally by: Cergorach [curious]How big is this database?[/curious]
Only some 1GiB so not big at all.
Secure 3rd party service ■ the Love project |
|
flashfreaking
LFC FreeFall Securities
|
Posted - 2007.12.28 22:39:00 -
[40]
You sir, deserve a medal, ingame, like the Tournament ones. Hmm, would be good suggestion anyway, for all active community members doing something awesome for the community Disallowed sig graphic. Send an e-mail to [email protected] when it meets the forum signature guidelines. ~Saint |
|
Verite Rendition
Caldari F.R.E.E. Explorer Atrum Tempestas Foedus
|
Posted - 2007.12.28 23:18:00 -
[41]
Originally by: Chribba
Originally by: Cergorach [curious]How big is this database?[/curious]
Only some 1GiB so not big at all.
Great, that's tiny. The RAMdrive idea is a good one given the size you're working with, you don't even need a hardware device to do it. I believe there are a couple of good Linux apps that create a RAMdrive out of the memory pool that would allow you to quickly go that route if you'd like. ---- FREE Explorer Lead Megalomanic EVE Automated Influence Map |
Lazuran
Gallente Time And ISK Sink Corporation
|
Posted - 2007.12.29 00:23:00 -
[42]
Originally by: Chribba
Originally by: Cergorach [curious]How big is this database?[/curious]
Only some 1GiB so not big at all.
With such a tiny DB you should have no performance issues at all with a decent RDBMS and a server with more RAM than that...
Disclaimer: I do not speak for the fanbois. |
Flinx Evenstar
Minmatar Omniscient Order
|
Posted - 2007.12.29 01:07:00 -
[43]
Good job getting it back online Chribba
You are a ******* hero dude CCP should throw you a little bandwidth and some storage space your way tbh
I really can't imagine EVE without eve-files, keep up the good work xxx
|
Aleksi Maksimovich
Alternative Methods Research Group New Eden Research
|
Posted - 2007.12.29 01:15:00 -
[44]
o/
RL comp tech - have been for 5 years
ssd for servers would scare me
get 6x 80gb sata hdd's (aprox $50 cdn for round #'s)
raid 6 pci card (aprox $450 cdn)
replace drives as necessary - knowing consumer hardware i would keep at least 2 around spare at any time so you can drop 2, and have them go through the RMA process without any downtime.
expensive, yes
downtime, no
considering the number of people who use this service im betting that if you asked for donations to upgrade hardware you'd likely get it in spades m8
~Cheers
__________________________________________________ Originally by: CCP Nozh
It's going to cost double for Amarr and I'm taking away your ability to warp.
|
Yumis
Amarr Vengeance of the Fallen Knights Of the Southerncross
|
Posted - 2007.12.29 02:16:00 -
[45]
Originally by: Mobius Dukat They have no moving parts, very little heat build up...
Ask yourself "how often does a RAM stick fail in your server?" isn't often i'll bet :)
I work in a Data Center with HPC clusters, the DIMMs get really really hot (to hot to touch), I suppose its down to what you do with the server a general office server will idle alot of the day but if you pound it with calucations things break. We loose a stick of RAM every couple of months across a few racks.
Make sure if you buy a SAS drive that you have a SAS controller, they look very similar to SATA, and a SATA drive will work with a SAS controller but not the other way around.
Im not even going to touch the RAID levels as I dont know what situation Chribba has, but im presuming (and presumptions are evil and lead to mistakes) that its colocated? If so he may only have 1U servers so the number of drives available will be low due to the small profile of the server, and a separate NAS/SAN would be out of the question as they charge heavily on size & power usage.
Good luck Chribba, keep up the amazing work you do.
|
Yumis
Amarr Vengeance of the Fallen Knights Of the Southerncross
|
Posted - 2007.12.29 02:21:00 -
[46]
Originally by: Aleksi Maksimovich
ssd for servers would scare me
Scary but its coming, spoke to a few guys at Seagate recently and rumour has it they are stopping making 10K rpm SCSI drives and focusing development on SSD & improving the 15K rpm SAS ones.
Although if you have a SAN with 200+ spindles you can max out the 4GB fibre connection so they still can perform very well.
|
|
|
|
Pages: 1 [2] :: one page |
First page | Previous page | Next page | Last page |