10 hard drives, single machine, what to do for performance and data protection.

This topic is locked from further discussion.

Avatar image for deactivated-61b556b29800c
deactivated-61b556b29800c

306

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#1 deactivated-61b556b29800c
Member since 2006 • 306 Posts

I currently have 5x2TB and 2x500GB drives. I'm not sure what to do about setting these up in a machine i'm building.

I'd very much like to be able to potentially move the array to a new machine in the far future, but then i'm unsure if pci-e raid controllers are reliable enough to last a long time.

Also, what's capable of handling 10 drives, or should i look at getting like 2x8 slot cards. I also would need the ability to add more drives in the future when needed.

I don't have $1500 to drop on a Drobo or a pre-made system that i can throw drives in, i have a machine capable of running what i want, just need to figure out how to configure these damn drives.

Avatar image for -GeordiLaForge-
-GeordiLaForge-

7167

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#2 -GeordiLaForge-
Member since 2006 • 7167 Posts
I'm guessing that this is for a server? If so, you should really do some research before going online with it. It takes a little effort and knowledge to keep a server safe. I lost all of my databases when my server got hacked...
Avatar image for GenTom
GenTom

5945

Forum Posts

0

Wiki Points

0

Followers

Reviews: 36

User Lists: 0

#3 GenTom
Member since 2005 • 5945 Posts
wow.. thats a lot of....... porn? :P
Avatar image for deactivated-61b556b29800c
deactivated-61b556b29800c

306

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#4 deactivated-61b556b29800c
Member since 2006 • 306 Posts

Not a web server or porn lol. It's all internal data only within our family, and i'm able to block all external internet access to this machine leaving it internal only. It just needs to be a file server. Small part DVR/Music, huuuge part business data like hundreds of vmware images.

I should've stated i could drop the 500's just to make things simple, but expandability in the future on the 2TB array is a must for future.

Avatar image for -GeordiLaForge-
-GeordiLaForge-

7167

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#5 -GeordiLaForge-
Member since 2006 • 7167 Posts
RAID
Avatar image for deactivated-61b556b29800c
deactivated-61b556b29800c

306

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#6 deactivated-61b556b29800c
Member since 2006 • 306 Posts
I know about RAID, i run a RAID5 with the 500's right now, but want to get it out of this machine and into a machine in the basement but i'm having a hard time finding info on what are the best RAID controllers for price, or would software raid be ok...etc.
Avatar image for JigglyWiggly_
JigglyWiggly_

24625

Forum Posts

0

Wiki Points

0

Followers

Reviews: 4

User Lists: 0

#7 JigglyWiggly_
Member since 2009 • 24625 Posts
I have 1x500 HD for the OS in my server and then 9x500 gigers in RAID 6 on my server. I had RAID 5, but whenever i had data loss, 2 hds always failed at the same time. Luckily, I have another machine with 3x1.5tb, that has the data backed up too. I don't use hardware RAID controllers, I use MDADM in Linux, works very well... downside is, few GUI,s (disk utility sucks in Ubuntu), so just forget the GUIs, and you have to know what you're doing for the most part... to manage it I mean. To create an array isn't hard, but when you have problems, it can get anoyying.
Avatar image for GummiRaccoon
GummiRaccoon

13799

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#8 GummiRaccoon
Member since 2003 • 13799 Posts

I've always been a fan of adaptec raid controllers, but you'll pay more for them.

Avatar image for markop2003
markop2003

29917

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#9 markop2003
Member since 2005 • 29917 Posts
I'ld just use on of the 500gb drives for the OS and software then use 2tbs for the data. I'ld use RAID50 with a shared hot drive. Rebuilding a 20tb RAID5 array will take forever, RAID 50 would solve this by spliting it down into smaller spindles and you get the added performance benefits of RAID0 instead of just JBOD. Also i'ld make a note to try and use enterprise drives where possible, use redundent gigabit NICs (considering how cheap they are it would be stupid not to) and use gigbit switches throughout, you'll need a UPS too or a battery assisted RAID cache to avoid parity errors if the power fails.
Avatar image for JigglyWiggly_
JigglyWiggly_

24625

Forum Posts

0

Wiki Points

0

Followers

Reviews: 4

User Lists: 0

#10 JigglyWiggly_
Member since 2009 • 24625 Posts
I'ld just use on of the 500gb drives for the OS and software then use 2tbs for the data. I'ld use RAID50 with a shared hot drive. Rebuilding a 20tb RAID5 array will take forever, RAID 50 would solve this by spliting it down into smaller spindles and you get the added performance benefits of RAID0 instead of just JBOD. Also i'ld make a note to try and use enterprise drives where possible, use redundent gigabit NICs (considering how cheap they are it would be stupid not to) and use gigbit switches throughout, you'll need a UPS too or a battery assisted RAID cache to avoid parity errors if the power fails.markop2003
Yes a UPS is gr8 to have, if he has the budget, then a RAID controller with a battery is always nice, except I am cheap, I just get random SATA cards that offer good performance use software. Yeah, I am sure he has 1 gbp/s throughout, or there is little point to his setup, and about enterprise drives, they're pricy, but maybe worth it. I've had several bad hds, and replacements that are bad too. Out of 10, I'd say 4 have gone bad after about 4 years, which is a bit much. About RAID 50, I'd just recommend RAID 5 with a hot spare, or 6, I don't think he will need the eXtreme performance, and not to mention the performance is fast enough, even on my cheap setup. 500-600 MB/s reads.
Avatar image for deactivated-61b556b29800c
deactivated-61b556b29800c

306

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#11 deactivated-61b556b29800c
Member since 2006 • 306 Posts
Just updating. The machine i'm replacing already run on UPS's (all machines in my house do), after some thought and consideration from discussions with other people, i'm after a Promise raid card capable of RAID6.
Avatar image for JigglyWiggly_
JigglyWiggly_

24625

Forum Posts

0

Wiki Points

0

Followers

Reviews: 4

User Lists: 0

#12 JigglyWiggly_
Member since 2009 • 24625 Posts
That's what I use, it's very nice, easy and simple. OFC, I still don't see why you need a RAID card.
Avatar image for markop2003
markop2003

29917

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#13 markop2003
Member since 2005 • 29917 Posts
[QUOTE="JigglyWiggly_"] About RAID 50, I'd just recommend RAID 5 with a hot spare, or 6, I don't think he will need the eXtreme performance, and not to mention the performance is fast enough, even on my cheap setup. 500-600 MB/s reads.

The problem appears with rebuild, if his entire array is made up of 2tb drives that means you've got to rebuild 20tb all at once and whilst that is happening another drive can die and you have to deal the the decreased performance.
Avatar image for JigglyWiggly_
JigglyWiggly_

24625

Forum Posts

0

Wiki Points

0

Followers

Reviews: 4

User Lists: 0

#14 JigglyWiggly_
Member since 2009 • 24625 Posts

Which is why I recommend RAID 6, 2 drives dying is very unlikely. The reason I'm avoiding 50 and 60 is because they can be a bit more troublesome.

Avatar image for GummiRaccoon
GummiRaccoon

13799

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#15 GummiRaccoon
Member since 2003 • 13799 Posts

Which is why I recommend RAID 6, 2 drives dying is very unlikely. The reason I'm avoiding 50 and 60 is because they can be a bit more troublesome.

JigglyWiggly_

The only time I've seen harddrives dying simultaneously is with the deathstars.

Avatar image for LordEC911
LordEC911

9972

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#16 LordEC911
Member since 2004 • 9972 Posts

I have always been a fan of Raid 1+0.

Are the disks going to be mostly full and used only for reads or are they mostly empty and going to be used for writes?
If you are mainly reading off of them Raid 1+0 should be slightly better than Raid 5.
If you are mainly going to be writing to them, Raid 5 will be slightly better.

Just make sure you get a strong card that will be able to handle the I/O.