2u Supermicro server build and storage setup

t235235

Distinguished
Jun 7, 2014
2
0
18,510
I'm looking to build a 2u server. It's going to host a private web site for a small number of users. The web site will be database backed and will also act as a front end for a small number of large files (80gb - 1.5tb each). I don't know if it makes any difference with regards to components, but it's going to sit in a data centre. I'm planing to run ubuntu server on the machine. My current storage needs are about 5-7tb and assuming the success and continued pursuit of my project they will rise to 25tb and possibly beyond within 12-18 months. I have no idea what kind of processing power I will need, but I do know that I will currently need approx 5-10gb of in memory data. As this is a self funded personal project I'd like to keep the costs to a minimum, but with some consideration for my future needs.

My current plan is:
1x Intel E5-2620v2
1x Samsung 840 SSD 256gb
32gb ECC Ram
Supermicro dual processor motherboard
Supermicro 2u 12x3.5" hot swap chassis
6x 4TB Hitatchi deskstar hard drives

I've got a few questions:

1) Is a 500W power supply sufficient (in the case I need to upgrade?)
I estimate that if I need to add another processor, more ram etc, that worst case (with what I think are very conservative overestimates) that I'm looking at is:
12 drives x 10w = 120w
2 E5-2620v2 x 95 = 190w
up to 6 ram sticks = 20w
fans = 15w?
motherboard = 20-80w???
hba/raid = 30w?
total = ~455w worst case
Is this reasonable? I'm also running another supermicro machine with 920w power supplies, for which a 500w PSU would not be sufficient. Is having more shared parts a consideration at all?

2) How to connect the drives? Which hardware should I get? I see myself as having a few options:
a) get a chassis with a direct access backplane and get a hdd/raid controller attached directly to them
b) get a chassis with a SAS expander, which would allow me to either get a cheaper and smaller hdd/raid controller or to get a motherboard with built in SAS ports like http://www.supermicro.co.uk/products/motherboard/Xeon/C600/X9DRL-3F.cfm (this seems slightly cheaper than a - especially if I'm running off of the motherboard)
c) Do I want a RAID controller? I'm still unsure as to the storage setup I want to use. I've been scared away from RAID 5 because of UREs during a rebuild and I'm worried about RAID 6 performance (side note: most of those large files will be written only once or several times and then only read). What kind of setup do I want?

3) With consideration to 2) is my drive choice ok? Is it worth paying extra for the enterprise grade? Will they play nice with my chosen hardware?

4) Any idea how much time/hassle (if any) I might save by going with a 1u server and a 2u NAS? I'd figure I'm looking at an extra £600-800 (~£3300 vs £2500+) in build out costs plus £600/yr more for colocating the extra server. Plus, if I do get to the point of scaling out to a quarter rack I'll have 2x4u plus this server (or server + NAS) so the extra u could limit my options a bit (though the running costs would be equal at that point assuming they fit and I don't need any other servers).

I hate to put the cart before the horse with regards to the storage setup I have in mind, but I'm hoping someone might have some insight on which direction I should take. Thanks so much for any help.
 
To start you off - I would recommend some higher quality storage drives.

You won't necessarily get better performance from enterprise class drives. What you get is reliability. Desktop orientated drives are designed for desktop users eg. 6 hours per day fairly light usage. Run them 24-7 and the failure rates soon shoots up.

I would at the least upgrade to a Samsung 840 Pro and some WD Black/Red drives. These still aren't enterprise class but have much improved reliability.


Also I'm fairly certain RAID-5 is not recommended for good database performance. RAID-10 is usually to set-up of choice here.
 


Thanks for your reply. That sounds reasonable. I had actually meant the 840 pro and hadn't realised that there are 2 different versions. I think I'll just go with 4x4tb enterprise drives running as RAID 10 since 8tb is sufficient for my needs at the moment and will come in at roughly the same cost as my original plan.

As to the other stuff, I just decided that I'll go with SC826BE16-R920LPB so I don't have to worry about any PSU issues as 500w seems to cut it close. I'm also thinking of going with http://www.supermicro.co.uk/products/motherboard/Xeon/C600/X9DRL-3F.cfm and just using the onboard SAS with a software raid 10. I figure I can always upgrade to a dedicated HBA should I have performance issues. Any idea if that seems reasonable?
 

TRENDING THREADS