Pure, unadulterated SPEED!!!

gogo809

Distinguished
Jan 8, 2011
4
0
18,510
I need a very fast sequential access data drive for a desktop. The faster the better. I am willing to invest in multiple HDD's and run striped raid. Data integrity is not an issue, so we can even keep it at the fastest (error prone) Raid 0 or possibly Raid 0+1. I can use as many drives as I can fit in a decent sized mid tower desktop. Probably 4 for the data dive 1 other (maybe ssd) for the OS.

There are a ton of new options for HDD's and Raid, and not a lot "out there" comparing them, so I wanted to draw on any and all experience you guys and gals have had with it.

(Some of these have already been answered in other posts on this forum, but I am looking for very up to date info if possible.)
1. What are the best HDDs to use? Old info I have found points to the Samsung Spinpoint F3 as having the best throughput, is this still true
2. Does SATA III (6Gb/s) make any difference whatsoever in a spindled HDD? (I would think the constraint would be read/write speed, not data transfer)
3. Do you still get better speeds with a discrete PCI Raid Controller? (Most good MOBO's have a raid controller built in nowadays)
4. What do you think about windows 7 software raid? (Crap?)

I am reading/writing/processing VERY large files (1GB minimum, 25GB max though the possibility exists for larger). There are multiple files so it is taking hours. To reduce processing time, I am looking into improving the slowest component; HDD read/write times. I know it will make a huge difference due to testing with RAMDisk. Though a better analog for that would be SSD, I believe the sequential reads and writes are supposed to be better on HDD's.

I have several dedicated servers (One Win2k8 server, one 2k8 file server) with nice processors and Raid 5 available to me (and controlled by me), but a 10/100 switch stops me from using them. It would take FOREVER to transfer the data. Even with a Gigabit switch (which I am supposed to get), it still wouldn't be fast enough to transfer gigabytes and gigabytes of data that way.

I'll take any information/links you can scrounge up on this one. Thanks guys and gals!

I am not going to be building this system today. But probably sometime in Late February or early March. If needed, can you recommend a good high speed Raid Controller?
 
Solution


You doing video? This could be a solution for you- one of the fastest available.

Take your pick...
If you're reading/processing/writing these files then the very first thing you should do is to arrange things so that the reading and the writing occur on different drives. Even if you use RAID to speed up sequential transfers, having the active files on different drives will make a big difference in elapsed times.

And when I say "different drives" I mean different physical drives, not on two different drive letters that are actually partitions on the same physical drive.
 
That is definitely something to consider. The large files are being read into a database though. hmmm. What if we store the database on a solid state drive, and fill it from 2 x raid 0 drives? (4 hdd's + 1 Solid State). I can do testing to see if its faster to thread the read/writes into separate processes, or just run them sequentially.

Does anybody have any input on the other questions? How about hardware recommendations?
 


You doing video? This could be a solution for you- one of the fastest available.

Take your pick:
http://www.newegg.com/Product/Productcompare.aspx?Submit=ENE&N=100008120%2050001550&IsNodeId=1&page=3&bop=And&CompareItemList=636|20-227-597^20-227-597-TS,20-227-578^20-227-578-TS,20-227-598^20-227-598-TS,20-227-659^20-227-659-TS,20-227-660^20-227-660-TS&nm_mc=AFC-C8Junction&cm_mmc=AFC-C8Junction-_-RSSDailyDeals-_-na-_-na&AID=10521304&PID=3463938&SID=

PCIe super fast SSD using four-way SF raid 0 controllers on board. Pretty sick throughput.
 
Solution