10gig ethernet NAS drive with 900MB/s transfer rate (read and write)

[andi okem]

I'm looking for a NAS drive that can have transfer speed : 900MB/s (minimum). I'll be using it for heavy 4k Visual effect compositing and editing. The best options for this actually is using thunderbolt2/3 RAID drive. But the problem is i want to use Ryzen CPU so I can't use thunderbolt because there's no x370 motherboard (for ryzen) that have thunderbolt header. So i need the alternative options using 10gig ethernet.

So the specs are :
- 10gig ethernet connection/port
- capacity 20TB
- budget around $5000
- minimum speed (R/W) : 900MB/s

I maybe have couple of options , but i haven't tried any of these. Have no idea if the performance is really good as i need. The options are : areca, qnap , g-speed. Anyone can help pls ?

Thanks.

 

[13thmonkey]

Not seen any 10G NAS reviews for a while? Have you considered building one? You'll need a 10G switch etc though... will get pricey. Unless you intend to use 10G to 10G crossover style, just one to one. You will need a tiered solution, or raid 10 on SSD's.

I don't know why there are no TB PCI-E cards, it would make it a lot simpler. Why so fast? getting to 350MB/s is a lot easier, by an order of magnitude, especially at that scale. The SSD's alone for 20TB will consume most of your budget at 900MB/s, at 350MB/s then raided HDDs would be fine and is easily reached.

USB 3.1 Gen 2 might be a better connection medium and is theoretically as fast as 10G, but with no switches etc. just need a NAS box that supports it.

The last one on this list might be an option. http://www.apollobuildtec.com/best-raid-enclosures/

 

[andi okem]

Thanks, i didn't think about the accesories needed like 10gig card, hub/switch etc which is not cheap. That's a good points that i'm not aware of, and yes now i find it become pricey or too pricey.

Using SSD is too expensive , for 20TB , it will cost me more than $8000. Am i right ?

I really need that 900MB/s 🙂 , i don't think i can use lower than 850MB/s. I have a Promise Pegasus raid system with thunderbolt that can tranfer 400MB/s and it's far from enough. I can't play it back at all. I need to stream real time at 24fps 4k 16bit file sequence such as cin, tga, dpx ,exr . It's not a raw file or mov file. So for example to playback 1 second footage means i have to stream it directly from the drive, 24 files of 4k image in 1 second. Each of these files is 53MB in size.

to be honest, the thunderbolt 2/3 is the perfect solution... but it means i have to go back to intel mobo (x99 chipset) and forget about the ryzen. And this is actually cheaper compared other solution.

This is the best candidate so far (in case i have to go to thunderbolt solution) :
https://www.youtube.com/watch?v=en6tiq_gXwM
cost me about $4000+ including the drives.

Not seen any 10G NAS reviews for a while? Have you considered building one? You'll need a 10G switch etc though... will get pricey. Unless you intend to use 10G to 10G crossover style, just one to one. You will need a tiered solution, or raid 10 on SSD's.

I don't know why there are no TB PCI-E cards, it would make it a lot simpler. Why so fast? getting to 350MB/s is a lot easier, by an order of magnitude, especially at that scale. The SSD's alone for 20TB will consume most of your budget at 900MB/s, at 350MB/s then raided HDDs would be fine and is easily reached.

USB 3.1 Gen 2 might be a better connection medium and is theoretically as fast as 10G, but with no switches etc. just need a NAS box that supports it.

The last one on this list might be an option. http://www.apollobuildtec.com/best-raid-enclosures/

 

[13thmonkey]

I thought i'd replied to this:

You have 2 problems.

1. Transporting data from the drives to the PC, USB3.1 gen2 will give you 10Gbps, and will be the best you can achieve.
2. Actually getting that much speed from Disks.
at roughly 200MB/s read speed you'd need 5 disks to approach 900MB/s assuming that scaling is 100% efficient (it isn't), so realistically you are looking at an array of maybe 7 disks, this will require a mirror else you'll be spending more time rebuilding the array than the benefit gained from the speed, so 14 disks in total, just finding the housing is not trivial.
A single NVMe/U.2 disk can do that however, or a pair of SATAIII SSDs in raid 0.
So a tiered solution might work, with an amount of SSD storage for the immediate part of the project, and then slower storage for the rest, you'll have to move between them, perhaps go and have lunch at this point?

We aren't quite there yet for cheap enough & fast enough storage for your purpose, late next year we will be. Currently £800 will get you 2TB of SATA III SSD. get two of these and you have a 4TB working partition, £1300 will get you a 4TB version, so blow 1/2 your budget on 8TB of SSD storage in raid0, spend another £1000 on good HDDs in raid 5/6 and a decent enclosure and you've got a chance of making it a better experience.

 

[Tech_TTT]

I'm looking for a NAS drive that can have transfer speed : 900MB/s (minimum). I'll be using it for heavy 4k Visual effect compositing and editing. The best options for this actually is using thunderbolt2/3 RAID drive. But the problem is i want to use Ryzen CPU so I can't use thunderbolt because there's no x370 motherboard (for ryzen) that have thunderbolt header. So i need the alternative options using 10gig ethernet.

So the specs are :
- 10gig ethernet connection/port
- capacity 20TB
- budget around $5000
- minimum speed (R/W) : 900MB/s

I maybe have couple of options , but i haven't tried any of these. Have no idea if the performance is really good as i need. The options are : areca, qnap , g-speed. Anyone can help pls ?

Thanks.

I see you have heavy budget just for the NAS , meaning money is no issue for you,

in that case ignore the AMD Ryzen and wait for the AMD Naples ... There is no point in going cheap and getting the Ryzen when you can spend $5000 Just for the NAS.

 

[andi okem]

I may change the setup for now , i will use thunderbolt 3 external drive (best candidate is areca raid 8050t3 12 bay with R/W speed at above 1700MB/s with reasonable price , half the NAS price ) and setup 10gig ethernet on my PC. Then i need to figure out where to get the adapter to connect between them. I'm looking the TB3 to 10gbe adapter, is there any ? i found sonnet and ATTO adapter, but they're working the other way around. It connects from PC with tb3 to any 10gbe pheripheral. I don't think i can use it for reverse process. Any suggestion ?

 

[badhddexpert]

i have similar plain. i plain buy a synology NAS 8-12bays. two fiber NIC,PC connect NAS via DAC cable. others PC visit NAS via 1000M NIC. i think this way cheap and satble. what do you think?

 

[Saga Lout]

Maybe there's someone else you can help, roger090.

 

[andi okem]

i have similar plain. i plain buy a synology NAS 8-12bays. two fiber NIC,PC connect NAS via DAC cable. others PC visit NAS via 1000M NIC. i think this way cheap and satble. what do you think?

If i want ryzen mobo or any other intel with no thunderbolt support, then the NAS will be the possible solution . In fact the NAS is twice the price of TB3 RAID. I 've checked some workstation-grade PCIe adapter manufacturers like sonnet, atto, akitio etc. They confirm there's no tb3 to 10gbe available so far. As some options (NAS) : DS1817 from synology and DX800RAID from sonnettech etc. via 10Gbe or SAS raid controller. If i don't need super high bandwidth i can use 1Gbe rather than the expensive 10Gbe.

 

[RealBeast]

If your machines are in close proximity there is a low cost solution if you really need it.

My storage machine with a large RAID 5 array is attached to my primary machine and a second backup NAS box using 10Gbps cheap style. I used 3 Intel X520DA2 adapters and three XDACBL5M 5m copper SFP+ DAC Twinax cables (if you want to go over 5m you need fiberoptic and the price goes way up), all bought off EBay (Intel brand on everything out of China) with a total cost of $475.

The NAS to NAS speed can max out the 10Gbps speed but not the primary computer as the SSD drives on it cannot saturate 10G.

Of course they all also are connected to the main gigabit Ethernet network.

 

[badhddexpert]

If your machines are in close proximity there is a low cost solution if you really need it.

My storage machine with a large RAID 5 array is attached to my primary machine and a second backup NAS box using 10Gbps cheap style. I used 3 Intel X520DA2 adapters and three XDACBL5M 5m copper SFP+ DAC Twinax cables (if you want to go over 5m you need fiberoptic and the price goes way up), all bought off EBay (Intel brand on everything out of China) with a total cost of $475.

The NAS to NAS speed can max out the 10Gbps speed but not the primary computer as the SSD drives on it cannot saturate 10G.

Of course they all also are connected to the main gigabit Ethernet network.

thanks for the details ideas. i am thinking how about PC use VHDX which save in NAS? i am doing same thing in my DS1515+ now. it's good way for me. i am data recovery guy. process many cases a day. i make VHDX for every case. eg. i have a 4 TB WD case. then i build a 8TB VHDX(dynamically expanding, it no real 8TB in your NAS. it occupy only contain capacity eg 4TB image but only 200GB inside so this 8TB VHDX file show size 200GB only and you can continue put data inside) in NAS start clone 4TB image. i will disconnect it from equipment clone PC and attach it to others extract data PC for another process. i think this way good for your manage your project too? easy and fast to MOVE project to another PC.
i use synology NAS long time. it stable and many good function. the point is it the best way for save data. of course it may over your budget.
why i recommend the 10GBE fiber way?
as it cheap way for high speed(DAC cable)
you can add fiber switch in the future when it price lower.
10G network is the future and you can see many 10G base product coming this year.