NAS + HTPC with all SSDs?

lnong

Prominent
Jun 28, 2017
3
0
510
I don't always (or often) upgrade my system, but when I do, I prefer to do it in a way that would allow it to stay "current" or "future-proof" for several years, even if it involves me doing it progressively throughout the year.

GOAL: Build a system that will include both a NAS and a HTPC, where files stored on the NAS could be any type and accessible (read/write) to any laptop in the house, while the media file types can additionally be served through DLNA and managed by the HTPC. Simply put, the NAS is a place for any files I want to back up and store, but I want to be able to feed the movie/music files to my A/V system for entertainment as well.

DESIRE: If possible, I want to use only NVMe SSDs in the system. I know that these are relatively new and are still costly, but I can start out small like with a few TBs at first, and then pick up more (or bigger) SSDs as they become cheaper. Also, my preference of the connection types for supporting NVMe is: U.2 > M.2 > PCIe (3.0).

QUESTIONS:
1) FreeNAS vs Windows Server 2016. I hear all the raves about FreeNAS and ZFS integrity, but I also hear good things about WS2016 and its ReFS. But the one thing I read and still need confirmation on is does WS2016 really allow adding disks of different sizes to an array and then automatically distributing the data onto the new drives, while FreeNAS cannot do either of these?

2) With FreeNAS, are you stuck to just a few of the plugin's available for handling Plex/DLNA/HTPC functions, while there are a lot more of these types of software on a Windows platform?

3) How much RAM should be used in a NAS with about 40-60 TB, and does it depend on whether FreeNAS or Windows is used?

4) Which motherboards out there have multiple (the more the better) U.2 connectors? Which have multiple M.2 connectors? Which have both U.2 and M.2 connectors, with more than one of each?

5) I see that there are SSDs made for U.2, SSDs made for M.2 and then SSDs that come on a PCIe 3.0 add-in card. And then there are M.2 -> U.2 adapters for people that just want to use 2.5" SSDs. But I have not come across any mentioning of a PCIe 3.0 x16 add-in card that contains 4 U.2 connectors on it. I understand that U.2 and M.2 connections supporting the NVMe protocol uses four PCIe 3.0 lanes each. But with a PCIe x16 bus available on a lot motherboards these days, mathematically the support is there. But why is there not any such a 4-port U.2 add-in PCIe card? I know that that number of lanes available to PCI cards (and other components in a computer) really depends on the number and configuration of HSIO lanes the CPU supports. But that's where boards with multiple CPUs come in to help.

Thank you.
 
Solution
The thing with using NVMe or even SATA SSDs in a NAS is your network. In order to even begin taking advantage of a fraction of that disk I/O you'd need to be running a 10Gbps home LAN. As for wifi clients, forget about it, they can't even saturate a single spinning disk over a network.

Even at 10Gbps LAN you're talking about realistically seeing 900MB/s of disk read/write performance over the LAN, and that's only for sequential read/writes. That can be accomplished with a good RAID card and 6-7 spinning disks in a RAID-5 with on-board cache (or SSD caching).

My recommendation: Look at an actual NAS, like a QNAP. They're LOADED with features and are far more than just a bulk storage device. Many models have 10Gbps flexibility and...
The thing with using NVMe or even SATA SSDs in a NAS is your network. In order to even begin taking advantage of a fraction of that disk I/O you'd need to be running a 10Gbps home LAN. As for wifi clients, forget about it, they can't even saturate a single spinning disk over a network.

Even at 10Gbps LAN you're talking about realistically seeing 900MB/s of disk read/write performance over the LAN, and that's only for sequential read/writes. That can be accomplished with a good RAID card and 6-7 spinning disks in a RAID-5 with on-board cache (or SSD caching).

My recommendation: Look at an actual NAS, like a QNAP. They're LOADED with features and are far more than just a bulk storage device. Many models have 10Gbps flexibility and SSD caching capabilities (including on-board m.2 connectors to connect m.2 SATA SSDs for caching). They can run your PLEX and media servers, share files to any client OS out there (including your mobile devices via apps), even run DHCP, virtual machines and a ton more.

I've got a TVS-882 that I loaded out to 32GB of RAM, added an Intel X540 10Gbps adapter to and put a couple m.2 SATA SSDs on board for caching, loaded out with 3.5" HDDs. It has a storage pool for file sharing to the house, also has an iSCSI LUN for my ESXi host (connected via one of its 10Gbps interfaces), runs a VM, and runs a few other apps you can add on it. Honestly the SSD caching isn't even really necessary because it'll use its RAM for write cache so even in a parity RAID (5 or 6) you get killer write performance. The SSD caching provides a little read benefit to me though. These things have a crazy feature set and great performance and definitely provide more than you could ever build in a desktop form factor for the $$.
 
Solution