[SOLVED] Building a new workstation for molecular dynamics. Any advice?

Jan 28, 2019
11
0
10
Couple preliminary points:

1) We use NAMD -- GPUs have got to be CUDA-capable Nvidia.
2) Our budget is around 5k USD.
3) By the end of the year we may have additional 5k to spend on the workstation, so it MUST have the potential to scale.

Questions:

1) Should we go for a single node workstation and try to make it as powerful as possible or a cluster of two sub-optimal nodes which together will outperform the optimal single node workstation? In case several-node systems are mostly needed to run several distinct simulations simultaneously, this is not our case -- assume we'll be running one task at a time.

2) Do we go with a single CPU system or a dual? Naturally, there will be more than one GPU. Do we need to have the second CPU to handle the second GPU? Or are modern CPUs capable of efficiently handling two GPUs at once? We won't be buying the 2nd CPU just now, but we need to plan for it, motherboard-wise.

3) Which CPU/CPUs? Should it necessarily be from Xeon family? Or would, say, i7-9800x be up to the task? Which particular models of both Xeon and non-Xeon series would you recommend?

4) What do we cool them with?

5) GPU. If we are able to afford Nvidia Tesla (K40, for example), should we go for it? Or are Teslas basically for supercomputers so they make sense only when there are thousands of them when even slight computational gains really add up, and we'd be no noticeably worse if we spent this money on a pair of decent GeForces?

Then which ones? Looks like a pair of 1070 buys 1080. Same goes for a pair of 2070 vs 2080. Do we go with the 10xx family or 20xx? Do we buy a single xx80 now and add another one at the end of the year? Or do we buy two xx70 now and add another two later? Will we be able to handle 4 GPUs? Are there even any benefits to having 4 GPUs instead of 2 or do the effects of having additional GPUs plateau at this point?

Also, which video card producers are the most reliable these days? Asus, EVGA, etc.?

6) Motherboard?

7) RAM. I guess no less than 64GB, but what other specs would be the best? Latency, etc.

8) PSU. How much watts will we need? Which PSUs are the most reliable?

9) And, perhaps, which tower. Well-ventilated, with enough space and everything.

Thanks.
 
Solution
https://www.pugetsystems.com/labs/hpc/NAMD-Molecular-Dynamics-Performance-on-NVIDIA-GTX-1080-and-1070-GPU-815/
https://www.pugetsystems.com/labs/hpc/AMD-Threadripper-and-1-4-NVIDIA-2080Ti-and-2070-for-NAMD-Molecular-Dynamics-1321/

shows GPU is much more important and Threadripper has most PCIE lanes to prevent bottlenecks.

PCPartPicker part list / Price breakdown by merchant

CPU: AMD - Threadripper 2990WX 3 GHz 32-Core Processor ($1699.99 @ SuperBiiz)
CPU Cooler: Corsair - H150i PRO 47.3 CFM Liquid CPU Cooler ($139.99 @ Newegg)
Motherboard: ASRock - X399 Taichi ATX TR4 Motherboard ($294.88 @ OutletPC)
Memory: Corsair - Vengeance LPX 128 GB (8 x 16 GB) DDR4-3200...
https://www.pugetsystems.com/labs/hpc/NAMD-Molecular-Dynamics-Performance-on-NVIDIA-GTX-1080-and-1070-GPU-815/
https://www.pugetsystems.com/labs/hpc/AMD-Threadripper-and-1-4-NVIDIA-2080Ti-and-2070-for-NAMD-Molecular-Dynamics-1321/

shows GPU is much more important and Threadripper has most PCIE lanes to prevent bottlenecks.

PCPartPicker part list / Price breakdown by merchant

CPU: AMD - Threadripper 2990WX 3 GHz 32-Core Processor ($1699.99 @ SuperBiiz)
CPU Cooler: Corsair - H150i PRO 47.3 CFM Liquid CPU Cooler ($139.99 @ Newegg)
Motherboard: ASRock - X399 Taichi ATX TR4 Motherboard ($294.88 @ OutletPC)
Memory: Corsair - Vengeance LPX 128 GB (8 x 16 GB) DDR4-3200 Memory ($999.99 @ Newegg)
Storage: Crucial - MX500 500 GB 2.5" Solid State Drive ($57.99 @ Amazon)
Storage: Samsung - 970 Evo 1 TB M.2-2280 Solid State Drive ($247.99 @ Amazon)
Video Card: EVGA - GeForce RTX 2080 Ti 11 GB Black Video Card ($1099.99 @ SuperBiiz)
Power Supply: EVGA - SuperNOVA G2 1300 W 80+ Gold Certified Fully-Modular ATX Power Supply ($156.88 @ OutletPC)
Total: $4697.70
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2019-01-28 17:26 EST-0500

Add one more 2080ti once the other 5k kicks in. Also add 2 more + a second psu in the future if needed.
 
Solution
Threadripper would be my choice, if your software can take advantage of that many cores/threads. You may want a quadro card, for this as well. If all that matters is cuda core amount, and not whether it is single or double precision, then a 2080ti is fine.

PCPartPicker part list / Price breakdown by merchant

CPU: AMD - Threadripper 2990WX 3 GHz 32-Core Processor ($1699.99 @ SuperBiiz)
Motherboard: ASRock - X399 Taichi ATX TR4 Motherboard ($324.98 @ Newegg)
Memory: Corsair - Vengeance LPX 64 GB (4 x 16 GB) DDR4-3000 Memory ($439.99 @ Newegg)
Storage: Samsung - 970 Evo 250 GB M.2-2280 Solid State Drive ($84.85 @ Amazon)
Storage: Samsung - 860 Evo 1 TB 2.5" Solid State Drive ($147.99 @ Amazon)
Storage: Toshiba - N300 6 TB 3.5" 7200RPM Internal Hard Drive ($168.99 @ Amazon)
Video Card: PNY - Quadro P5000 16 GB Video Card ($1698.22 @ Amazon)
Case: Fractal Design - Arc Midi ATX Mid Tower Case ($49.99 @ Newegg)
Power Supply: Corsair - RMx 1000 W 80+ Gold Certified Fully-Modular ATX Power Supply ($139.99 @ Newegg)
Operating System: Microsoft - Windows 10 Pro OEM 64-bit ($124.89 @ My Choice Software)
Other: Dark Rock Pro TR4 for AMD ($89.99)
Total: $4969.87
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2019-01-28 17:30 EST-0500

 

I'll look into quadro, but the fact that Nvidia only markets them for professional graphics gives me a pause. Thanks.