Desktop Finite Element Machine

[raycecscedu]

I've built two respectable scientific computers using ASUS dual socket server boards w/Xeon quad core cpu's and would like to continue my evolution. Cost limit is about $2500 and I am thinking about GPU cards (nvidia cuda) to help with my finite element software (supports cuda). I've seen a fair number of posts but either they are gamers or a little out-dated. Any suggestions about how to proceed? Present system: Dual Xeon E5620, 24 GB ram, Win10-64, 12 TB HD storage 2x 260 GB SSD.

 

[imsqam]

Doing FEA's are you. Can you provide the name and version of the actual software package you are using? In the meantime I will begin on a build, I am thinking Ryzen Threadripper here.

 

[imsqam]

Can you provide the details of all your existing components, especially the HDD's. I want to see if we can salvage some of that gear.

 

[imsqam]

Okay, here is a draft build. We can edit as you provide information. CPU is a 12 core with a 3.5 GHz core speed. You will be disabling the multi-threading of course. 64GB of RAM, expensive yes but well worth it especially if you are working on larger models. No storage included although I was looking at an Optane SSD. It might well be worth it if you will breach the 64GB RAM limit. Mid level Quadro GPU, use of a workstation card is a good idea here.

Okay, looking for more info here.

PCPartPicker part list: https://pcpartpicker.com/list/rWdwtJ
Price breakdown by merchant: https://pcpartpicker.com/list/rWdwtJ/by_merchant/

CPU: AMD - Threadripper 1920X 3.5GHz 12-Core Processor ($674.99 @ Amazon)
CPU Cooler: Noctua - NH-U12S TR4-SP3 93.4 CFM CPU Cooler ($69.90 @ Amazon)
Motherboard: ASRock - X399 Taichi ATX TR4 Motherboard ($335.49 @ SuperBiiz)
Memory: G.Skill - Ripjaws V Series 64GB (4 x 16GB) DDR4-3200 Memory ($699.99 @ Newegg)
Video Card: PNY - Quadro P2000 5GB Video Card ($419.99 @ Dell)
Case: Fractal Design - Define S ATX Mid Tower Case ($78.99 @ SuperBiiz)
Power Supply: SeaSonic - Snow Silent 750W 80+ Platinum Certified Fully-Modular ATX Power Supply ($136.99 @ SuperBiiz)
Total: $2416.34
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2018-01-28 15:56 EST-0500

 

[raycecscedu]

Thanks Imsqam,
Answers and clarifications.
1. Main software package I use is Midas GTS NX and Midas Civil. Both are made by Midas IT from Korea. Used for Geotechnical/Structural/Civil Engineering Analysis. The main performance demand issues are size of problem: up to maybe 2 million degrees of freedom; material non-linearity (soil, structural member behavior); geometric nonlinearity (structures become distorted, separated); dynamics (non-linear time history analysis requiring small time steps with 30-sec time histories, earthquakes)
2. I check the hard drives. They are 4x 3TB SATA with 6 GB/sec bandwidth.
3. SSD's are OCZ-vertex 280 GB, and Muskin 240 GB

I take it the disable multi-threading is because the GPU's will be doing the work and I want the CPU to stay out of the way.

 

[imsqam]

First, the statement about multi-threading is based on the fact the vast majority of simulation software does not exploit multi-threading and the software actually work better with it disabled.

Okay, 2nd draft. Changed RAM to ECC type, this is highly suggested to prevent crashes, especially when you are in the last stages of simulation. RAM is still at 64GB, this should be enough to hold 2M degrees of freedom models. Had to change case to one that has more storage capability.

Upped the PSU to an 850W, the machine will spend extended periods of time under heavy load and I would feel more comfortable with a bit more head room.

Found almost no literature regarding hardware optimization for Midas GTS NX and/or Midas Civil, just some very basic min requirements. But I did find this general article which I thought was quite a good analysis.
http://www.develop3d.com/workstations/workstations-for-simulation-fea-Ansys-Mechanical-17.0

In an effort to assess RAM needs I reviewed this, different software but probably still in the ballpark.
https://www.comsol.com/blogs/much-memory-needed-solve-large-comsol-models/

Storage has been the big mystery though. I looked at Optane but that only seems to be of value if you are using a single HDD as your boot drive. My original thought was to use it as a cache drive with the 4 HDD's setup in a RAID but that does not work.
https://www.intel.com/content/www/us/en/support/articles/000024018/memory-and-storage/intel-optane-memory.html

Your 4 HDD's will make a nice little RAID 10 setup which will be good for raw storage but they should have nothing to do with the simulation work. I included a 240GB NVMe drive for your boot drive for now. At some point you might want to get the HDD's out of the case and into a NAS desktop system
https://www.newegg.com/Product/Product.aspx?Item=9SIA2F866R1769&cm_re=nas-_-22-108-624-_-Product

I am going to continue to look at the storage issue, I would not want to drag the rest of the system down with a poor storage solution. Puget Systems who I find to be very knowledgeable seem to be going with 500+GB SSD's only in their Solidworks systems.
https://www.pugetsystems.com/recommended/Recommended-Systems-for-SOLIDWORKS-150/Hardware-Recommendations
https://www.pugetsystems.com/recommended/Recommended-Systems-for-SOLIDWORKS-150/Buy_196

In the build below I just tried to approximate your current HDD's and SSD's. I could not find an OCZ SSD that is 280GB in size. I assume that they are both SATA SSD's.

PCPartPicker part list: https://pcpartpicker.com/list/XcR9jc
Price breakdown by merchant: https://pcpartpicker.com/list/XcR9jc/by_merchant/

CPU: AMD - Threadripper 1920X 3.5GHz 12-Core Processor ($680.98 @ Newegg)
CPU Cooler: Noctua - NH-U12S TR4-SP3 93.4 CFM CPU Cooler ($69.90 @ Amazon)
Motherboard: ASRock - X399 Taichi ATX TR4 Motherboard ($335.49 @ SuperBiiz)
Memory: Kingston - ValueRAM 16GB (1 x 16GB) DDR4-2400 Memory ($178.99 @ SuperBiiz)
Memory: Kingston - ValueRAM 16GB (1 x 16GB) DDR4-2400 Memory ($178.99 @ SuperBiiz)
Memory: Kingston - ValueRAM 16GB (1 x 16GB) DDR4-2400 Memory ($178.99 @ SuperBiiz)
Memory: Kingston - ValueRAM 16GB (1 x 16GB) DDR4-2400 Memory ($178.99 @ SuperBiiz)
Storage: Mushkin - Chronos 240GB 2.5" Solid State Drive (Purchased For $0.00)
Storage: OCZ - Vertex 250GB 2.5" Solid State Drive (Purchased For $0.00)
Storage: MyDigitalSSD - BPX 256GB M.2-2280 Solid State Drive ($129.99 @ Amazon)
Storage: Seagate - Barracuda 3TB 3.5" 7200RPM Internal Hard Drive (Purchased For $0.00)
Storage: Seagate - Barracuda 3TB 3.5" 7200RPM Internal Hard Drive (Purchased For $0.00)
Storage: Seagate - Barracuda 3TB 3.5" 7200RPM Internal Hard Drive (Purchased For $0.00)
Storage: Seagate - Barracuda 3TB 3.5" 7200RPM Internal Hard Drive (Purchased For $0.00)
Video Card: PNY - Quadro P2000 5GB Video Card ($419.99 @ Dell)
Case: NZXT - Phantom 410 (Black) ATX Mid Tower Case ($79.99 @ SuperBiiz)
Power Supply: SeaSonic - FOCUS Plus Gold 850W 80+ Gold Certified Fully-Modular ATX Power Supply ($117.40 @ Amazon)
Total: $2549.70
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2018-01-29 20:30 EST-0500