Building a server home.

[0rangefox]

Hello guys, i need help about this please. I recently purchased 2 Intel Xeon x5675, but i want know about your opinion, how you recommend me, in buying one motherboard dual cpu, scoket 1366, ddr3 and with good speed about ram, cpu etc...., and i wanted to know too some coolers good for my CPU. And how much Watts i will need to buy my Power Supply for this all components. And I want he have a good air cooler, for no heat CPU or RAM. And suggest me some cases good for the motherboard you will suggest for me. Thank you.

List of my components i will want for my server:
-> 2x Intel Xeon x5675
-> 32gb RAM DDR3 ECC 1333Mhz
-> 3TB HDD 7.2k RPM

 

[kanewolf]

Dual socket motherboards very often have proprietary connectors. Stay away from Dell, HP, IBM motherboards. Asus, Supermicro, are pretty safe, but read the owner's manual before purchase. Don't buy a 2U server chassis and swap CPUs. 2U servers are very loud. A deskside workstation like a HP Z800 or Dell T series is a good choice for a CPU swap.

 

[0rangefox]

Dual socket motherboards very often have proprietary connectors. Stay away from Dell, HP, IBM motherboards. Asus, Supermicro, are pretty safe, but read the owner's manual before purchase. Don't buy a 2U server chassis and swap CPUs. 2U servers are very loud. A deskside workstation like a HP Z800 or Dell T series is a good choice for a CPU swap.

Hey @kanewolf, thank you for getting one response, but you can explain more what is CPU Swap? I didnt hear about these thing. And about this motherboard, Supermicro X8DTN+-F, its good for me?

 

[kanewolf]

What I mean by a CPU swap is if you find a Z800 with a lower performance CPUs installed for sale on E-Bay. You buy a fully functional workstation and swap in higher performance CPUs.

That motherboard is probably OK. You need to ensure that you purchase a power supply with two ATX12V plugs. That motherboard requires 24pin power plus TWO 8 pin ATX12V power plugs. You want to install RAM in multiples of 6 DIMMs (three per CPU socket). So six or twelve 4GB DIMMs, etc. See page 2-6 of the user's manual for memory sizing. You really want REGISTERED DIMMs (RDIMMs). Use the TESTED memory list on the Supermicro page to find RDIMMs.

 

[0rangefox]

What I mean by a CPU swap is if you find a Z800 with a lower performance CPUs installed for sale on E-Bay. You buy a fully functional workstation and swap in higher performance CPUs.

That motherboard is probably OK. You need to ensure that you purchase a power supply with two ATX12V plugs. That motherboard requires 24pin power plus TWO 8 pin ATX12V power plugs. You want to install RAM in multiples of 6 DIMMs (three per CPU socket). So six or twelve 4GB DIMMs, etc. See page 2-6 of the user's manual for memory sizing. You really want REGISTERED DIMMs (RDIMMs). Use the TESTED memory list on the Supermicro page to find RDIMMs.

Thank you again for response, and about this motherboard on Ebay? Its okay? And i will buy two 16gb rams, are these RAMS on ebay. And you can suggest me one Case for server with compatibility to put the motherboard and one Power Supply with Watts suficcient to all components i want. Please?

Really, thank you so much.

 

[kanewolf]

Don't buy two DIMMs. Buy SIX smaller ones -- SIX 8GB DIMMs or SIX 4GB DIMMs. I said that in the previous post. Those CPUs have triple channel memory controllers. You want to put a DIMM in each channel.

You want a power supply with 750 to 850W with dual ATX12V plugs. You want a case that can support an EEATX motherboard. I don't have a recommendation.

Problems like finding a case that fit is one reason I recommend buying a workstation and upgrading if necessary. It has the right size case and power supply.

Also remember that a PRO version of Windows desktop or a server version is required for dual socket motherboards.

 

[0rangefox]

Okay thank you! I will buy one of these Power Supply, but about this.

Don't buy two DIMMs. Buy SIX smaller ones -- SIX 8GB DIMMs or SIX 4GB DIMMs. I said that in the previous post. Those CPUs have triple channel memory controllers. You want to put a DIMM in each channel.

You can give me one example? Please? Because im not much expert on CPU or Motherboards.

 

[kanewolf]

Search for 4GB ddr3 RDIMM or 8GB ddr3 RDIMM on e-bay just like you did for the motherboard. Then check the approved memory list on Supermicro's webpage. I am not going to do your work for you. If you want a server, then you have to do the work. AGAIN this is why I recommend buying a used Z700 or Dell T series workstation. It has everything you need.

 

[0rangefox]

Search for 4GB ddr3 RDIMM or 8GB ddr3 RDIMM on e-bay just like you did for the motherboard. Then check the approved memory list on Supermicro's webpage. I am not going to do your work for you. If you want a server, then you have to do the work. AGAIN this is why I recommend buying a used Z700 or Dell T series workstation. It has everything you need.

But why, i cant put 2 RAM 16gb? I dont understand this part.

 

[kanewolf]

You can put in two DIMMs, you will loose 2/3 the memory bandwidth per CPU. You will badly impact performance. You don't WANT to put in two DIMMs if you want all the possible performance from those CPUs.

 

[0rangefox]

You can put in two DIMMs, you will loose 2/3 the memory bandwidth per CPU. You will badly impact performance. You don't WANT to put in two DIMMs if you want all the possible performance from those CPUs.

But why i will lose, its what i want to understand and explain me please. I will lose badwidth because im not using all slots of RAM? its because it?

 

[kanewolf]

Each CPU can SIMULTANEOUSLY access three DIMM slots at one time. The hardware will spread the data in the three memory channels. So the CPU can read and write three times as fast if you have all three memory channels filled. I don't know how to explain it any better.

 

[0rangefox]

Each CPU can SIMULTANEOUSLY access three DIMM slots at one time. The hardware will spread the data in the three memory channels. So the CPU can read and write three times as fast if you have all three memory channels filled. I don't know how to explain it any better.

Hmmm i think im understanding but let me say its correct, On the motherboard i will buy, 1 Channel = 9 Slots for ram. Its correct? And my motherboard go 2 Channels, on total is 18 slots to put RAM. is correct?

 

[kanewolf]

No. One memory channel == one DIMM. The motherboard can put 3 DIMMs / channel. Look at page PDF page 22 of the user's manual -- https://www.supermicro.com/manuals/motherboard/5500/MNL-1199.pdf It shows the block diagram of the motherboard. Each CPU has three banks of memory each of which can hold up to three DIMMs Look at PDF page 36 where the motherboard manual says how to place RAM.

MULTIPLES of THREE DIMMs / CPU socket for maximum performance.

 

[0rangefox]

No. One memory channel == one DIMM. The motherboard can put 3 DIMMs / channel. Look at page PDF page 22 of the user's manual -- https://www.supermicro.com/manuals/motherboard/5500/MNL-1199.pdf It shows the block diagram of the motherboard. Each CPU has three banks of memory each of which can hold up to three DIMMs Look at PDF page 36 where the motherboard manual says how to place RAM.

MULTIPLES of THREE DIMMs / CPU socket for maximum performance.

I dont understand, for me its chinese, i think i need you say me more simple, example make images with explain xd
So, to get maxium perfomance is, if i buy 3 16gb i will get in maxium perfomance?

 

[kanewolf]

I have no less than 6 times above said to buy three DIMMs per CPU socket. A total of six DIMMs for the motherboard. That would give you 24GB with 4GB DIMMs or 48GB with 8GB DIMMs.

We are not communicating. I believe English is not your primary language. I am done. Sorry for not be more helpful.

 

[0rangefox]

I have no less than 6 times above said to buy three DIMMs per CPU socket. A total of six DIMMs for the motherboard. That would give you 24GB with 4GB DIMMs or 48GB with 8GB DIMMs.

We are not communicating. I believe English is not your primary language. I am done. Sorry for not be more helpful.

But on website of Intel Xeon x5675 say can support on maxium 288gb of RAM, and what is?

 

[popatim]

288GB is the MOST ram that the processor can use but have no worries, they don't make RDimm's that big yet.

At your level of knowledge, you should not be attempting to build a server, especially when the motherboard manual is like Chinese to you. Hire someone to build this for you. You will save money since you won't have to go back and fix all your mistakes.

Good luck.

 

[0rangefox]

288GB is the MOST ram that the processor can use but have no worries, they don't make RDimm's that big yet.

At your level of knowledge, you should not be attempting to build a server, especially when the motherboard manual is like Chinese to you. Hire someone to build this for you. You will save money since you won't have to go back and fix all your mistakes.

Good luck.

Hey, thank you, but i know how motherboard works, but only motherboard with 1 CPU and not with 2, and its because um saying on this fórum, for help me, so, let me say, other guy said if i put one RDimm (Registered RAM?) 16gb with 2 CPU i Will lose power or something? Please help me, and on my country , dont have much people can help me about my problem, so, you are the guys who can help me.

 

[popatim]

As told several times, you really should get 3 RDimm modules for each CPU. This server is not setup like a PC. Though they are similar they are more sophisticated/complex

Each CPU gets its access to its memory at very high speed and also has access to the other CPU's memory but this secondary access is MUCH slower. So much slower that you really want to avoid it so be sure to get enough for each CPU but not so much as that you waste money by having ram you aren't using. How much you need is dependent on many factors such as the OS, Applications it will Run, and the number of users it will support concurrently.

- Each CPU should have the same amount of RAM as the other.
- Use Supported kits from either the motherboards list of ram or the memory makers list that are verified for your motherboard.
- Each kit will have 3 sticks of identical RDimm Ram modules. (You will use 6, 12, or 18 sticks total depending on motherbd)
- Use the motherbd owners manual and follow their instructions on where to install the ram to. (No, I will not read it for you)

You really should buy a pre-built system or have one built for you if you need a server , otherwise a single core pc running a single Xeon CPU with many cores would be easier to setup and manage for you. For example, price out RDimm ram modules

 

[0rangefox]

As told several times, you really should get 3 RDimm modules for each CPU. This server is not setup like a PC. Though they are similar they are more sophisticated/complex

Each CPU gets its access to its memory at very high speed and also has access to the other CPU's memory but this secondary access is MUCH slower. So much slower that you really want to avoid it so be sure to get enough for each CPU but not so much as that you waste money by having ram you aren't using. How much you need is dependent on many factors such as the OS, Applications it will Run, and the number of users it will support concurrently.

- Each CPU should have the same amount of RAM as the other.
- Use Supported kits from either the motherboards list of ram or the memory makers list that are verified for your motherboard.
- Each kit will have 3 sticks of identical RDimm Ram modules. (You will use 6, 12, or 18 sticks total depending on motherbd)
- Use the motherbd owners manual and follow their instructions on where to install the ram to. (No, I will not read it for you)

You really should buy a pre-built system or have one built for you if you need a server , otherwise a single core pc running a single Xeon CPU with many cores would be easier to setup and manage for you. For example, price out RDimm ram modules

So let me say , if i understand now, what are you trying to say is, CPU support only 3 RAM of ECC, and 6 RAM of Non-ECC? So, if i put 3x 16GB Ecc + 6x 16GB Non-ECC for 2 CPU, will working good and powerfull?

 

[popatim]

No.
Each cpu supports up to 9 ram sticks, depending on the motherbd.
You don't mix ECC with non-ECC ram.
Best performance in using triple channel memory which requires a grouping of 3 sticks or ram, preferably a matched set which means they've been verified by the manufacturer to work together in triple channel mode.

With you wanting a dual cpu server, you will need 2 kits (one for each cpu) so 6 sticks of ram total at Minimum.
So if you buy two 12gb kits, you Will have 3 sticks of 4GB ram in each kit for a total of 6 pieces (24GB of ram).
- Each CPU will have direct access to its 12gb of ram even though you have 24GB in total in the server.
- Each CPU will have indirect access to the other's CPU ram but this is much much slower.
Its similar to cramming two motherbd into one case, though you have 24gb installed, you really have two sets of 12gb.

If your motherbd has 12 ram slots you can use 1 or 2 kits per CPU (since each cpu has 6 slots for its ram)
If your motherbd has 18 ram slots you could use 1, 2, or 3 ram kits per CPU (since each cpu will have 9 ram slots) I do not recommend these motherbds.


In contrast to getting a single cpu (with more cores), all cores would have access to the full amount of installed ram and setup would be very similar to a standard pc.

 

[0rangefox]

No.
Each cpu supports up to 9 ram sticks, depending on the motherbd.
You don't mix ECC with non-ECC ram.
Best performance in using triple channel memory which requires a grouping of 3 sticks or ram, preferably a matched set which means they've been verified by the manufacturer to work together in triple channel mode.

With you wanting a dual cpu server, you will need 2 kits (one for each cpu) so 6 sticks of ram total at Minimum.
So if you buy two 12gb kits, you Will have 3 sticks of 4GB ram in each kit for a total of 6 pieces (24GB of ram).
- Each CPU will have direct access to its 12gb of ram even though you have 24GB in total in the server.
- Each CPU will have indirect access to the other's CPU ram but this is much much slower.
Its similar to cramming two motherbd into one case, though you have 24gb installed, you really have two sets of 12gb.

If your motherbd has 12 ram slots you can use 1 or 2 kits per CPU (since each cpu has 6 slots for its ram)
If your motherbd has 18 ram slots you could use 1, 2, or 3 ram kits per CPU (since each cpu will have 9 ram slots) I do not recommend these motherbds.


In contrast to getting a single cpu (with more cores), all cores would have access to the full amount of installed ram and setup would be very similar to a standard pc.

Thank you so much! Now i understand the "logics", so you can say me one motherboard recommended for my specs please?

 

[popatim]

Nope. I'm one of the ones trying to talk you out of building a two cpu system as there are many more 'oddities' with such a build then I feel like supporting.

Sorry.

 

[0rangefox]

Nope. I'm one of the ones trying to talk you out of building a two cpu system as there are many more 'oddities' with such a build then I feel like supporting.

Sorry.

Okay, no problem, i will try find profissionals to talk with him. Thank you anyways.

Best regards,
0rangeFox