Question Deep Learning Dedicated Build

[ZCodeMichael]

Hi! This is my first post on this platform. I'm thinking of building a reasonably priced computer dedicated to fine-tuning image models or training one completely from scratch. As a starter, I just want to have a barebones build that has the essential components (CPU, RAM, Motherboard) that has no GPUs to start with, and later on, if/when I find a good deal on a GPU I like, I'll start adding them. So the key thing for this build is expandability, especially for multiple GPUs. Here is the current build I have in mind:

CPU i7-6700 (or the k variant if I get a good price) ~70-80 USD
Motherboard Z170-WS ~100 USD

[Both CPU and motherboard are used listings from ebay. I haven't bought them yet so prices might fluctuate]

Memory 16gb (some unknown ddr4 ram sticks from my old build but I have plans to add more if needed)
Power Supply EVGA 700 GD, 80+ Gold 700w
Storage will be transferred from my old build (2 - 1tb SSDs and 1 - 500gb SSD)
Case ATX form factor also from my old build

The reason I picked this specific motherboard is because I couldn't find any other motherboards (besides server motherboards) that have a high number of PCIe slots and have high bandwidth for multiple GPUs. The specs for this motherboard allow 4 GPUs in x8 mode. This might sound overkill, but I like to have the option to expand to 4 GPUs and try out different combinations.

A few concerns I have about this build:

1. What I'm concerned about is the limited number of supported CPUs with this motherboard that aren't 8/9th gen. I'm concerned that even if I get the best in-slot CPU it will still bottleneck the GPUs in terms of pushing data back and forth.
   1. This might be quite subjective since it probably depends on the kind of GPUs I get. Ideally, I would love to have 2 RTX 3060 (12gb) but realistically, if I'm lucky, I might be able to get 3-4 GTX 1070s for a good price. I picked the GTX 1070s since it's mid-range, decently fast, and they're pretty cheap for 8gb VRAM, but I'm all ears for suggestions on the type of GPU.
   2. Also, if there's a better motherboard and CPU combination that I'm not aware of that can support 4 GPUs (or at least 3) in x8 mode, that would be great and similarly priced second hand.
2. I'm not sure if a 700 watt power supply is good enough. PC Part picker is telling me 585 watts for 3 GTX 1070s

As a side note. I do have an i7-8700 cpu but couldn't find a motherboard with the same level of expandability.

 

[Eximo]

That relies on PLX chips to convince the GPUs they are connected to x16 slots. So you can have many GPUs, but they won't all have full bandwidth. That shouldn't matter too much though.

700W is not really good enough, no. That leaves very little margin for the rest of the system.

I would focus on a single larger graphics card and forgo the plan entirely of multiple 1070. Even two 3060 is a better proposition.

One RTX 3080 would do it, or even less given the performance gains. They can sell for as low as $200, just have to try some bidding.

 

[ZCodeMichael]

That relies on PLX chips to convince the GPUs they are connected to x16 slots. So you can have many GPUs, but they won't all have full bandwidth. That shouldn't matter too much though.

700W is not really good enough, no. That leaves very little margin for the rest of the system.

I would focus on a single larger graphics card and forgo the plan entirely of multiple 1070. Even two 3060 is a better proposition.

One RTX 3080 would do it, or even less given the performance gains. They can sell for as low as $200, just have to try some bidding.

ah I see. I'll try to snipe a good deal on ebay for a large GPU. Do you think the CPU will be enough if, let's say, I get two 3060s? Also, what kind of wattage should I look for in this case? at least 1000w?

 

[Eximo]

Not really. A more recent i3-12100 runs circles around an i7-6700. Even an older i3-10100 would be better.

https://www.cpubenchmark.net/compar...l-i7-6700-vs-Intel-i3-10100-vs-Intel-i3-12100

I don't think the CPU matters too much at all, but I don't see any reason for picking up an old platform with half its lifespan gone.

LGA1700 motherboards brand new are around $90. Quite adequate for a single GPU. And for a little more you can find boards with 2 x16 slots around $100-105

 

[ZCodeMichael]

Not really. A more recent i3-12100 runs circles around an i7-6700. Even an older i3-10100 would be better.

https://www.cpubenchmark.net/compar...l-i7-6700-vs-Intel-i3-10100-vs-Intel-i3-12100

I don't think the CPU matters too much at all, but I don't see any reason for picking up an old platform with half its lifespan gone.

LGA1700 motherboards brand new are around $90. Quite adequate for a single GPU. And for a little more you can find boards with 2 x16 slots around $100-105

that's a good thought. Thanks for the help man!