Discussion I made a GPU expansion board to sort out the problems related to Llama3.0

NOR1NCO

Prominent
Jan 10, 2023
18
4
515
Hey everyone.

GPU servers are prohibitively expensive and way beyond my budget. However, I'm eager to achieve the local deployment of the Llama LLM. So, I had to come up with an alternative solution.

I've designed a GPU expansion board with PCIe 4.0. The distance between the 2 slots is a whopping 80mm, which can fit two 3-slot GPUs. Besides that, there are two handles on it

There are 4 SFF-8654 8I interfaces on the PCB board for transmitting PCIE signals, and each interface can provide PCIE x8. The PCB board is powered by an 8-pin GPU power supply interface.

As it won't be marketed, I can reveal the costs: $11 for the GPU steel bracket and around $13.2 for the PCB.

I can easily expand my GPU cards on my shelf. What do you think?




6741340ad29ded1a8c7d36de.jpg


6741340bd29ded1a8c7d371f.jpg


6741340bd29ded1a8c7d3764.jpg



6741340cd29ded1a8c7d388a.jpg

6741340bd29ded1a8c7d3817.jpg