Hey everyone.
GPU servers are prohibitively expensive and way beyond my budget. However, I'm eager to achieve the local deployment of the Llama LLM. So, I had to come up with an alternative solution.
I've designed a GPU expansion board with PCIe 4.0. The distance between the 2 slots is a whopping 80mm, which can fit two 3-slot GPUs. Besides that, there are two handles on it
There are 4 SFF-8654 8I interfaces on the PCB board for transmitting PCIE signals, and each interface can provide PCIE x8. The PCB board is powered by an 8-pin GPU power supply interface.
As it won't be marketed, I can reveal the costs: $11 for the GPU steel bracket and around $13.2 for the PCB.
I can easily expand my GPU cards on my shelf. What do you think?
GPU servers are prohibitively expensive and way beyond my budget. However, I'm eager to achieve the local deployment of the Llama LLM. So, I had to come up with an alternative solution.
I've designed a GPU expansion board with PCIe 4.0. The distance between the 2 slots is a whopping 80mm, which can fit two 3-slot GPUs. Besides that, there are two handles on it
There are 4 SFF-8654 8I interfaces on the PCB board for transmitting PCIE signals, and each interface can provide PCIE x8. The PCB board is powered by an 8-pin GPU power supply interface.
As it won't be marketed, I can reveal the costs: $11 for the GPU steel bracket and around $13.2 for the PCB.
I can easily expand my GPU cards on my shelf. What do you think?