Hi all.
I have a desktop running a small LLM via a Home Assistant add-on (Oobabooga), and I've hit the ceiling on the model size I can "effectively" use.
Currently I have a Ryzen 5 3600 and 16GB of RAM, on a Lenovo "special" motherboard. I will need to change out the motherboard.
The idea is to get a new motherboard and use server RAM since I can get it cheap. For this I was considering 32GB 2Rx4 PC4-2666V DDR4 ECC MTA36ASF4G72PZ-2G6E1SI sticks, and 4 of them, for a total of 128GB RAM.
After extensive googling I am still not able to definitively tell if this is possible with the CPU I have. I don't need the ECC function, I just need the capacity. I was considering the MSI B550M PRO-VDH WIFI motherboard, again due to it being cost-friendly.
Any insight is very welcome.
I have a desktop running a small LLM via a Home Assistant add-on (Oobabooga), and I've hit the ceiling on the model size I can "effectively" use.
Currently I have a Ryzen 5 3600 and 16GB of RAM, on a Lenovo "special" motherboard. I will need to change out the motherboard.
The idea is to get a new motherboard and use server RAM since I can get it cheap. For this I was considering 32GB 2Rx4 PC4-2666V DDR4 ECC MTA36ASF4G72PZ-2G6E1SI sticks, and 4 of them, for a total of 128GB RAM.
After extensive googling I am still not able to definitively tell if this is possible with the CPU I have. I don't need the ECC function, I just need the capacity. I was considering the MSI B550M PRO-VDH WIFI motherboard, again due to it being cost-friendly.
Any insight is very welcome.