Question modern GPU on older motherboard

[HAROONDINHO]

Hello everyone!
I have an old server from 2013 that has a tesla M40 gpu, im trying to run llms locally on that gpu through ollama but haven't had luck, I know its not officially supported since it has a compute capability of 3.5 but I tried using a modified version of ollama but still it falls back to using CPU.
I have decided to get a newer GPU, I have a budget of around $500 and considering RTX 3060 12 GB but I'm worried that it uses PCIe 4.0 while my motherboard uses PCIe 3.0, would the GPU be significantly throttled? also any other better alternatives for the GPU would be greatly appreciated, I would prefer a new(not second hand) .
Thanks in advance!

 

[COLGeek]

I wouldn't worry too much about the PCIe version aspect. The PCIe standard is backward compatible.

What specific server are you using?

 

[HAROONDINHO]

I wouldn't worry too much about the PCIe version aspect. The PCIe standard is backward compatible.

What specific server are you using?

HP Z820 Workstation, Xeon E5-2667, 64 GB DDR3 RAM, running Arch linux

 

[COLGeek]

The 3060 should work okay in that system and seems to perform relatively well with Ollama (from a cursory search).