So, 6000mhz is the best choice per AMD for Ryzen 7000, but Corsair gives a max of 5600mhz? Nope. Nope. Nope.
G.Skill has DDR5-6000. I have DDR4 G.Skill in one system (Samsung B-die) and Corsair in another and the Corsair compares very poorly if you enjoy tweaking timings. Looks good, too bad iCue is a pretty terrible program.
On the bright side, you don't have to worry about ram, for the life of the system.
- Modern enough CPU
- NVIDIA graphics card
- 64 or better 128 Gb of RAM (192 or 256 would be perfect)
One may run with 32 Gb of RAM, but inference will be slow (with the speed of your swap file reading)
I am running this on 12700k/128 Gb RAM/NVIDIA 3070ti 8Gb/fast huge nvme and getting one token from 30B model in a few seconds.
For example, 30B model uses around 70 Gb of RAM. 7B model fits into 18 Gb. 13B model uses 48 Gb.