Question Graphics card for Stable Diffusion ?

[vegetarian_crocodile]

I have a budget of around $3000.

Apparently, I should be in the market for a used graphics card: https://www.tomshardware.com/news/ltt-second-hand-mining-gpus-are-a-good-buy.

Can someone suggest something to look at for Stable Diffusion? I need not have any display connectors on it.

 

[Eximo]

I think the best bang for your buck is going to be new RTX 4090 rather than picking anything up used. You could look for used 4090, though I don't see why there would be many on the market.

You could get something like 3 or 4 3090 for the money, but then you are going to need a massive PSU and a very high end motherboard. Whereas a decent high power supply and one 4090 will set you back about $2000.

 

[Aeacus]

Nvidia Quadro RTX 6000 Ada generation would be another option. It isn't as power hungry as RTX 4090 is and is far better suited for the Stable Diffusion.
Further reading: https://www.nvidia.com/en-us/design-visualization/rtx-6000/

There are cheaper workstation GPU options as well,
Nvidia Quadro lineup: https://www.nvidia.com/en-us/design-visualization/desktop-graphics/
AMD Radeon Pro lineup: https://www.amd.com/en/graphics/workstations

 

[vegetarian_crocodile]

..Can anyone be so kind as to post any benchmarks or anything like that?

I'm honestly not sure which specs stable diffusion makes the most use of!

Does anyone have any benchmarks so I might be able to compare what, exactly, the difference is between the two lines?

 

[Aeacus]

..Can anyone be so kind as to post any benchmarks or anything like that?

Workstation GPUs are rare sight on benchmark sites, since most of the times, as soon as they are bought, are put into use, crunching numbers. Quadro/Radeon Pro rarely sits idling by, where there would be free time to benchmark it.

So, what little info can be found, are from news articles;
link 1: https://wccftech.com/nvidia-rtx-600...ked-3dmark-72-percent-faster-vs-a6000-ampere/
link 2: https://www.servethehome.com/nvidia-rtx-6000-ada-specs/

or reviews. Do note that the review is Quadro RTX 6000 (Turing) and not of a Quadro RTX 6000 Ada (Ada Lovelace),
link: https://www.servethehome.com/nvidia-quadro-rtx-6000-gpu-review/

But if you want GPU without display ports, then you need to look towards server GPUs, like Nvidia L40,
article: https://www.servethehome.com/nvidia-l40-omniverse-gpu-launched-gtc-2022/

Radeon Pro W6800 review,
link: https://develop3d.com/hardware/amd-radeon-pro-w6800-review/

 

[Eximo]

Best I could determine was that stable diffusion relies on CUDA processing or the Tensor cores founds in RTX GPUs. Newest GPUs have the most of both.

Late model workstation cards are basically your whole budget (and then some), if you can even find them. I did a quick shop around and couldn't even find some of them, likely a case of needing to find a direct supplier, and they might not let you buy just one.