News Miner Pivots 38,000 GPUs From Crypto to AI

Mining rigs are okay for some kinds of simple inference jobs. Particularly video processing, where you can stream compressed video to the GPU and both decompress + process it in-place. I expected mining companies would quickly pivot to exploit such opportunities, in the wake of the crypto crash.

They're absolutely horrible for LLMs, and training in general. For that, you need lots of main memory capacity and inter-GPU bandwidth, which is exactly what they don't have.
 
So fortunate that NVIDIA has a product line that was able to senselessly pivot away from the crypto dumpster fire and can now be employed for...ahem....AI !
 
Would you really want to buy a used GPU that's been sitting on a mining motherboard operating for 24 hours a day?
That's a qualified "yes":
  • Seller must be reputable.
  • Must include a reasonable warranty (30 days minimum, 90 days preferable).
  • Fans should've been replaced or otherwise checked not to make excessive noise. Even better: heatsink was reinstalled with fresh TIM of good quality.
  • Price must be below the market rate, for used cards of that model.

People have tested used mining GPUs and enough of them work well enough that they shouldn't be automatically regarded as trash.
 
  • Like
Reactions: TJ Hooker