News TinyBox AI accelerator now available starting at $15k, available in AMD 7900XTX and Nvidia RTX 4090 variants

[Admin]

The TinyBox AI accelerators feature either six 7900XTX or RTX 4090 GPUs and could deliver at least 738 FP16 TFLOPS of computing performance.

TinyBox AI accelerator now available starting at $15k, available in AMD 7900XTX and Nvidia RTX 4090 variants : Read more

 

[vanadiel007]

Hopefully this will not take off well, because otherwise we will have another shortage of consumer GPU's.

 

[derekullo]

Hopefully this will not take off well, because otherwise we will have another shortage of consumer GPU's.

A 4090 is barely a consumer gpu lol.

 

[bit_user]

A 4090 is barely a consumer gpu lol.

One thing is fab capacity and GDDR supply. Nvidia recently had to downgrade some of their GPUs from GDDR6X to regular GDDR6, due to shortages of the former.

Another thing is that people using consumer GPUs for AI training will just move on to the next generation of consumer GPUs, when they launch. That could push up prices and shift demand down the product stack, resulting in higher prices even on lower-end models.

I'm not saying any of this will happen, but I think they're not impossible outcomes. Then again, people have been doing multi-GPU training with Nvidia consumer GPUs for like a decade, so this isn't really anything terribly new or novel (apart from any clever algorithms Tiny might've devised).

 

[NinoPino]

Hopefully this will not take off well, because otherwise we will have another shortage of consumer GPU's.

By price and power usage those GPUs cannot be defined consumer.

 

[derekullo]

By price and power usage those GPUs cannot be defined consumer.

If anything a Geforce 4090 would be a prosumer gpu.

 

[Amdlova]

16k = pain
25k = great. Everything works...

I can't decide what is right

 

[Samlebon2306]

Very expensive dehumidifier.

 

[DS426]

By price and power usage those GPUs cannot be defined consumer.

Ok but that's not how consumer-class products work. It's also about support levels and some other assurances.

Also, the price class of the 7900 XTX is completely different than the 4090 being that, based on actual market prices, the 4090 really is out on it's own at a cost of more than 50% higher than the 7900 XTX. Sure, they're both "prosumer" class products, but that still falls in the consumer category and not professional or datacenter.

We're kind of arguing semantics here but the basics remains the same: you're getting one of the most affordable AI training servers for the performance given. Thankfully, there are alternatives to nVidia's AI strangehold, which the pricing really reflects. Now that clever folks will be tinkering with the AMD models and the both ends are working to improve driver quality, it seems to me that both options are very compelling, albeit for somewhat different reasons (price-perf vs. all-out performance and "it just works").