News AWS Uses Intel's Habana Gaudi for Large Language Models

[Admin]

AWS uses PyTorch with DeepSpeed to train large language models with Intel Habana Gaudi-based DL1 EC2 instances.

AWS Uses Intel's Habana Gaudi for Large Language Models : Read more

 

[bit_user]

Why does the article URL say "aws-uses-intel-habana-gaudi-for-llvm" ? LLVM (Low Level Virtual Machine) is something completely different.

https://en.wikipedia.org/wiki/LLVM
​

As for the article, it'd be ideal if it had some stats on how Nvidia A100's or H100's perform on the same workload. However, it's definitely cool to hear about Gaudi in the wild. Virtually all I've heard about it, since Intel bought them, is about their kernel patches and driver work.

Makes me wonder how AMD's MI250X is getting on...