AMD, Xilinx Claim World Record for Machine Learning Inference

[Lucian Armasu]

AMD and Xilinx put Intel and Nvidia on notice with a new data center system that beat the world record for machine learning inference.

AMD, Xilinx Claim World Record for Machine Learning Inference : Read more

 

[redgarl]

SHould look into xilinx stock.

 

[bit_user]

The focus here seems to be “real-time” inference because the Alveo cards promise three times lower latency than GPUs with four times the throughput for low-latency applications.

The original blog post specifies a batch size of 1. This caught my attention, as it's not usually necessary to use such a small batch size. I have to wonder if their performance lead quickly evaporates, as batch size goes up.