Nvidia Tech Radically Improves AI Inferencing Efficiency

[kcarbotte]

Nvidia revealed the third generation of its TensorRT AI inferencing software, the DeepStream video analytics platform, and the ninth generation of Nvidia’s CUDA technology.

Nvidia Tech Radically Improves AI Inferencing Efficiency : Read more

 

[bit_user]

I think these numbers are pretty much in line with what they already said about the V100. The big announcement is mostly just the SDK support for it.

It will be interesting to know how much of the V100's capabilities are shared by the smaller Volta GPUs. I think it's safe to assume they won't have its tensor product engine.

Edit: okay, TensorRT's network optimization features are interesting. I didn't know it had those.