News Alleged Apple M4 Geekbench scores show incremental improvement in machine learning over last gen

Apple's M3 was rated for 18 TOPS at FP16 precision, but the M4 is rated for 38 TOPS with INT4. That means, if equalized to INT8 precision, we're looking at a 5% improvement in TOPS for the M4 over the M3.

Not entirely sure if that info is 100% correct. 38 TOPS with INT4 ? Got proof ?

First off, Apple has NOT confirmed nor listed the exact precision info, as to whether the value is based on INT16, INT8, or even INT4 precision.

But for ML inference, INT8 would be the most likely option/candidate, since this is what Apple quoted for the A17 chip last year.

So the 5% improvement claim would also not be accurate.
 
Last edited by a moderator:
Not entirely sure if that info is 100% correct. 38 TOPS with INT4 ? Got proof ?

First off, Apple has NOT confirmed nor listed the exact precision info, as to whether the value is based on INT16, INT8, or even INT4 precision.

But for ML inference, INT8 would be the most likely option/candidate, since this is what Apple quoted for the A17 chip last year.
Ooops, you are correct. Apple has confirmed to analysts that it is INT8. fixed the typo.

View: https://twitter.com/BenBajarin/status/1787861586285298111
 
Last edited:
Btw, now based on the 38 Tops INT8 metric the claimed performance should be much more than the 5% value the original article claimed ? Right?

Or something else entirely?