Omdia is part of Informa TechTarget

This website is owned and operated by Informa TechTarget, part of a global network that informs, influences and connects the world’s technology buyers and sellers. All copyright resides with them. Informa PLC’s registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. TechTarget, Inc.’s registered office is 275 Grove St. Newton, MA 02466.

header banner coverage

Omdia: In-CPU AI acceleration, the must-have feature of 2022, is turning out to be a disappointment

Aug 6, 2024

CPU AdobeStock_265255384

LONDON, August 6, 2024: In 2021-2022, CPU vendors raced to get additional AI acceleration built into their instruction sets. Intel, Arm, and AMD all announced the feature was coming. Now, though, only a subset of Intel’s Xeon 6 chips have it, as well as a relatively small number of smartphones. An Omdia research note, Have in-CPU AI accelerators bombed? investigates why.

 

Omdia’s Principal Analyst for Advanced Computing, Alexander Harrowell said: “There are reasons to think volumes of Intel’s Sapphire Rapids and Emerald Rapids chips with the AMX AI extension were disappointing. Meanwhile, none of the major Arm-based server CPU projects have chosen to use the equivalent extension, and AMD eventually didn’t go ahead with theirs.”

 

“Results from the MLPerf Inference benchmarking project suggest that adding middle-weight GPUs offers much more performance per dollar than deploying CPUs with in-CPU acceleration. There are special cases where in-CPU extensions help – for example, if it’s a priority to keep the number of cores down because of per-core software licenses – but otherwise it looks like a better deal to either use GPUs or select based on factors such as instruction width and core density.”

More from our experts View All
Let's Connect
register Banner

Register here for full complimentary research reports and content.

Get ahead in your business and receive industry insider news, findings and trends from Omdia analysts.

Register