The Massive AI Performance Benefit With AMX On Intel Xeon 6 "Granite Rapids"

Besides the support for MRDIMM-8800 memory, another distinct advantage of Intel Xeon 6 "Granite Rapids" processors is the continued presence of Advanced Matrix Extensions (AMX). Here are some fresh benchmarks looking at the impact of AMX on the Intel Xeon 6980P processors for AI inference workloads.