Intel launches Xeon 6 processors and Gaudi 3 AI accelerators

In addition to the P-cores, Intel has added AI inference capabilities to the Xeon 6900P lineup to bring AI coprocessors to CPUs. AMD is doing the same thing. The belief is that inferencing has a much lower power demand and therefore can be done on a client PC rather than require server processors like GPUs.

The stats for the Xeon 6900P chips are impressive. Compared to the previous Xeon generation, the maximum core count is doubled to 128 cores by using a chiplet design. So instead of one large piece of silicon, the processor is broken up into three easier-to-manufacture pieces.

The Xeon 6 is the first processor to support new MRDIMM modules from Micron, which improve bandwidth and latency performance. In the case of Xeon 6900P, memory improves by up to 57% to 8,800 MT/s.