In an AI server the CPU rarely gets the headlines, yet it decides how many GPUs and NICs a node can feed, how fast data is decoded and tokenized, how much memory bandwidth is available to offload and preprocessing, and whether small-model or batch inference can run without a GPU at all. This course gives engineers a working model of the modern server CPU: core microarchitecture, chiplet and tile packaging, cache hierarchy, NUMA, memory channels and PCIe and CXL lanes, and how each of those shows up in AI workloads.
The middle of the course covers the instruction-set features that matter for AI on CPUs, including AVX-512, AVX10, AMX with BF16 and FP16 tiles, and Arm SVE2 and SME, and how libraries such as oneDNN, ZenDNN, Arm Compute Library and llama.cpp use them. It then surveys the platforms current in October 2026: Intel Xeon 6 P-core and E-core and Xeon 6+ (Clearwater Forest), AMD EPYC 9005 (Turin) and the Zen 6 EPYC 9006 (Venice), NVIDIA Grace and the Vera CPU in Vera Rubin systems, and cloud Arm CPUs such as AWS Graviton4 and Graviton5, Google Axion and Microsoft Cobalt. It closes with selection and tuning: lanes-per-GPU arithmetic, NUMA pinning, BIOS and power settings, and a worked host-CPU sizing exercise. Vendor figures are stated as of October 2026 and marked as vendor claims where independent results are not yet available. The course ends with an automated exam and a Wirewalk Institute certificate of completion and assessment; it is not a vendor certification.