On the current Sizzling Chips assembly, Intel revealed technical specs and options for the next-generation Xeon structure arriving in 2024. Whereas the subsequent era is usually used to explain new merchandise, it additionally implies the evolution of previous or present merchandise.
Within the case of the Xeon, the time period is perhaps “divergent” era Xeons. The brand new Sierra Forest (SRF) and Granite Rapids (GNR) symbolize a special strategy to Xeon processors than we’ve got seen up to now.
Manufacturing CPUs (or GPUs) is dear. As an finish person, you may even see a large number of desktop processors and a complete bunch of various Xeon choices. This vary of choices doesn’t imply every processor is uniquely manufactured. There’s a distinction between desktop and server processors, however inside every class, the essential concept is to design and construct a brand new era monolithic processor and “adapt” it to the varied product traces. As an illustration, processor options might be “fused off” and turned off in manufacturing. There’s additionally a “binning” course of the place processors are sorted by most frequency or temperature. Normally, the economics of processor manufacturing invitations a “one dimension suits all” strategy. The grasp processor is “adjusted” for the varied SKU choices.
This methodology has modified as a result of CPUs have gotten “disaggregated” and has been tailored by AMD for each desktop and server processors. As an alternative of 1 massive silicon die, the processor is damaged down into separate “chiplets.” Whereas this does complicate the manufacturing, the benefit is a greater yield attributable to small chiplets and the power to combine and match the performance on the processor substrate.
Intel has used the chiplet design within the subsequent (divergent) era of Xeons. Intel calls this strategy “modular system-on-chips (SoCs).” The Sierra Forest and Granite Rapids CPUs are very completely different processors, but socket-compatiblearriving throughout the similar launch cadence.
One other vital facet of those new processors is improved energy effectivity. Intel expects Sierra Forest to have a 240% higher efficiency per watt than its present era. The environment friendly enhancements are largely as a result of success of the Intel 3nm course of node. As said within the Intel 2Q of 2023 incomes name.
Intel 3 met defect density and efficiency milestones for Q2, launched PDK1.1, and is on observe for general yield and efficiency targets. We’ll launch Sierra Forest (SRF) in 1H’24 with Granite Rapids (GNR), following shortly thereafter, our lead automobiles for Intel 3.
Selected Effectivity or Efficiency
Intel has made two varieties of cores obtainable within the next-generation Xeon. The E-core (E for effectivity) is a power-optimized model for cloud/internet purposes, and the P-core (P for efficiency core) is designed for heavier technical computing (e.g., HPC and AI). Determine One offers an outline of the 2 varieties.

Each cores share many design components and are suitable with all firmware and OS software program stacks. They assist the quickest DDR and new high-bandwidth multiplexed mixed rank (MCR) DIMMs. As well as, the most recent Intel Flat Reminiscence allows hardware-managed information motion between DDR5 and CXL reminiscence, making whole capability seen to software program. Lastly, each CPUs assist CXL 2.0 (backward compatibility to CXL 1.1), superior I/O with as much as 136 PCIe 5.0/CXL 2.0 lanes, and as much as six UPI hyperlinks.
The Environment friendly Sierra Forest

Sierra Forest consists of E-cores. Determine Two reveals that it’s designed for the Common Objective high-density sale out workload. Xeon processors with E-cores are enhanced to ship density-optimized compute in probably the most power-efficient method. Xeon processors with E-cores present favorable power-performance density, providing benefits for cloud-native and hyperscale workloads. Sierra Forest is anticipated to have the next options.
- Offers a 2.5x higher rack density and a pair of.4x increased efficiency per watt (Projected efficiency relative to 4th Gen Intel Xeons).
- Assist for 1-socket and 2-socket servers, with as much as 144 cores per CPU and TDP as little as 200 Watts.
- Affords a contemporary instruction set with strong safety, virtualization and AVX with AI extensions.
- Foundational reminiscence RAS options equivalent to machine verify information cache ECC commonplace in all Xeon CPUs.
The Performant Granite Rapids

Determine Three reveals that Granite Rapids with P-cores are optimized to ship the bottom whole price of possession (TCO) for high-core performance-sensitive workloads and general-purpose compute workloads. In keeping with Intel, Xeon processors present higher AI efficiency than some other CPU. (see Intel Efficiency Index) Granite Rapids is anticipated to boost the present stage of AI efficiency. Constructed-in accelerators can be found to provide a further enhance to focused workloads for even better efficiency and effectivity.
- Offers a 2-3x higher efficiency for blended AI workloads (Based mostly on projected efficiency relative to 4th Gen Intel Xeons).
- Affords enhanced Intel AMX with assist for brand spanking new FP16 directions.
- Offers increased reminiscence bandwidth, core rely, and cache for compute-intensive workloads.
- Socket scalability from one socket to eight sockets.
The Selection is Yours
This evolution (or divergence) ought to bode properly for HPC. On condition that the P-cores are optimized for technical computing (floating level), Granite Rapids is an entire number-crunching processor with out making design concessions for internet and cloud markets. In the identical method, Sierra Forrest can de-burden itself with the extraneous number-crunching {hardware}. Relating to availability, Intel states that Sierra Forest can be obtainable within the first half of 2024, with Granite Rapids to observe quickly after (let’s assume it’s prepared for SC24 in Atlanta). Within the meantime, anticipate extra particulars to be forthcoming, together with vendor benchmarks.
Academia & Analysis, Power, Leisure, Monetary Companies, Authorities, Life Sciences, Manufacturing, Oil & Fuel, Retail, semiconductor, Area & Physics