At SC23, we noticed quite a lot of next-gen AMD methods. Whereas we all know HPE-Cray and AMD are putting in El Capitan a 2 Exaflop Supercomputer, we additionally received information this week that Microsoft was deploying massive numbers of AMD’s MI300X GPUs. We thought of us could wish to see the brand new high-end GPUs and APUs, so we snapped a number of pictures.
AMD MI300 Recap
For many who want a fast refresher, the AMD Intuition MI300 household is a modular constructing block structure the place AMD combines GPU, CPU, HBM, and extra right into a 3D stacked bundle. AMD can range the GPU and CPU tiles to attain various kinds of configurations. Since AI is promoting like hotcakes proper now, the 2 hottest configurations we’re more likely to hear about within the close to future are the MI300A which is one-quarter CPU and three-quarters GPU, and the MI300X which is all GPU.
At SC23, we noticed each.
AMD Intuition MI300A at SC23
First is the AMD Intuition MI300A. This can be a massive APU that we grabbed a photograph of in June, however for some cause the scale didn’t register.
We noticed the APU on the present flooring within the Gigabyte G383-R80. One can see that this can be a socketed processor.
The socket appears very acquainted though it’s labeled “SH5”.
Overlook the DDR5 for a second. The AMD MI300A’s SH5 socket is similar to the SP5 socket for Genoa, Genoa-X, and Bergamo.
Certainly, these even use the identical model of provider that we see in AMD’s mainstream server CPUs at the moment.
The provider is gray very like the AMD EPYC Milan-X.
Our Genoa-X samples had orange carriers like Genoa (inexperienced is Bergamo.) Maybe gray is AMD’s colour for its high-end HPC CPUs?
These have been put in into the LGA6096 sockets in a Gigabyte G383-R80. One could recall that socket SP5 for the AMD EPYC Genoa, Genoa-X, and Bergamo is a LGA6096 design as properly. 4 of those sockets have been on the motherboard.
What we’re most concerned about getting extra particulars on is the CXL assist. These chips wouldn’t have DIMM slots and are as a substitute utilizing onboard HBM for reminiscence wants, very like the Intel Xeon MAX 9480, besides with extra capability and as principally accelerator. The chips have a number of PCIe Gen5 interfaces. Earlier than AMD’s June 2023 information heart occasion, we heard of us concerned about reminiscence enlargement by way of Kind-3 CXL units to get extra reminiscence capability. AMD has nonetheless not stated whether or not this can be a supported function.
AMD additionally had the MI300X at SC23, so allow us to get to that subsequent.
