Two years in the past Cloudflare rolled out their “Gen 11” server fleet constructed round AMD EPYC Milan processors and on Friday the corporate started speaking about their forthcoming “Gen 12” server designs that may quickly be rolling out throughout their knowledge facilities for powering this widely-used internet infrastructure.
Cloudflare’s weblog is usually residence to a variety of attention-grabbing technical perception from this main internet firm. Whereas Cloudflare has lengthy leveraged 1U server designs, with their Gen12 servers they’re shifting to a 2U design because of the elevated energy/thermal necessities of the latest-generation server processors from AMD and Intel.
Cloudflare hasn’t but publicly stated whether or not they’re utilizing 4th Gen Intel Xeon Scalable or AMD Zen 4 (Genoa/Genoa-X or Bergamo), however in Friday’s weblog publish they famous that with their Cloudflare companies they’ve famous scaling as much as 128 cores / 256 threads. In addition they famous a CPU TDP candy spot at round 340 Watts. With scaling as much as 128 cores / 256 threads, it would not be in any respect stunning in the event that they went with an AMD EPYC “Bergamo” design that options 128 cores / 256 threads right now with the likes of the EPYC 9754.
Cloudflare reveals off their Gen 12 server design.
Because of the increased CPU TDPs, they discovered profit going from 1U to 2U kind issue as of their racks they’ve extra space obtainable than racks. In going for a 2U structure with their Gen 12 servers they’re shifting to bigger followers, bigger heatsinks to assist in warmth dissipation, and having fun with much less air impedance, and room for extra PCIe-attached accelerators / GPUs / add-on playing cards.
They additional famous of their weblog publish on their 2U advantages:
Thermal simulations supplied by Cloudflare distributors confirmed that 4x 60mm followers or 4x 80mm followers at lower than 40 Watt per fan is adequate to chill the system. That may be a theoretical financial savings of a minimum of 150 Watt in comparison with 8x 40mm followers in a 1U design, which might lead to vital Operational Expenditure (OPEX) financial savings and a lift to TCO enchancment. Switching to a 2U kind issue additionally provides us the good thing about absolutely using our rack energy finances and our rack house, and gives ample room for the addition of PCIe connected accelerators / GPUs, together with dual-slot kind issue choices.
…
It might sound counter-intuitive, however our observations point out that rising the server chassis, and using extra space per node really will increase rack density and improves total TCO profit over earlier technology deployments, because it permits for a greater thermal design. We’re very proud of the results of this technical readiness investigation, and are actively engaged on validating our Gen 12 Compute servers and launching them into manufacturing quickly.
Will probably be attention-grabbing to see in the end how they spec’ed out their Gen 12 servers and different technical particulars to be printed quickly. Not less than from the main points printed up to now, it is seemingly they went for AMD’s Bergamo whereas their follow-up posts ought to shed higher element.
