Cloudflare's always-interesting technical blog laid out their details today concerning their next-gen "12th Generation" in-house servers that will be powering their vast web infrastructure. With these next-gen Cloudflare servers they are going with AMD EPYC 9684X Genoa-X processors.

Cloudflare's current-gen servers are 1U designs powered by AMD EPYC 7713 "Milan" processors while their Gen 12 server has upgraded to the AMD [1]EPYC 9684X Genoa-X processors. It's a great upgrade with now having 3D V-Cache, native AVX-512 support will help their AI/ML workloads and more, great PCI Express connectivity, etc. The AMD EPYC 9684X performance remains very strong with competitive power efficiency even more than one year after launch.

[2]

The Cloudflare Gen 12 Compute platform is using 384GB of DDR5-4800 memory across 12 memory channels, Samsung NVMe SSD storage, dual 25 Gbe Ethernet, and an 800 Watt power supply. With this generation they've also [3]switched the server design from 1U to 2U for helping with cooling and other factors.

Cloudflare was deciding between the EPYC 9654, EPYC 9754, and EPYC 9684X processors for their next-gen server and ultimately went for the 3D V-Cache Genoa variant for the best performance.

Cloudflare noted in today's blog post they are already testing 5th Gen EPYC "Turin" servers as part of their planning and design discussion for their next-generation (Gen 13) server platform.

Those curious about Cloudflare's Genoa-X server design choices for powering their compute infrastructure can learn all the interesting technical details over on the [4]Cloudflare blog .



[1] https://www.phoronix.com/search/EPYC+9684X

[2] https://www.phoronix.com/image-viewer.php?id=2024&image=cloudflare_genoa_x_lrg

[3] https://www.phoronix.com/news/Cloudflare-Gen12-Server

[4] https://blog.cloudflare.com/gen-12-servers/