Infineon promises 12kW PSUs for next generation of power-hungry AI servers
(2024/05/28)
- Reference: 1716924605
- News link: https://www.theregister.co.uk/2024/05/28/infineon_psu_ai/
- Source link:
Not long ago an entire rack of systems might consume 10kW or less of power. Today, that's barely enough to run a single GPU server, and those systems are only expected to get hotter and greedier for power amid the AI boom.
To keep those GPUs adequately fed, Infineon is [1]developing new, high-efficiency power supply units (PSUs) capable of delivering up to 12kW of energy to the system, up from around 3.3kW today.
To do this, Infineon says it's using a combination of silicon, silicon-carbide, and gallium-nitride technology. You may recognize gallium nitride, or GaN, as the material that's helped to shrink consumer chargers in recent years.
[2]
Silicon-carbide (SiC) on the other hand, has gained widespread attention amid the proliferation of electric vehicles. Generally speaking, SiC is [3]more efficient at higher voltages, making it a prime choice for the traction and DC-to-DC inverters commonly found in EVs. However, as Infineon notes, that technology also makes sense in high-wattage PSUs needed to fuel hotter and hotter GPUs and AI accelerators.
[4]
[5]
The German giant says its next-gen PSUs will be capable of achieving 97.5 percent efficiency, when they start shipping early next year. Infineon contends these will help to drive down carbon emissions and power losses.
The first of these PSUs will be an 8kW unit that Infineon says will be able to support AI racks up to 300kW or more. Meanwhile, its 12kW power supplies are set to follow sometime later.
[6]CEO of UK's National Grid warns of datacenters' thirst for power
[7]We polled thousands of IT pros – and sustainability just ain't a priority right now
[8]Microsoft's carbon emissions up nearly 30% thanks to AI
[9]Nvidia PUE-PUEs datacenter efficiency ratings, calls for application-specific metrics
The power demands of modern AI systems have proven to be quite the headache for datacenter operators. For instance, as The Next Platform previously [10]reported , Digital Realty has faced challenges with power as it worked to support larger deployments of Nvidia's DGX platform, which packs four 10.2kW servers into a single rack.
But while eight and even 12kW power supplies will no doubt simplify designs by reducing the number of PSUs required, power is likely to remain an ongoing challenge. As Schneider Electric wrote in a [11]report last summer, PSUs aren't the only limiting factor, we're also going to need beefier power distribution units (PDU).
[12]
According to Schneider, at 120/208 volts it would require five 60 amp circuits to power an 80kW rack with single failure redundancy. This, they note, poses a variety of challenges and could impede airflow. Because of this, they recommended switching to 240/415 volt PDUs, and even at these voltages, Schneider warned this may not be enough.
But even if you can sort out rack power delivery, that doesn't do you much good if your local utility isn't up to the task. Amazon is [13]reportedly rationing resources at its Dublin datacenters due to power constraints, a factor that previously led Microsoft to [14]build a 170 megawatt gas plant to even out disruptions to the grid.
Meanwhile, in the UK, National Grid CEO John Pettigrew [15]warned in March that datacenter power consumption could rise by as much as 500 percent over the next decade and would require major infrastructure improvements to support that growth. ®
Get our [16]Tech Resources
[1] https://www.infineon.com/cms/en/about-infineon/press/press-releases/2024/INFPSS202405-105.html
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZlZUAeXUke1LxC6MDK4XiwAAAME&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://www.theregister.com/2023/08/01/onsemi_silicon_caribide_demand/
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZlZUAeXUke1LxC6MDK4XiwAAAME&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZlZUAeXUke1LxC6MDK4XiwAAAME&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2024/03/27/ceo_of_uks_national_grid/
[7] https://www.theregister.com/2024/05/28/register_it_sustainability/
[8] https://www.theregister.com/2024/05/16/microsoft_co2_emissions/
[9] https://www.theregister.com/2024/05/14/nvidia_pue_datacenter/
[10] https://www.nextplatform.com/2023/07/31/where-to-park-your-ai-cluster-is-as-important-as-procuring-it/
[11] https://www.theregister.com/2023/09/19/schneider_electric_ai_dc/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZlZUAeXUke1LxC6MDK4XiwAAAME&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[13] https://www.theregister.com/2024/04/09/aws_resource_restrictions/
[14] https://www.theregister.com/2023/07/22/microsoft_power_plant/
[15] https://www.theregister.com/2024/03/27/ceo_of_uks_national_grid/
[16] https://whitepapers.theregister.com/
To keep those GPUs adequately fed, Infineon is [1]developing new, high-efficiency power supply units (PSUs) capable of delivering up to 12kW of energy to the system, up from around 3.3kW today.
To do this, Infineon says it's using a combination of silicon, silicon-carbide, and gallium-nitride technology. You may recognize gallium nitride, or GaN, as the material that's helped to shrink consumer chargers in recent years.
[2]
Silicon-carbide (SiC) on the other hand, has gained widespread attention amid the proliferation of electric vehicles. Generally speaking, SiC is [3]more efficient at higher voltages, making it a prime choice for the traction and DC-to-DC inverters commonly found in EVs. However, as Infineon notes, that technology also makes sense in high-wattage PSUs needed to fuel hotter and hotter GPUs and AI accelerators.
[4]
[5]
The German giant says its next-gen PSUs will be capable of achieving 97.5 percent efficiency, when they start shipping early next year. Infineon contends these will help to drive down carbon emissions and power losses.
The first of these PSUs will be an 8kW unit that Infineon says will be able to support AI racks up to 300kW or more. Meanwhile, its 12kW power supplies are set to follow sometime later.
[6]CEO of UK's National Grid warns of datacenters' thirst for power
[7]We polled thousands of IT pros – and sustainability just ain't a priority right now
[8]Microsoft's carbon emissions up nearly 30% thanks to AI
[9]Nvidia PUE-PUEs datacenter efficiency ratings, calls for application-specific metrics
The power demands of modern AI systems have proven to be quite the headache for datacenter operators. For instance, as The Next Platform previously [10]reported , Digital Realty has faced challenges with power as it worked to support larger deployments of Nvidia's DGX platform, which packs four 10.2kW servers into a single rack.
But while eight and even 12kW power supplies will no doubt simplify designs by reducing the number of PSUs required, power is likely to remain an ongoing challenge. As Schneider Electric wrote in a [11]report last summer, PSUs aren't the only limiting factor, we're also going to need beefier power distribution units (PDU).
[12]
According to Schneider, at 120/208 volts it would require five 60 amp circuits to power an 80kW rack with single failure redundancy. This, they note, poses a variety of challenges and could impede airflow. Because of this, they recommended switching to 240/415 volt PDUs, and even at these voltages, Schneider warned this may not be enough.
But even if you can sort out rack power delivery, that doesn't do you much good if your local utility isn't up to the task. Amazon is [13]reportedly rationing resources at its Dublin datacenters due to power constraints, a factor that previously led Microsoft to [14]build a 170 megawatt gas plant to even out disruptions to the grid.
Meanwhile, in the UK, National Grid CEO John Pettigrew [15]warned in March that datacenter power consumption could rise by as much as 500 percent over the next decade and would require major infrastructure improvements to support that growth. ®
Get our [16]Tech Resources
[1] https://www.infineon.com/cms/en/about-infineon/press/press-releases/2024/INFPSS202405-105.html
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZlZUAeXUke1LxC6MDK4XiwAAAME&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://www.theregister.com/2023/08/01/onsemi_silicon_caribide_demand/
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZlZUAeXUke1LxC6MDK4XiwAAAME&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZlZUAeXUke1LxC6MDK4XiwAAAME&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2024/03/27/ceo_of_uks_national_grid/
[7] https://www.theregister.com/2024/05/28/register_it_sustainability/
[8] https://www.theregister.com/2024/05/16/microsoft_co2_emissions/
[9] https://www.theregister.com/2024/05/14/nvidia_pue_datacenter/
[10] https://www.nextplatform.com/2023/07/31/where-to-park-your-ai-cluster-is-as-important-as-procuring-it/
[11] https://www.theregister.com/2023/09/19/schneider_electric_ai_dc/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZlZUAeXUke1LxC6MDK4XiwAAAME&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[13] https://www.theregister.com/2024/04/09/aws_resource_restrictions/
[14] https://www.theregister.com/2023/07/22/microsoft_power_plant/
[15] https://www.theregister.com/2024/03/27/ceo_of_uks_national_grid/
[16] https://whitepapers.theregister.com/
Anonymous Coward
Perhaps a tax on all energy use that cannot be demonstrated to objectively be for the greater good? It would be quite modest for the home user but very painful for the techbros.
The sooner this 'AI' bubble bursts the better, and dumps the ~80% of cryptocurrency-esk wastefulness of proposed inane use cases.