Nvidia CEO whines Europeans aren’t buying enough GPUs
- Reference: 1729780214
- News link: https://www.theregister.co.uk/2024/10/24/nvidia_gpus_europe/
- Source link:
"The EU has to accelerate the progress in AI," he said, according to [1]Reuters . "There's an awakening in every country realizing that the data is a national resource."
Naturally, Huang believes the vehicle for closing this gap is AI infrastructure, specifically Nvidia GPUs.
[2]
"What country can afford not to have this infrastructure," he said during a fireside chat. "Just as every country realized you need to have communications, transportation, healthcare, fundamental infrastructure, the fundamental infrastructure of any country surely must be the manufacturing of intelligence."
[3]
[4]
During the roughly 30-minute [5]chat , Jensen extolled the potential for generative AI technologies to drive the development of new technologies, particularly in biology and drug discovery — a key focus for Danish pharmaceutical giant Novo Nordisk, which is funding Gefion's deployment.
"The era of computer-aided drug discovery must be within this decade," Huang said in a statement.
[6]
Named after a Danish goddess, the system is based on Nvidia's nearly two-year-old DGX H100 SuperPOD architecture, and is equipped with 191 nodes containing a total of 1,528 H100 GPUs. As conventional supercomputers go, the system is among the top 20 most powerful systems in the world, at least on paper anyway. With peak FP64 performance of 102 petaFLOPS, the system should slot in between the number 14 ranked Perlmutter and Nvidia's own Selene supercomputer in 15th place on the latest Top500 [7]ranking .
However, Gefion is billed as Denmark's "largest sovereign AI supercomputer," which means it is likely to spend a lot more time running at far lower precision. At FP8 the machine boasts roughly 6 exaFLOPS of sparse AI performance, though for training, the system is more likely to use dense 16-bit data types. At that precision the system is still quite powerful claiming 1.5 exaFLOPS of total system performance.
For Denmark, the machine, operated by the Novo Nordisk-backed Danish Center for AI Innovation, will be used to study everything from quantum computing and infectious disease, to climate change and food security.
[8]
For Nvidia, the system appears to be a sales pitch to other European nations about the value of "sovereign AI."
"Having a supercomputer on national soil provides a foundation for countries to use their own infrastructure as they build AI models and applications that reflect their unique culture and language," the GPU giant wrote in a [9]blog post on Wednesday.
[10]41-million-digit prime crunched by datacenter GPUs
[11]Amazon makes $500M bet on itty-bitty nuclear reactors to fuel cloud empire
[12]Uncle Sam reportedly considers capping AI chip shipments to Middle East
[13]AMD targets Nvidia H200 with 256GB MI325X AI chips, zippier MI355X due in H2 2025
Huang's emphasis on Europe comes as Nvidia faces waning prospects in China amid the Middle Kingdom's ongoing trade war with the US.
Nvidia has for years been blocked from selling its most powerful GPUs to China. The outfit has gone to great lengths to [14]subvert US export rules, including developing specialized accelerators designed to limbo under Commerce Department performance caps on multiple occasions.
However, unless those performance caps are indexed, Nvidia's competitiveness in China will eventually erode as domestic alternatives catch up. In fact, the US could enact even stiffer restrictions on the sale of accelerators to the country after it was revealed this week that Huawei had used [15]back channels to manufacture its homegrown accelerators at TSMC in violation of sanctions. ®
Get our [16]Tech Resources
[1] https://www.reuters.com/technology/eu-lags-us-china-ai-investments-nvidia-ceo-says-2024-10-23/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZxpvKHKFsntpXb-3spy6WAAAAME&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZxpvKHKFsntpXb-3spy6WAAAAME&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZxpvKHKFsntpXb-3spy6WAAAAME&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://blogs.nvidia.com/blog/denmark-sovereign-ai-supercomputer/
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZxpvKHKFsntpXb-3spy6WAAAAME&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.top500.org/lists/top500/list/2024/06/
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZxpvKHKFsntpXb-3spy6WAAAAME&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[9] https://blogs.nvidia.com/blog/denmark-sovereign-ai-supercomputer/
[10] https://www.theregister.com/2024/10/23/41_million_digit_prime/
[11] https://www.theregister.com/2024/10/16/amazon_nuclear_smr/
[12] https://www.theregister.com/2024/10/16/us_export_cap_ai_chip_middle_east/
[13] https://www.theregister.com/2024/10/10/amd_mi325x_ai_gpu/
[14] https://www.theregister.com/2023/11/09/nvidia_china_gpu/
[15] https://www.theregister.com/2024/10/22/tsmc_huawei_sanctions_report/
[16] https://whitepapers.theregister.com/
I'd settle for him showing some tangible benefits. There's a Stanford-attributed estimate on the web that total global investments in AI between 2013 and 2022 were around $930 billion, not including any defence AI spend. What a fucking waste.
For about a ninth of that we could have eradicated malaria globally, which kills around 600,000 people each year, and we'd still have say $810 billion to do other genuinely useful stuff.
Could we really eliminate malaria. I'd love to think it's possible, I'm sure scientifically it is, but getting people to work together against it seems a bit far-fetched.
Not a cure, but the new malaria vaccines are going to be a massive benefit to mankind.
https://theconversation.com/two-new-malaria-vaccines-are-being-rolled-out-across-africa-how-they-work-and-what-they-promise-227959
Perhaps the EU is right
Not to waste money on ai. Where is the payback ?
Adding yourself to a. Image (aka Google pixel)
invest more in artificial intelligence if they want to close the gap .....
Why?
Seriously, just let those two entities (US and China) carry on waving their AI Prowess/Knobs in public and let the rest of us sit back without a real worry.
Might save a little money in the process, not spanking it on GPUs or new build power stations!
Is it just me, or...
Something about the phrase "manufactured intelligence" sounds slightly sinister....
They hiked up to prices of GPU's during the price gouging for the scalpers but then never brought the prices back down.
Perhaps he should think about reducing the prices to enable us to buy them!