News: 0176554941

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Jensen Huang: AI Has To Do '100 Times More' Computation Now Than When ChatGPT Was Released

(Thursday February 27, 2025 @05:00AM (BeauHD) from the then-and-now dept.)


In an interview with CNBC's Jon Fortt on Wednesday, Nvidia CEO Jensen Huang said next-gen AI will [1]need 100 times more compute than older models as a result of new reasoning approaches that think "about how best to answer" questions step by step. From a report:

> "The amount of computation necessary to do that reasoning process is 100 times more than what we used to do," Huang told CNBC's Jon Fortt in an interview on Wednesday following the chipmaker's fourth-quarter earnings report. He cited models including DeepSeek's R1, OpenAI's GPT-4 and xAI's Grok 3 as models that use a reasoning process.

>

> Huang pushed back on that idea in the interview on Wednesday, saying DeepSeek popularized reasoning models that will need more chips. "DeepSeek was fantastic," Huang said. "It was fantastic because it open sourced a reasoning model that's absolutely world class." Huang said that company's percentage of revenue in China has fallen by about half due to the export restrictions, adding that there are other competitive pressures in the country, including from Huawei.

>

> Developers will likely search for ways around export controls through software, whether it be for a supercomputer, a personal computer, a phone or a game console, Huang said. "Ultimately, software finds a way," he said. "You ultimately make that software work on whatever system that you're targeting, and you create great software." Huang said that Nvidia's GB200, which is sold in the United States, can generate AI content 60 times faster than the versions of the company's chips that it sells to China under export controls.



[1] https://www.cnbc.com/2025/02/26/nvidia-ceo-huang-says-next-generation-ai-will-need-more-compute.html



Re: Why does it? (Score:2)

by fluffernutter ( 1411889 )

When asked who most deserve the death penalty, grok said Trump and Musk before it was specifically prohibited from giving that answer. So there's that.

Can we have a "No AI promotion day"? (Score:2)

by Mr. Dollar Ton ( 5495648 )

Like, every Thursday /. doesn't post any crap from used car salesman types about "AI"?

Please?

More hardware required... (Score:3)

by Viol8 ( 599362 )

... says man who sells hardware.

Yeah, ok Jensen, whatever you say.

The whole fuss around DeepSeek is it used far LESS hardware resources than current models so god knows where this guy got the 100x extra from other than out of his backside.

Re: More hardware required... (Score:1)

by KnobbyMcKnobface ( 10233038 )

Completely agree with your main point - newsflash - salesman sells. But the deepseek surprise was efficiency of training the models (whether or not it cheated). I think Huang is talking about increases in the separate cost per use.

The more you buy the more you save (Score:2)

by GotNoRice ( 7207988 )

Now go buy 100 times more.

AI (Score:2)

by ledow ( 319597 )

"Throw more processing at it, that'll make it intelligent!"

The cry of every AI researcher since the 60's.

And now we're training it on the entire human Internet, now we're using specifically designed stupendously parallel hardware in datacentre-volumes spread across the globe, now we're pulling huge amounts of global energy, now we're using so much RAM, GPUs and storage just to do so that it's creating hardware shortages, now we're training it for years at a time on the new input of the human race live and i

You have an unusual understanding of the problems of human relationships.