News: 1717554607

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

The definition of an AI PC is now even muddier, helping no-one – not even AIs

(2024/06/05)


Computex Analysis The dominant theme at this year's Computex conf in Taiwan is that tens of millions of "AI PCs" will sell this year, and more the year after. But despite all the enthusiasm, the qualities of an AI PC have become even more uncertain – and clarity is many months away.

The Register first became confused by the term "AI PC" earlier this year when Intel was bandying it about, so we [1]asked how the silicon giant defined the term and were told it described any laptop packing a Core Ultra CPU that includes an NPU. The moniker was not, however, used by Intel to describe a more comprehensive bill of materials and qualities in the same way that it used brands like "Centrino" or "Ultrabook" to outline a set of specs to which hardware manufacturers were required to conform.

A couple of weeks ago Microsoft muddied the waters by ignoring "AI PC" and introducing the term "Copilot+ PC" to describe machines with an NPU that perform at 40 [2]TOPS or more.

[3]

At Computex this week, CPU- and PC-makers have used the terms "AI PC" and "Copilot+ PC" interchangeably.

[4]

[5]

Developments at the conference suggest the 40 TOPS definition won't be helpful for long. Intel, for example, used Computex to reveal that its forthcoming Panther Lake SoCs will boast stats that "dwarf" the 48 TOPS produced by its [6]newly announced Lunar Lake processors. Qualcomm and AMD have assured attendees they're just getting started with NPU-packing processors.

[7]Nvidia CEO brushes off Big Tech's attacks on NVLink network tech

[8]Fired-up Pat Gelsinger shoots from the lip at Qualcomm and Nvidia

[9]Raspberry Pi unveils Hailo-powered AI Kit to make the model 5 smarter

[10]Arm CEO aims to conquer half the Windows world in 5 years

Further complicating matters is that "AI PC" and "Copilot+ PC" are terms that describe only a PC's processor – an obvious limitation, as myriad components can influence a machine's performance. Further, NPUs are measured in different ways because they're tuned to perform different sorts of math. Some are rated on INT8, others on FP16 … yet all get a TOPS score that a buyer is being asked to understand when comparing machines.

Which means a year from now a Panther Lake unit with perhaps 100 TOPs could enjoy the same branding as a 40 TOPS unit. Pity the punter or enterprise PC procurement posse that goes shopping under those circumstances.

Intel CEO Pat Gelsinger thinks this is not good for buyers.

[11]

In a Q&A session at Computex yesterday, he said "AI PC benchmarks are needed. We don't have proper comparisons yet."

That matters to buyers, but also to Intel as it faces a new and boisterous competitor in the form of Qualcomm, which is happily telling world+dog its new Elite X SoCs are the finest PC powerplants on the planet.

Gelsinger yesterday rubbished that claim.

[12]

But as things stand, he'll struggle to prove it to most would-be buyers.

The Intel CEO suggested it could be a year before comparative performance of AI PCs is easy to understand.

"It will be six months or a year before there is any coherence in the benchmarking space," he predicted, calling for the Standard Performance Evaluation Corporation to deliver certainty by developing a benchmark.

It's hard not to agree with Gelsinger, as AI PCs are being hailed as the biggest thing to happen in tech since the internet went large in the late 1990s. In the words of Microsoft CEO Satya Nadella, they mark the moment at which "Computers can understand us instead of us having to understand computers."

But as things stand, understanding how well an AI PC will be able to understand you is almost impossible to understand.

And that's a problem for the entire AI ecosystem. It means the devices people will buy to experience the latest thing may disappoint.

Which leaves us all in a situation where the PC industry is telling the world its extreme cleverness has delivered its finest-ever products while it can't even agree on what they should be called or properly differentiate the machines.

Buyers need more than hype that these machines are marvellous.

We all deserve better – from AI PCs, and the AI that will run on them. ®

Get our [13]Tech Resources



[1] https://www.theregister.com/2024/03/12/what_is_an_ai_pc/

[2] https://www.theregister.com/Tag/TOPS

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Zl-i4-U4iEP3sAWm8JmItQAAAA0&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Zl-i4-U4iEP3sAWm8JmItQAAAA0&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Zl-i4-U4iEP3sAWm8JmItQAAAA0&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[6] https://www.theregister.com/2024/06/04/intel_details_lunar_lake_tops/

[7] https://www.theregister.com/2024/06/04/nvidia_computex_nvlink_rubin/

[8] https://www.theregister.com/2024/06/04/intel_gelsinger_computex_keynote/

[9] https://www.theregister.com/2024/06/04/raspberry_pi_ai_kit/

[10] https://www.theregister.com/2024/06/03/arm_50_percent_windows/

[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Zl-i4-U4iEP3sAWm8JmItQAAAA0&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Zl-i4-U4iEP3sAWm8JmItQAAAA0&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[13] https://whitepapers.theregister.com/



Okay great

Sorry that handle is already taken.

But, err, what are TOPS?

TOPS

diodesign

TOPS is short for a trillion operations per second. In the context of AI, it'll be INT8 or signed byte precision. So 40 TOPS is 40 trillion operations a second using signed byte values. It's a measure of AI performance by systems.

You'll typically see manufacturers say their hardware can hit X TOPS of AI performance, and software and LLM makers say you'll need hardware capable of Y TOPS for this AI application to be useful. You as a user will want X to be greater than Y.

Eg, Microsoft [1]claims a PC needs a minimum of 40 TOPS to run its Copilot+ suite.

I'll define a page for it and link to it.

C.

[1] https://support.microsoft.com/en-us/topic/copilot-pcs-hardware-requirements-35782169-6eab-4d63-a5c5-c498c3037364

It happened long ago
In the new magic land
The Indians and the buffalo
Existed hand in hand
The Indians needed food
They need skins for a roof
They only took what they needed
And the buffalo ran loose
But then came the white man
With his thick and empty head
He couldn't see past his billfold
He wanted all the buffalo dead
It was sad, oh so sad.
-- Ted Nugent, "The Great White Buffalo"