News: 1710241211

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

We asked Intel to define 'AI PC'. Its reply: 'Anything with our latest CPUs'

(2024/03/12)


If you're confused about what makes a PC an "AI PC," you're not alone. But finally have something of an answer: if it packs a GPU, a processor that boasts a neural processing unit and can handle VNNI and Dp4a instructions, it qualifies – at least according to Robert Hallock, Intel's senior director of technical marketing.

As luck would have it, that combo is present in Intel's current-generation desktop processors – 14th-gen Core, aka Core Ultra, aka "Meteor Lake." All models feature a GPU, NPU, and can handle Vector Neural Network Instructions (VNNI) that speed some – surprise! – neural networking tasks, and the DP4a instructions that help GPUs to process video.

Because AI PCs are therefore just PCs with current processors, Intel doesn't consider "AI PC" to be a brand that denotes conformity with a spec or a particular capability not present in other PCs.

[1]

Intel used the "Centrino" brand to distinguish Wi-Fi-enabled PCs, and did likewise by giving home entertainment PCs the "Viiv" moniker. Chipzilla still uses the tactic with "vPro" – a brand that denotes processors that include manageability and security for business users.

[2]

[3]

But AI PCs are neither a brand nor a spec.

"The reason we have not created a category for it like Centrino is we believe this is simply what a PC will be like in four or five years time," Hallock told The Register , adding that Intel's recipe for an AI PC doesn't include specific requirements for memory, storage, or I/O speeds.

[4]

"There are cases where a very large LLM might require 32GB of RAM," he noted. “Everything else will fit comfortably in a 16GB system.”

Another reason AI PCs won't be branded is that all PCs can run AI. Hallock pointed out, however, that PCs without an NPU will run AI at painfully slow speeds.

"Falling back to the CPU is grotesquely inefficient from a performance and energy efficiency point of view," he told The Register . "For large language models or generative AI, an NPU is basically a requirement."

[5]Desktop GPU shipments jumped by a third – no thanks to AI PCs

[6]Apple gets in on the AI PC hype, claims fanless M3 MacBook Air is fab for LLMs

[7]Hold up world, HP's all-in-one print subscription's about to land, and don't forget AI PCs

[8]Dell promises 'every PC is going to be an AI PC' whether you like it or not

If AI PCs are just this year's PCs, why bother buying one?

Hallock predicted that AI will infuse and change the experience of using a PC in the same way that graphics cards have done over the years.

[9]

"Today the graphics engine runs your browser, your webcam, it runs the UI, it is everywhere," he observed – yet only a few years ago GPUs were considered an expensive optional extra. In coming years, Hallock expects AI will become similarly omnipresent, and essential.

That change is not immediately apparent, as current AI-infused apps mostly serve content creators or offer simple functions like tidying up video in Zoom or Teams sessions.

Hallock believes more profound and obvious examples of AI at work are imminent.

He cited security vendors Crowdstrike and browser isolation outfit Bufferzone using NPUs to run convolutional neural network models that detect attacks that try to tamper with system memory – a defense against attacks that CPU-based systems may struggle to detect.

Hallock also predicted that CRM systems will be able to respond to queries about when you met someone and what you discussed – and deliver a generative summary of your relationship.

"The other one I am personally excited about is outsourcing all the minutes and summaries and notes and follow up emails to AI: I would get two hours back in my day by hitting 'Generate'. Automate that across many knowledge workers and businesses get very excited."

But they won't need to get excited about AI PCs to make it happen.

They'll just need to buy this year's PCs. ®

Get our [10]Tech Resources



[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZfCKLFv6RYB9IAK2HkagmwAAAMs&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZfCKLFv6RYB9IAK2HkagmwAAAMs&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZfCKLFv6RYB9IAK2HkagmwAAAMs&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZfCKLFv6RYB9IAK2HkagmwAAAMs&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[5] https://www.theregister.com/2024/03/06/desktop_gpu_shipments/

[6] https://www.theregister.com/2024/03/04/apples_fanless_macbook_air_gets/

[7] https://www.theregister.com/2024/02/29/hold_up_world_hps_allinone/

[8] https://www.theregister.com/2024/02/26/dell_ai_pc/

[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZfCKLFv6RYB9IAK2HkagmwAAAMs&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[10] https://whitepapers.theregister.com/



tatatata

"There are cases where a very large LLM might require 32GB of RAM," he noted. “Everything else will fit comfortably in a 16GB system.”

Seems a bit like:

I have to say that in 1981, making those decisions, I felt like I was providing enough freedom for 10 years. That is, a move from 64k to 640k felt like something that would last a great deal of time. (Gates)

32 bits, it is enough for an experiment, it is 4.3 billion terminations -- even the defense department doesn't need 4.3 billion of anything (Cerf)

"I think there is a world market for maybe five computers." (Watson)

(and so on)

The claim is already untrue even today

pip25

There are open-source models today that do not even fit into 64 GB of RAM, let alone 32.

In other words: this is just the usual marketing drivel.

Better tell Microshit

Julian 8

"Falling back to the CPU is grotesquely inefficient from a performance and energy efficiency point of view," he told The Register.

And there they are, pushing clippy2 to all machines.

I wonder if older PCs will suddenly become worth more ?

Anonymous Coward

Much like second hand cars did.

Who want's this shit sprayed everywhere ? I don't.

Same as the heresy I committed when I last chose a car *and* TV. Told the sales person I didn't give a shiny shit how smart anything was because I will never use it. Instead I will use what I bring to the table through the screen(s).

"Desktop" ?

xenny

I thought Meteor Lake was mobile only?

Intel's senior director of technical marketing.

Anonymous Coward

as opposed to a senior director of general' marketing bullshit.

So about those NPU's...

chuckufarley

...Intel talks about them a lot. But for the past few years most GPU's on the market have had Tensors cores built in. They are specifically designed to run the neural networks inside of AI models. So I would argue any gamer with Tensor cores in their GPU already has an AI PC. Welcome to the future.

katrinab

GPT4All runs at a fairly usable speed on my Threadripper. Running it on my RTX3080Ti is a lot faster, but I wouldn't say the CPU option is "uncomfortably slow".

AI?

Headley_Grange

I'm looking forward to this AI. I can just tell it go through the DVD iso's I haven't converted to MP4 and run them through Handbrake, save only the episodes (no extras), make sure that any that need subtitles are ripped properly either as a track or burnt-in ones, give them meaningful series and episode names, sort them into directories then stick them on the NAS in the right hierarchy and update my tracking file. I'm looking forward to asking the AI to "sort out my iTunes Library", including rationalizing all the "sort album artist" fields, fixing the artwork, upping the volume on the tracks that are a bit quiet and shifting the song announcements on live albums from the end of the previous track to the start of the track that it's introducting - all without changing the play count and last played date metadata. That's just a couple of things I've spent a few hours doing this week, but there are tons of things I can think of for AI to do for me. Will it be out in time for Christmas? What colour will it be?

Ah, so an AI PC just needs a specific Intel CPU

Pascal Monett

Yeah, go tell that to Nvidia.

Or rather, just keep on banging that drum. There is no such thing as AI anyway, so make the most of it while you can.

After all, quantum is coming . . .

Re: Ah, so an AI PC just needs a specific Intel CPU

Paddy Fagan

> After all, quantum is coming . . .

Or maybe its not - ....something about uncertainty....

Re: Ah, so an AI PC just needs a specific Intel CPU

spacecadet66

Thanks folks, I'll be here all week. Be sure to simultaneously try and not try the veal.

spacecadet66

> at least according to Robert Hallock, Intel's senior director of technical marketing

But why listen to what a marketer says, about anything, ever? Their job is literally to say whatever will make product sell. If this were five years ago he'd be explaining how the latest CPUs were "blockchain-ready" and how important that is.

Nobody wants constructive criticism. It's all we can do to put up with
constructive praise.