Apple gets in on the AI PC hype, claims fanless M3 MacBook Air is fab for LLMs
(2024/03/04)
- Reference: 1709579714
- News link: https://www.theregister.co.uk/2024/03/04/apples_fanless_macbook_air_gets/
- Source link:
Four months after Apple launched its M3 processors alongside refreshed MacBook Pros, the chips have finally arrived on the iGiant's fanless ultra lite laptops.
Apple refreshed its 13-and 15-inch MacBook Air devices Monday, adding support for base M3 silicon, though if you want the beefier M3 Pro or Max chips you'll have to step up to something with active cooling — as well as faster Wi-Fi 6E and support for more displays.
The notebook itself hasn't changed much since its M2 design refresh in 2022. We took a look at [1]that machine not too long ago and were particularly impressed by its battery life. The M3 Air still claims the same 18 hour battery life, dual Thunderbolt 3/USB 4 ports, and can be had in four shades of anodized aluminum. Apple says the midnight color now features a "breakthrough anodization seal" which should help fend off fingerprints — a common complaint with the previous model.
[2]
So, apart from being less smudge-prone, most of the improvements are under the hood. Digging into the spec sheet, we see the $1,099 base-model 13-inch comes equipped with eight CPU and GPU cores, 256GB of flash storage, and an anemic 8GB of unified memory. But, if you buy Apple's claims, that's the equivalent of 16GB on a Windows PC [3]because efficiency .
[4]
[5]
The base-model 15-inch Air will set you back $1,299, which gets you the larger display and slightly faster 10-core GPU, but otherwise the CPU, memory, and storage config are identical to its smaller sibling.
In terms of performance, Apple says you can expect the M3 to be about 60 percent faster than the M1 Air. We took a [6]closer look at Apple's performance claims and architectural improvements behind them when the chips launched last October. However, we recommend taking Apple's claims with a grain of salt, particularly for sustained workloads that are likely to strain the [7]fanless design . We'll have to wait for a full tear-down down to see if Apple has modified the heat spreader.
[8]
In addition to the higher performance, Apple also highlighted the notebook's 16-core Neural Engine, which it claims makes the Air the "world's best consumer laptop for AI." To be clear the inclusion of an NPU isn't new to the M3, but with everyone hyping AI PCs, it seems like Apple may be under pressure to talk up such hardware capabilities.
On that AI note, Apple suggests using Pixelmator Pro to automatically enhance images, remove background noise from video in CapCut, or solve math problems in Goodnotes 6. They highlighted the ability to run large language models (LLMs) and diffusion models locally "with great performance."
It should be noted that the ability to run LLMs on Apple Silicon isn't new. In fact we've tested a 16GB M1 MacBook Air running the Llama 2 7B LLM using [9]Ollama , and it actually performs quite well.
[10]
With that said, if you are looking at picking up an M3 Air to run LLMs, we highly recommend configuring the Air with a bit more memory, especially if you want to run LLMs without bottlenecking your system. Generally speaking, at Int8, a common data type for inferencing, you need about 1GB RAM for every billion parameters. However, practically speaking, techniques like quantization can allow models like Meta's Llama 2 7B to run using half or less that.
[11]EU-turn! Now Apple says it won't banish Home Screen web apps in Europe
[12]Apple Vision Pro rentals take China by storm ahead of official release
[13]Apple promises to protect iMessage chats from quantum computers
[14]EU takes a bite out of Apple with $2B in-app purchase fine
Unfortunately, configuring the M3 with more memory isn't cheap. An additional 8GB will set you back $200 while you'll pay an extra $400 for the 24GB spec. Storage isn't cheap either. Jumping up to the 512GB model will cost an extra $200 while maxing it out at 2TB will cost you $800. Maxing out the 15-inch machine with 24GB of RAM and 2TB of storage would run you $2,499.
And like past MacBook Airs there's no upgrading it after the fact with the SSDs soldered down to the board and memory co-packaged alongside the SoC.
In addition to the faster M3 silicon, the notebook also adds support for faster Wi-Fi 6E connectivity and the ability to connect two external displays, albeit only when the notebook's lid is closed. Display support has long been a criticism of Apple's M1 and M2 silicon which, with the exception of the Mac Mini, only support one external monitor. If you needed more, you'd have to step up to one of the Pro or Max variants.
The M3 MacBook Air is due out Friday, March 8. However, if you're not ready to take the leap, the 13-inch M2 model will be sticking around a while longer at a reduced price of $999.
The venerable M1 Air, however, has all but disappeared from Apple's website, though you may still be able to find one in their refurbished store for a while yet. ®
Get our [15]Tech Resources
[1] https://www.theregister.com/2023/12/11/macbook_air_15_2023_review/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://www.theregister.com/2023/11/09/apple_exec_defends_8gb/
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2023/10/31/apple_m3_cpus_macbook_pro_imac/
[7] https://www.theregister.com/2022/07/21/m2_macbook_air_teardown/
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[9] https://github.com/ollama/ollama
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[11] https://www.theregister.com/2024/03/02/apple_reverses_pwa_decision/
[12] https://www.theregister.com/2024/02/27/china_apple_vision_pro_rentals/
[13] https://www.theregister.com/2024/02/21/apple_postquantum_security/
[14] https://www.theregister.com/2024/03/04/eu_apple_fine/
[15] https://whitepapers.theregister.com/
Apple refreshed its 13-and 15-inch MacBook Air devices Monday, adding support for base M3 silicon, though if you want the beefier M3 Pro or Max chips you'll have to step up to something with active cooling — as well as faster Wi-Fi 6E and support for more displays.
The notebook itself hasn't changed much since its M2 design refresh in 2022. We took a look at [1]that machine not too long ago and were particularly impressed by its battery life. The M3 Air still claims the same 18 hour battery life, dual Thunderbolt 3/USB 4 ports, and can be had in four shades of anodized aluminum. Apple says the midnight color now features a "breakthrough anodization seal" which should help fend off fingerprints — a common complaint with the previous model.
[2]
So, apart from being less smudge-prone, most of the improvements are under the hood. Digging into the spec sheet, we see the $1,099 base-model 13-inch comes equipped with eight CPU and GPU cores, 256GB of flash storage, and an anemic 8GB of unified memory. But, if you buy Apple's claims, that's the equivalent of 16GB on a Windows PC [3]because efficiency .
[4]
[5]
The base-model 15-inch Air will set you back $1,299, which gets you the larger display and slightly faster 10-core GPU, but otherwise the CPU, memory, and storage config are identical to its smaller sibling.
In terms of performance, Apple says you can expect the M3 to be about 60 percent faster than the M1 Air. We took a [6]closer look at Apple's performance claims and architectural improvements behind them when the chips launched last October. However, we recommend taking Apple's claims with a grain of salt, particularly for sustained workloads that are likely to strain the [7]fanless design . We'll have to wait for a full tear-down down to see if Apple has modified the heat spreader.
[8]
In addition to the higher performance, Apple also highlighted the notebook's 16-core Neural Engine, which it claims makes the Air the "world's best consumer laptop for AI." To be clear the inclusion of an NPU isn't new to the M3, but with everyone hyping AI PCs, it seems like Apple may be under pressure to talk up such hardware capabilities.
On that AI note, Apple suggests using Pixelmator Pro to automatically enhance images, remove background noise from video in CapCut, or solve math problems in Goodnotes 6. They highlighted the ability to run large language models (LLMs) and diffusion models locally "with great performance."
It should be noted that the ability to run LLMs on Apple Silicon isn't new. In fact we've tested a 16GB M1 MacBook Air running the Llama 2 7B LLM using [9]Ollama , and it actually performs quite well.
[10]
With that said, if you are looking at picking up an M3 Air to run LLMs, we highly recommend configuring the Air with a bit more memory, especially if you want to run LLMs without bottlenecking your system. Generally speaking, at Int8, a common data type for inferencing, you need about 1GB RAM for every billion parameters. However, practically speaking, techniques like quantization can allow models like Meta's Llama 2 7B to run using half or less that.
[11]EU-turn! Now Apple says it won't banish Home Screen web apps in Europe
[12]Apple Vision Pro rentals take China by storm ahead of official release
[13]Apple promises to protect iMessage chats from quantum computers
[14]EU takes a bite out of Apple with $2B in-app purchase fine
Unfortunately, configuring the M3 with more memory isn't cheap. An additional 8GB will set you back $200 while you'll pay an extra $400 for the 24GB spec. Storage isn't cheap either. Jumping up to the 512GB model will cost an extra $200 while maxing it out at 2TB will cost you $800. Maxing out the 15-inch machine with 24GB of RAM and 2TB of storage would run you $2,499.
And like past MacBook Airs there's no upgrading it after the fact with the SSDs soldered down to the board and memory co-packaged alongside the SoC.
In addition to the faster M3 silicon, the notebook also adds support for faster Wi-Fi 6E connectivity and the ability to connect two external displays, albeit only when the notebook's lid is closed. Display support has long been a criticism of Apple's M1 and M2 silicon which, with the exception of the Mac Mini, only support one external monitor. If you needed more, you'd have to step up to one of the Pro or Max variants.
The M3 MacBook Air is due out Friday, March 8. However, if you're not ready to take the leap, the 13-inch M2 model will be sticking around a while longer at a reduced price of $999.
The venerable M1 Air, however, has all but disappeared from Apple's website, though you may still be able to find one in their refurbished store for a while yet. ®
Get our [15]Tech Resources
[1] https://www.theregister.com/2023/12/11/macbook_air_15_2023_review/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://www.theregister.com/2023/11/09/apple_exec_defends_8gb/
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2023/10/31/apple_m3_cpus_macbook_pro_imac/
[7] https://www.theregister.com/2022/07/21/m2_macbook_air_teardown/
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[9] https://github.com/ollama/ollama
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZeZSl80SVtuT7XcQwnUWNQAAAQQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[11] https://www.theregister.com/2024/03/02/apple_reverses_pwa_decision/
[12] https://www.theregister.com/2024/02/27/china_apple_vision_pro_rentals/
[13] https://www.theregister.com/2024/02/21/apple_postquantum_security/
[14] https://www.theregister.com/2024/03/04/eu_apple_fine/
[15] https://whitepapers.theregister.com/
aerogems
Not sure why Apple really cares. Their Mac business has become something of an afterthought with the success of the iPod and then iPhone and iPad. So much so, they dropped "Computer" from the company name many years ago. At this point, their entire Mac lineup is essentially just iPads in a different form factor and able to run the full version of macOS, not it's stripped down cousin iOS/iPadOS. So, why they are even bothering to try to goose sales of those systems is kind of a mystery. Maybe they ordered a few too many M3s from the fab and need to offload them? During my time at Apple, I was a product analyst for the Mac line, and they gave that one to me largely because it was so low volume compared to other product lines. I was splitting my time with another function that was a lot more high volume and business critical, if very unsexy.
Mac Can-can
Anonymous Coward
I'll have to try this Oohlala model on my MoulinRouge Air laptop ...
Dual monitors
Good to hear that’s finally happened. I’m using a dual display link adapter but it has issues and doesn’t work under all circumstances. What with HP biz laptops routinely supporting 3 monitors, it’s about time.