Apple's on-device AI model, dubbed Apple Intelligence, will require 4 GB of device storage space, and more at a later date. That's about the size of an HD movie, for now.

The iBiz declared its storage requirements in its "Introduction to Apple Intelligence on iPhone" note [1]published in advance of the public release of iOS 18.1 next month. That's when Apple Intelligence is [2]officially ushered in on iOS (18.1) and macOS (Sequoia 15.1).

There's also a hardware requirement: iPhone 16, iPhone 16 Plus, iPhone 16 Pro, iPhone 16 Pro Max, iPhone 15 Pro, or iPhone 15 Pro Max. Those with iPad and Mac models with M1 and later Apple Silicon will also have access to Apple's AI service.

[3]

Both the iPhone 15 Pro and the iPhone 16 line come with a minimum of 128 GB of storage.

[4]

[5]

Those testing beta versions of Apple's software have [6]reported fluctuating model sizes, some more 5 GB and others around half that.

Apple expects the storage space required will rise over time. "Storage requirements for on-device Apple Intelligence models will increase as more features roll out," the company cautions in a footnote.

[7]

But Apple Intelligence will not be generally available with the release of iOS 18.1. Rather it will be offered as a beta service and users will have to join a waitlist for several hours prior to activation. Once the service has been activated, then the various neural network models required will be downloaded. Apple has not said whether downloaded models can be removed once installed, though presumably users will have the option to deactivate the service.

The Apple Foundation Model (AFM) is a ~3-billion-parameter generative model that's designed to run efficiently on mobile devices, complemented by a large server-based language model within Apple's Private Cloud Compute infrastructure. There's also a diffusion model for adding graphics in Messages and a coding model in Xcode.

[8]FBI raids HQ of US govt IT giant Carahsoft

[9]Feel free to ignore GenAI for now – a new kind of software developer is being born

[10]Who's watching you the closest online? Google, duh

[11]Elon's latest X-periment: Blocked users can still stalk your public tweets

Apple is quantizing its on-device AFM at 4-bits or less to keep its size down – some layers are less important and so get only about 2-bits of quantization. "On average, AFM-on-device can be compressed to only about 3.5 bits per weight (bpw) without significant quality loss," Apple's eggheads explain in [12]a paper detailing their work. "We choose to use 3.7 bpw in production as it already meets the memory requirements."

Generally speaking, a 3B parameter model takes up about 6 GB of storage at 16-bit quantization, about 3 GB at 8-bits, and about 1.5 GB at 4-bits.

To make its AFM more flexible, Apple uses "adapters," which the corp describes as "small collections of model weights that are overlaid onto the common base foundation model." Its AI system loads and unloads these on the fly to provide specific capabilities, such as summarization, proofreading, Mail replies, and so on. Adapters require about 10s of megabytes each, according to Apple's researchers.

[13]

Initially, the capability of Apple Intelligence will be limited to:

Writing Tools

Clean Up in Photos

Create a Memory movie in Photos

Natural language search in Photos

Notification summaries

Reduce Interruptions Focus

Intelligent Breakthrough & Silencing in Focus

Priority messages in Mail

Smart Reply in Mail and Messages

Summaries in Mail and Messages

Siri enhancements, including product knowledge, more resilient request handling, new look and feel, more natural voice, the ability to type to Siri, and more

Reactions to beta versions of the software include terms like " [14]disappointment " and " [15]meh ," but perhaps broader availability and expanded capabilities will lead to a few appealing use cases. ®

Get our [16]Tech Resources



[1] https://support.apple.com/en-mide/guide/iphone/iphc28624b81/ios

[2] https://www.apple.com/newsroom/2024/09/apple-intelligence-comes-to-iphone-ipad-and-mac-starting-next-month/

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZvQzo_ii7QNBEmJqHXwQOAAAARM&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZvQzo_ii7QNBEmJqHXwQOAAAARM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZvQzo_ii7QNBEmJqHXwQOAAAARM&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[6] https://www.reddit.com/r/iOSBeta/comments/1eqojy8/ios_181_db2_apple_intelligence_size_doubled_since/

[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZvQzo_ii7QNBEmJqHXwQOAAAARM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[8] https://www.theregister.com/2024/09/24/fbi_raids_carahsoft_headquarters/

[9] https://www.theregister.com/2024/09/23/kelsey_hightower_interview_part_2/

[10] https://www.theregister.com/2024/09/24/google_online_tracker/

[11] https://www.theregister.com/2024/09/24/x_block_changes/

[12] https://arxiv.org/abs/2407.21075

[13] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZvQzo_ii7QNBEmJqHXwQOAAAARM&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[14] https://www.reddit.com/r/Siri/comments/1fm7hat/apple_intelligence_is_a_huge_disappointment/

[15] https://www.reddit.com/r/iphone/comments/1eu0k3d/comment/lih36o0/

[16] https://whitepapers.theregister.com/