Apple’s new Foundation Models Framework introduces an on-device large language model (LLM) with 3 billion parameters, enabling AI features to run locally on Apple devices. This “device-scale model” excels at tasks like content generation, text summarization, and natural language understanding, all while prioritizing user privacy by processing data locally and offline. The framework also introduces Guided Generation, allowing developers to define the structure of AI-generated responses, ensuring reliability and robustness in app features.
Links:
Design and Development Videos - Apple Developer
Apple Just Handed Every Developer a 3-Billion Parameter AI Model, No Cloud Required | by Cogni Down Under | Medium
Apple’s Foundation Models framework unlocks new intelligent app experiences - Apple
Guided Generation with FoundationModels: How to Get Swift Structs from LLMs | by Luiz Fernando Salvaterra | Medium
Deep dive into the Foundation Models framework - WWDC25 - Videos - Apple Developer
Introduction to Apple's FoundationModels: Limitations, Capabilities, Tools
Apple supercharges its tools and technologies for developers - Apple
Joint statement from Google and Apple
Local AI Chat - SmartFruit App - App Store