hn.today

Foundation Models Framework (macOS)

developer.apple.com267 points35 comments
Screenshot of Foundation Models Framework (macOS)

Apple’s Foundation Models framework is a native Swift API for adding language-model capabilities to apps, with direct access to Apple’s on-device model and models running in Private Cloud Compute. It is designed for tasks ranging from summaries to agent-like workflows, and includes guided generation, tool calling, image understanding, and integration with Vision features such as OCR and barcode reading. The framework also supports server-hosted models, including Claude and Gemini, through a shared API; providers can offer models by implementing its Language Model protocol. Apple emphasizes privacy and offline operation for on-device use. Eligible developers in the App Store Small Business Program - with fewer than two million first-time downloads - can access Apple models on Private Cloud Compute without cloud API charges, though usage limits may apply.

The framework’s newer Dynamic Profiles let apps switch models, tools, instructions, temperature, and reasoning settings during a continuous session while retaining a shared transcript. This supports adaptable agents and skills. An Evaluations framework helps test prompt and model behavior under changing conditions, while the macOS 27 “fm” command-line tool enables scripting and model-workflow prototyping. Apple also offers an open-source utilities package with experimental skills and context-management helpers, plus a Python SDK for working with Python tools and evaluation packages. Developers can consult usage restrictions and documentation for integrating Apple’s cloud model. Server-side features may have daily limits that vary with demand and request complexity; expanded access is expected to become available for a fee.

Read on developer.apple.com35 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.