Harbor is a planned Mac app for running open-weight AI models locally on Apple silicon, turning a Mac into a private inference server. Its central promise is that prompts and other data stay on the user’s hardware rather than being sent to cloud services. The app is designed to simplify the process: users can browse, download, and load models inside Harbor, without needing to configure infrastructure or use command-line tools.
Harbor can also link two or more Macs equipped with Thunderbolt 5, automatically detecting them and combining their unified memory into a shared inference resource. This could let users run models too large for one computer or handle more simultaneous requests than a single Mac can manage. The intended setup is plug-and-play, with clustering and model management handled by the app. Harbor is currently in private preview under the Claris brand.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.