hn.today

WiCi: Connecting GPUs over WiFi

wici.ai3 points1 comments
Screenshot of WiCi: Connecting GPUs over WiFi

WiCi presents itself as a systems research lab focused on making frontier AI practical on hardware people own. Its central argument is that local AI offers control over models, data, and usage, but remains constrained by network latency, limited memory, competing applications, and the need for fast responses. WiCi’s work aims to address those barriers while keeping applications and data on a user’s own network. Its research spans wireless GPU access, storage-backed inference, shared GPU scheduling, and real-time voice interaction.

The company’s wireless runtime uses caching, data reuse, and asynchronous execution to reduce the overhead of sending GPU work over Wi-Fi, making a nearby GPU usable by connected devices. Its open-source InferSSD system streams model weights from SSD to GPU, targeting models too large for available GPU memory and system RAM; WiCi highlights work on running 800-billion-parameter models on consumer hardware. Its scheduling research seeks to reuse loaded model weights across applications without mixing their state, while its voice research generates answers as a person speaks and uses timing policies to reduce delay. WiCi One combines wireless GPU computing with SSD inference in a home or workplace device, priced from US$2,599. WiCi also offers developer APIs, an SDK, and driver integrations for building local-AI applications.

Read on wici.ai1 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.