Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU
Llama-modchip aims to run a 284-billion-parameter DeepSeek model using 64GB of RAM without a GPU. The provided information does not explain its technical approach. (github.com)
John Langford explains that AI Frontiers was formed at Microsoft Research after ChatGPT’s launch to organize research more effectively than isolated projects could. Its roughly 50 researchers combined coordinated efforts on agents, including AutoGen and the Fara computer-use agent, with work on core model capabilities such as the Next Latent objective, Dion3, and the Full Bandwidth Transformer. The group also built shared infrastructure, including a model-training codebase, so its work could benefit researchers across Microsoft. Langford says these efforts produced pioneering results despite limited compute and the challenges of aligning a research organization.
After AI Frontiers was moved into Microsoft AI, Langford says its research-led approach clashed with leadership focused on scaling models through data and larger training runs. He accepts that scaling can reliably improve predictions and business returns, but argues that research can deliver substantial efficiency gains: he cites experiments suggesting a Full Bandwidth Transformer variant could match a model twice its size, reducing training and inference costs. Concluding that the new organization had little appetite for research and that returning to Microsoft Research offered no dependable route from research to practical use, he left. Other founding leaders reached similar conclusions, and AI Frontiers ended, including its internship program. Langford says Microsoft could again become attractive to researchers if its leadership commits to organizing effectively and putting innovation into use.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.
Llama-modchip aims to run a 284-billion-parameter DeepSeek model using 64GB of RAM without a GPU. The provided information does not explain its technical approach. (github.com)
A GNU maintainer’s controversial take prompted debate about AI-generated code in open-source projects. Commenters discussed project leaders who use AI tools while distancing themselves from code ownership. (social.treehouse.systems)
ThinkStream says AI can generate work, but people still need to understand it. The provided page content contains only an anti-bot prompt. (thinkstream.app)
Ensemble is a book and open-source project for building an AI coding agent that helps create the next edition. It advocates development-driven specifications, where specs evolve alongside implementation instead of dictating development upfront. (github.com)
Maple uses manifold-activated pruning to compress mixture-of-experts language models below 2 bits per weight. Its developers say it runs Gemma 4 26B at 45 tokens per second on a 6GB GPU. (github.com)
A longtime Claude Code user is switching to Pi after growing frustrated with incompatible instruction-file formats, limited VSCode session support, and bugs in the GUI extension. They say Claude Code has prioritized adding features over fixing reliability and usability problems. (caleb.software)
Today's best Hacker News stories, summarized and screenshotted, one email a day.