Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU
Llama-modchip aims to run a 284-billion-parameter DeepSeek model using 64GB of RAM without a GPU. The provided information does not explain its technical approach. (github.com)
Agent memory is knowledge retained across sessions from interactions and tasks, distinct from model training, within-conversation learning, or summaries used to continue a task. It can range from searchable transcripts to Claude-written notes, organized representations such as wikis, and information automatically loaded into future sessions. The central idea is that memory should be treated as a prediction about what will be useful later: agents must identify durable facts, tested rules, strategies, and lessons rather than preserve every detail. A “dreaming” process can review logs during idle periods, correct mistakes, consolidate notes, and shape what future sessions receive.
Evaluations show that effective memory can substantially improve long-horizon performance, but its value depends on how models organize and use it. On a database task from CL-Bench, stronger Claude models used feedback to validate rules, document evidence, and warn about traps, raising scores markedly over stateless runs. In Pokémon Red, Sonnet 3.7 accumulated hundreds of files describing changing, often redundant state; maintaining them consumed effort and yielded one badge. Fable 5 kept a compact set of goals, plans, and tested strategies and earned four badges, while Opus 5.5 also used concise, actively updated notes to beat the game. General permission to use memory worked better for capable models than rigid instructions such as recording only failures. Older models benefited more from explicit guidance to consult notes and test explanations, suggesting that memory design should let capable agents judge salience while providing weaker ones with targeted support.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.
Llama-modchip aims to run a 284-billion-parameter DeepSeek model using 64GB of RAM without a GPU. The provided information does not explain its technical approach. (github.com)
A GNU maintainer’s controversial take prompted debate about AI-generated code in open-source projects. Commenters discussed project leaders who use AI tools while distancing themselves from code ownership. (social.treehouse.systems)
ThinkStream says AI can generate work, but people still need to understand it. The provided page content contains only an anti-bot prompt. (thinkstream.app)
Ensemble is a book and open-source project for building an AI coding agent that helps create the next edition. It advocates development-driven specifications, where specs evolve alongside implementation instead of dictating development upfront. (github.com)
Maple uses manifold-activated pruning to compress mixture-of-experts language models below 2 bits per weight. Its developers say it runs Gemma 4 26B at 45 tokens per second on a 6GB GPU. (github.com)
A longtime Claude Code user is switching to Pi after growing frustrated with incompatible instruction-file formats, limited VSCode session support, and bugs in the GUI extension. They say Claude Code has prioritized adding features over fixing reliability and usability problems. (caleb.software)
Today's best Hacker News stories, summarized and screenshotted, one email a day.