Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU
Llama-modchip aims to run a 284-billion-parameter DeepSeek model using 64GB of RAM without a GPU. The provided information does not explain its technical approach. (github.com)
Nous Research’s Arete-27B is a post-trained version of Alibaba’s Qwen3.8-27B, designed to reduce what the team describes as Chinese state-aligned political framing and make the model reflect Western values. Those values are assessed across seven topics, including free expression, democracy, privacy, markets, education, state ideology, and the environment. The team evaluated factual accuracy and whether answers adopted official Chinese government narratives, using 803 prompts tied to source material and a blinded language-model judge. On this test, the base model averaged 2.32 out of 5 for factual recall, and 22% of its answers showed propaganda by the evaluation’s definition. Nous selected Inkling as the teacher model and assembled training examples that did not overlap with the evaluation prompts.
The team fine-tuned all language-model weights on about 52.8 million tokens over two epochs, without reinforcement learning or preference optimization. Arete scored 2.98 for factual recall and reduced propaganda-containing answers to 1%; zero-scoring answers fell from 359 to 216. Improvements appeared in all seven categories, with the largest gains on freedom of expression. The model’s score on Hermes Bench was nearly unchanged from Qwen’s, while its Terminal-Bench score was higher, leading Nous to report no capability regression in the benchmarks it checked. The team argues these results show that a relatively small amount of targeted training can substantially change a model’s political framing without disrupting its underlying capabilities. It has released the weights, evaluation materials, and training data for further testing.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.
Llama-modchip aims to run a 284-billion-parameter DeepSeek model using 64GB of RAM without a GPU. The provided information does not explain its technical approach. (github.com)
A GNU maintainer’s controversial take prompted debate about AI-generated code in open-source projects. Commenters discussed project leaders who use AI tools while distancing themselves from code ownership. (social.treehouse.systems)
ThinkStream says AI can generate work, but people still need to understand it. The provided page content contains only an anti-bot prompt. (thinkstream.app)
Ensemble is a book and open-source project for building an AI coding agent that helps create the next edition. It advocates development-driven specifications, where specs evolve alongside implementation instead of dictating development upfront. (github.com)
Maple uses manifold-activated pruning to compress mixture-of-experts language models below 2 bits per weight. Its developers say it runs Gemma 4 26B at 45 tokens per second on a 6GB GPU. (github.com)
A longtime Claude Code user is switching to Pi after growing frustrated with incompatible instruction-file formats, limited VSCode session support, and bugs in the GUI extension. They say Claude Code has prioritized adding features over fixing reliability and usability problems. (caleb.software)
Today's best Hacker News stories, summarized and screenshotted, one email a day.