hn.today

New Linux tech compresses memory in RAM, as RAM, for 452x speedup

tomshardware.com47 points17 comments
Screenshot of New Linux tech compresses memory in RAM, as RAM, for 452x speedup

Commenters debated what the new Linux CRAM work actually is and how it differs from prior efforts. cwillu argued the original writeups misunderstood the project, confusing it with zswap; they said CRAM enables cacheline-level access and hardware-assisted compression rather than the page-level, SSD-like behavior of zswap. tancop emphasized that the core distinction is not just offloading but treating compressed RAM as slower memory with NUMA-like placement and allocation policies, which reduces overhead and improves performance. Kevin_Flynn noted historical parallels with 1990s Ram Doubler software, and others pointed readers toward a Phoronix writeup for a more technical take.

Commenters also debated the practical impact on AI workloads and logistics around the talk. madduci suggested CRAM could let people run large "frontier" models locally, while tintor and throawayonthe pushed back that general-purpose memory compression won’t help model weights as effectively as quantization or distillation because weights are high-entropy. sroussey acknowledged current brute-force approaches to models but pointed to ongoing research in model compression and architectural separation of knowledge versus compute. Several participants (cyberclimb, tux3) remarked on difficulties finding or hearing the conference presentation recording.

Read on tomshardware.com17 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in Other

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.