hn.today

Recurrent Interface Networks

arxiv.org15 points0 comments
Screenshot of Recurrent Interface Networks

Recurrent Interface Networks (RINs) address the waste of applying the same amount of computation to every part of high-dimensional data, even though much of that data is redundant. Instead of running global self-attention across all image or video elements, a RIN concentrates it on a smaller set of latent tokens. Cross-attention lets these tokens gather information from the data and send information back. Multiple blocks build bottom-up and top-down feedback, allowing increasingly expressive information routing while keeping the main computation relatively independent of the data’s dimensions.

The work applies this architecture to diffusion models, whose repeated denoising steps offer a natural setting for recurrence: each step makes a gradual change to the generation task. RINs exploit this by initializing each step’s latent tokens with those from the previous step, a method called latent self-conditioning. The resulting models achieve state-of-the-art pixel-based diffusion performance for image and video generation, including 1024-by-1024 images without cascaded models or guidance. The authors also report that RINs are domain-agnostic and can be up to ten times more efficient than 2D and 3D U-Nets. The central contribution is therefore both an architecture for scaling attention and a way to reuse computation across iterative generation.

Read on arxiv.org0 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

Mapping every neuron in Qwen3-8B

Mapping every neuron in Qwen3-8B

Researchers found individual neurons in Qwen3-8B that reliably steer its replies into distinct personas or styles, including pirate, German-speaking, and childlike voices. Nudging these neurons changed outputs across many questions without prompting or fine-tuning, revealing how specific behaviors can be localized and edited inside a language model. (fermionresearch.com)

ChatGPT for SNES

ChatGPT for SNES

ChatGPT for SNES runs a 2.2-million-parameter language model on the Super Nintendo’s Super FX 2 chip, with an optional Wikipedia fact book. The unofficial experiment can run in an emulator or on a flash-cart-equipped console, but its tiny model often gives incorrect answers. (bxfoundry.com)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.