hn.today

I post trained a model on Demoscenes

datavorous.com38 points21 comments
Screenshot of I post trained a model on Demoscenes

The project explores whether a language model can help artists discover unexpected visual effects by completing unfinished “Dweets”: JavaScript demos constrained to 140 characters. The author sees these tiny programs as a creative language, where shared code patterns can lead to very different animations and countless possible continuations. Rather than enumerate possibilities or rely on a general-purpose coding model, the goal was to train an autocomplete system that understands Dwitter’s unusual code-golf idioms and can offer branches for the artist to evaluate, edit, and develop. The author also wanted the system to reflect aesthetic preferences, treating code completion as a way to explore possibilities rather than simply finish a program.

The model, Demoscener, was built from 25,000 Dweets and about 1,300 validation examples, using Qwen2.5-Code-7B as its base. Continued pretraining made the model substantially better at predicting Dweet syntax: perplexity on held-out examples fell from 28.63 to 8.57. Training that increasingly emphasized the site’s most highly rated demos made generated animations more visually compelling and further improved prediction, including for examples not used in that curriculum. The author then used GRPO preference training, personally comparing groups of eight generated animations over roughly 9-10 rounds and inspecting about 40,000 outputs. A blind comparison by a friend favored one of the resulting checkpoints. The final tool presents continuations side by side so users can choose promising branches, tweak them, and keep exploring.

Read on datavorous.com21 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

GPT-6.1 Terra

GPT-6.1 Terra

OpenAI’s GPT-6.1 Terra is a midrange model focused on visual reasoning, computer use, and technical communication, with faster computer-use performance than Astra and Sol. It costs $1 per million input tokens and $5 per million output tokens, positioning it between the cheaper Luna and pricier Sol. (simonwillison.net)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.