hn.today

GPT-5.6 Sol can beat Factorio on peaceful mode

ryanmadden.net132 points134 comments
Screenshot of GPT-5.6 Sol can beat Factorio on peaceful mode

GPT-5.6 Sol, running in Codex at a low thinking level, completed a peaceful Factorio game in 13.5 hours of in-game time. The experiment used a Python-based game manager that let the model control the game programmatically while preserving constraints faced by human players, including limited reach and fog of war. The run was recorded as a screencast, and the manager also tracked production statistics alongside research milestones. The author had planned to stop after blue science, but Sol performed well enough to continue toward launching a rocket.

The run showed both progress and limitations. Sol handled earlier stages better than expected, and markedly improved on prior GPT-5.5 attempts, which had failed to use transport belts. But difficulties scaling production emerged later and slowed progress. Sol struggled to connect some factory systems, ultimately compensating by repeatedly carrying supplies between areas to keep rocket production going. The author sees Factorio as a useful, visually accessible way to study model capabilities and build intuition about how models handle complex tasks, while noting that programming offers a related comparison. Future tests are planned with other models, different thinking levels, and games that include enemy attacks.

Read on ryanmadden.net134 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

GPT-6.1 Terra

GPT-6.1 Terra

OpenAI’s GPT-6.1 Terra is a midrange model focused on visual reasoning, computer use, and technical communication, with faster computer-use performance than Astra and Sol. It costs $1 per million input tokens and $5 per million output tokens, positioning it between the cheaper Luna and pricier Sol. (simonwillison.net)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.