GPT-5.6 Sol, running in Codex at a low thinking level, completed a peaceful Factorio game in 13.5 hours of in-game time. The experiment used a Python-based game manager that let the model control the game programmatically while preserving constraints faced by human players, including limited reach and fog of war. The run was recorded as a screencast, and the manager also tracked production statistics alongside research milestones. The author had planned to stop after blue science, but Sol performed well enough to continue toward launching a rocket.
The run showed both progress and limitations. Sol handled earlier stages better than expected, and markedly improved on prior GPT-5.5 attempts, which had failed to use transport belts. But difficulties scaling production emerged later and slowed progress. Sol struggled to connect some factory systems, ultimately compensating by repeatedly carrying supplies between areas to keep rocket production going. The author sees Factorio as a useful, visually accessible way to study model capabilities and build intuition about how models handle complex tasks, while noting that programming offers a related comparison. Future tests are planned with other models, different thinking levels, and games that include enemy attacks.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.