The piece evaluates whether Gemini 4 Neon could compete with Opus 5.5 on the Agent Duel leaderboard. Gemini 4 Carbon led the leaderboard when early votes were excluded, but its main drawback was speed: it generated 46 tokens per second. Neon was observed at 127 tokens per second through OpenRouter, alongside incremental benchmark improvements. To estimate how much that speed matters, the author modeled leaderboard win rates using model identity, generation speed, and whether a user voted early. Adding an interaction between speed and early voting improved the model’s fit, and the results indicate speed is almost as influential as model identity.
Assuming Neon performs about as well as Carbon - a reasonable assumption given Neon’s stronger benchmark scores - and maintains its observed speed, the model projects a leaderboard Elo of 1,066. That is close to Opus 5.5’s 1,078 in a later analysis snapshot. Neon’s estimated win rate against Opus is 48.3%, counting ties as half a win; the 90% interval for the Elo difference runs from 94 points behind to 68 points ahead. The projection therefore places Neon roughly level with Opus, rather than establishing it as the superior model. It depends on modeled leaderboard effects and assumed Carbon-like performance, not a direct comparison between the two models.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.