hn.today

Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5

artificialanalysis.ai329 points240 comments
Screenshot of Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5

Google’s Gemini 4 Carbon ranks first on the Artificial Analysis Intelligence Index v5, scoring 59 and taking the top result in four of nine evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience and AutomationBench-AA. Its strongest gains are in complex reasoning, scientific tasks, coding and knowledge work, though it does not lead every category. In coding-agent tests, Carbon scores 59 with Google’s Antigravity CLI, three points behind Claude Opus 5.5, and places second on both Terminal-Bench 4.0 and FrontierCode v1.1. Its AA-Briefcase score improves 126 Elo over Gemini 4 Argon, with particularly notable gains in presentation creation and analytical quality, but it remains behind several competing models.

At standard pricing, Carbon costs $7.76 per Intelligence Index task, about 23% less than Claude Opus 5.5, and uses 29% fewer output tokens per task; its cost is similar to Argon’s despite scoring nine points higher. Carbon also leads the updated AA-Omniscience evaluation, with 58% accuracy and an 11% hallucination rate - higher than Argon’s 4%, but far below the 50% rates reported for Claude Opus 5.5 and GPT-6 Astra. The model has a one-million-token context window and accepts text, images, video and speech. It is being offered to selected users, not yet publicly released, at $4 per million input tokens and $20 per million output tokens, with a 50% launch discount and 95% off cached inputs.

Read on artificialanalysis.ai240 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.