hn.today

Frontier AI models outperform analysts on earnings prediction

samaya.ai20 points2 comments
Screenshot of Frontier AI models outperform analysts on earnings prediction

Researchers built a finance-specific prediction harness to test whether frontier AI can beat human analysts at forecasting quarterly earnings. The evaluation ran seven high-capability models (GPT-6 Astra, Claude Fable 5.1, Claude Opus 5.5, GPT-5.6 Sol, Claude Sonnet 5, Gemini 3.8 Flash, Kimi K3) on 456 earnings instances for companies with >$5B market cap and ≥8 broker estimates. Models made one-week-ahead forecasts for four headline metrics (revenue, gross margin, operating income, adjusted EPS) using a point-in-time gated data stack, time-aware retrieval, substituted web access, and expert-guided prompts. Performance was measured by normalized prediction error (adjusted for each company’s surprise volatility), surprise correlation (Spearman ρ versus actual − consensus), and hit rate; a bias-corrected consensus baseline (adding each company’s median historical surprise) provided a stronger expert comparison.

Results show a capability inflection: all tested models beat raw analyst consensus, and the latest frontier models (Fable 5.1, Opus 5.5, GPT-6 Astra) outperform the bias-corrected consensus, with GPT-6 Astra leading on overall error and hit rate while Fable and Opus excel on surprise correlation. Traces reveal models gather evidence, quantify event impacts, and revise away from consensus, driving gains especially on below-consensus calls. An ablation study attributes most of the accuracy improvement to access to up-to-date data, demonstrating that frontier models plus a finance-tailored harness achieve superhuman performance on earnings prediction.

Read on samaya.ai2 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.