hn.today

AI coding agents generate more code, but not more software

arstechnica.com280 points231 comments
Screenshot of AI coding agents generate more code, but not more software

Harvard researchers Fiona Chen and James Stratton analyzed granular engineering analytics from Jellyfish - about 300 million work events across more than 700,000 engineers at 700+ firms from 2021 to March 2026 - to measure the operational impact of AI coding assistants and autonomous coding agents. Using direct measures of AI adoption and GitHub activity with difference-in-differences regressions, they found that introducing agentic coding tools sharply raises developer output metrics: roughly 30% more lines of code, 20% more commits, and 23% more pull requests on average.

Those upward shifts did not translate into greater software delivery or reduced headcount. Jira-tracked issue and epic resolution rates showed no statistically significant change. Instead, review work ballooned: time from pull request submission to merge rose about 49%, the share of PRs requiring changes nearly doubled, comments per PR increased ~35%, and 14% more workers were doing reviews. AI-driven review remains limited - by March 2026 agents authored about 23.3% of review comments and handled 10.8% of PRs - so human reviewers remain the bottleneck. The net effect is that coding efficiency gains are largely absorbed by downstream review costs, leaving firms with more code but not more completed software.

Read on arstechnica.com231 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in Programming

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.