hn.today

On The Use of AI-Based Tools to Find Bugs in Open Source Software

haproxy.com11 points2 comments
Screenshot of On The Use of AI-Based Tools to Find Bugs in Open Source Software

HAProxy lead developer Willy Tarreau describes using AI models to find defects in HAProxy and argues that their value depends on pairing model capability with developers’ validation and repair work. A trusted colleague used Anthropic’s Mythos model to uncover complex bugs, but later batches of its reports were difficult to act on: they lacked code excerpts, clear explanations, reproducers, fixes, and even tested commit identifiers. Using Opus to interpret the reports and suggest patches helped the team; after substantial reworking, about one-third of the proposed fixes were merged. In contrast, many unsolicited AI-generated security reports provide no reproducer or patch, leaving maintainers to investigate uncertain claims.

Tarreau criticizes restricted access to powerful models and safeguards that block ordinary defensive work, such as inspecting C code, reproducing bugs, or tracing root causes. He says these barriers fall hardest on open-source maintainers, while people who submit low-quality findings can still gain access and benefit professionally. Models including newer Opus releases and GLM can find real bugs, but refusals and missing context undermine their usefulness. Developers need tools that scan specified code, demonstrate defects with reusable reproducers, propose and test fixes, rule out false positives, and check for related bugs - not tools focused on exploits or intrusion. Safeguards, he argues, should enable this repair workflow rather than treating work on provided source code as an attack.

Read on haproxy.com2 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in Security

Upload2Shell · CVE-2026-125396

Upload2Shell · CVE-2026-125396

A use-after-free in Ghostscript’s Type 1 font loader lets crafted documents escape the -dSAFER sandbox and run commands through vulnerable upload, preview, and document-processing workflows. Ghostscript 10.08.0 fixes the flaw, with downstream vulnerabilities also reported in services including Debian CUPS, Roundcube, Plesk, and WordPress. (pwn.ai)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.