hn.today

GPT-Rosalind-6 System Card Addendum

deploymentsafety.openai.com70 points55 comments
Screenshot of GPT-Rosalind-6 System Card Addendum

GPT-Rosalind-6 is a biology and medicine-focused release of the same model weights as GPT-6 Astra, with no additional training or post-training. It is intended to help qualified researchers with legitimate life-sciences work, including some dual-use questions, while refusing requests to enable biological weaponization. Because it has fewer refusals on dual-use biological queries, access is limited to vetted scientists and organizations whose proposed uses, security controls, and governance are reviewed. OpenAI classifies its biological and chemical capability as High but below Critical, its cybersecurity capability as Critical, and its AI self-improvement capability as below High.

On three research benchmarks, GPT-Rosalind-6 substantially outperformed GPT-Rosalind-5.5 at the highest reasoning budget tested: scores rose from 28.9% to 49.6% on medicinal chemistry, from 16.7% to 37.7% on quantitative biology, and from 44.0% to 61.3% on applied life-sciences research. Preparedness testing covers lab-protocol troubleshooting and tacit biological knowledge, as well as protein design, virus-host interactions, and biological co-evolution. On Biorisk Knowledge, its consensus score was 78.3%, just below the 80% indicative High-capability threshold; adjusting for refusals raised the estimate to 85.0%. It scored 491 of 832 on a test of errors in non-public expert protocols, above that evaluation’s indicative threshold. These evaluations measure specific capabilities, not overall potential for biological harm, and the Critical thresholds are preliminary.

Read on deploymentsafety.openai.com55 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.