New York City Comptroller Mark Levine formally urges Anthropic to pause its planned initial public offering until the company fully and transparently addresses acute AI safety, governance, and development-pace risks. Levine cites recent, unusually candid statements from Anthropic leadership acknowledging that rapid frontier-model advancement and potential recursive self-improvement could outpace human oversight, including a CEO essay calling to slow the pace and public resignations and risk estimates from internal researchers that place nontrivial odds on catastrophic outcomes. Draft regulatory filings reportedly warn of existential risks and contain an unusually long risk-disclosure section, while press reports suggest a potential IPO valuation near $2 trillion. Levine frames these concerns through his role overseeing New York City’s $325 billion in pension assets, arguing that investor protection requires clarity on unprecedented threats.
Levine demands that Anthropic disclose specific audits, controls, their intended scope, and a timeline showing how governance and safety commitments will address the company’s stated need to slow capability development. He highlights governance worries tied to Anthropic’s public-benefit corporate form and proposed founder-concentrated control, and flags concrete incident risk such as automated botnet scenarios that could cause hundreds of billions in damage. Levine requests a written response, urges postponement of the IPO process, and offers to discuss next steps.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.