hn.today

An AI Rant

carlhandellen.substack.com15 points7 comments
Screenshot of An AI Rant

Carl Handellen argues that warnings of AI-driven human extinction are alarmist and unsupported. He accepts that AI is already changing daily life and has transformed software engineering, but rejects predictions that advanced systems will soon eradicate humanity. He cites a 2023 statement comparing AI extinction risk with pandemics and nuclear war, Eliezer Yudkowsky’s claim that an uncontrolled powerful AI could kill all biological life, and Anthropic figures’ estimates: Evan Hubinger’s belief in a greater-than-10% chance of catastrophe within a decade and CEO Dario Amodei’s 25% chance that outcomes go “really, really badly.” Handellen says these claims come without a public, detailed account of how such a catastrophe would unfold.

He describes the feared scenario as depending on several uncertain steps: AI must become vastly more intelligent than humans, continue improving without hitting limits, regard people as an obstacle, and find a way to destroy humanity despite lacking direct access to the physical world. By contrast, he presents economic harm from slowing or halting AI development as a more immediate certainty, arguing that restrictions could trigger recession and widespread hardship; he points to a sharp Nasdaq decline following the prospect of regulation. He suspects, while acknowledging he is speculating, that some researchers’ beliefs reflect an existing “doomer” worldview and that AI-company executives may use existential warnings to justify regulation that entrenches their market power and limits open-source competitors.

Read on carlhandellen.substack.com7 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

Now Anthropic is blocking Russian users

Now Anthropic is blocking Russian users

Anthropic is accused of charging Russian Claude users before identity checks, then cutting off access after verification and retaining biometric data. Critics say account bans can affect linked GitHub projects and Russian citizens living abroad, and accuse the company of failing to answer public questions. (twitter.com)

The End of AI Frontiers

The End of AI Frontiers

Microsoft Research’s AI Frontiers group brought together about 50 researchers to develop agent systems and foundational AI advances. After the team joined Microsoft AI in September, its research-first approach clashed with leadership’s emphasis on scaling. (hunch.net)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.