hn.today

Sex, AI, and the Apocalypse

iankduncan.com173 points177 comments
Screenshot of Sex, AI, and the Apocalypse

A high-profile resignation from Anthropic by researcher Jacob Coxon, who warned that his colleagues "earnestly believe that [AI] could kill us all by the end of the decade," thrust apocalyptic AI rhetoric into the mainstream. That claim was publicly echoed by Anthropic leadership and amplified by politicians and tech moguls. Those warnings trace back not to generic technologists but to a distinct twenty-five-year-old "rationalist" subculture centered on LessWrong, the Machine Intelligence Research Institute (MIRI), and personalities like Eliezer Yudkowsky. That community grew around a doctrine of clearer thinking, a secular liturgy (Secular Solstice) organized by Raymond Arnold, and canonical writings (the Sequences) that recruited technologists into a worldview prioritizing existential risk mitigation. Its demographics skew heavily male, autistic or neurodivergent, and technically trained, and its founding narratives and leaders - Yudkowsky’s early transhumanism and MIRI’s long-standing concern about misaligned superintelligence - have shaped both belief and recruitment into contemporary AI safety institutions.

The social ecosystem producing these warnings is deeply entangled with troubling specifics: a Harry Potter fanfic recruitment pipeline, psychological workshops described as coercive, programs advocating eugenic child-enhancement, sex-and-culture controversies, a sect that retreated to boats and faced links to multiple deaths, and bloggers who promoted anti-democratic ideas that reached high government offices. These cultural features - salvation stories, authoritarian sympathies, fraught sexual dynamics, and experimental social practices - are embedded in organizations now asking for public trust on AI governance. Assessing the credibility and policy weight of doomsday claims therefore requires scrutiny of the community’s intellectual lineage, social practices, and political influence.

Read on iankduncan.com177 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in Security

Hacking OpenAI

Hacking OpenAI

Hackers exploited two vulnerabilities, including a heap buffer overflow and an SSO misconfiguration, to access OpenAI employees' ChatGPT accounts and internal repositories. The attack demonstrated how quickly security flaws can be chained together to compromise sensitive systems within 72 hours. (hacktron.ai)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.