The piece argues that warnings from major AI companies about existential risk are genuine and not a cynical corporate plot to boost valuations or capture regulation. Evidence includes a 2024 survey of 1,580 AI researchers (mostly academics) in which over half assigned at least a 10% chance of human extinction or permanent severe disempowerment from AI, and 72% wanted more prioritization of safety research. Independent luminaries like Geoffrey Hinton and Yoshua Bengio have publicly shifted to activism over catastrophic risk, and numerous engineers and researchers (Paul Christiano, Daniel Kokotajlo, Jacob Coxon and others) have left lucrative positions, often forgoing millions, to found safety nonprofits or blow the whistle - actions inconsistent with a profit-motivated conspiracy.
Company leaders similarly voiced serious concerns long before founding or running major labs. Dario Amodei debated superintelligence risks in 2013 and later left OpenAI to found Anthropic after internal disputes about safety and cooperation; Sam Altman, Elon Musk, and DeepMind founders expressed regulatory and existential worries years before their companies scaled. The account emphasizes that these positions predate corporate incentives and that the regulatory-capture story would require implausible foreknowledge and strategically foolish behavior by many independent actors.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.
ChatGPT became widely used among students for solving problem sets, shifting academic dynamics. The physicist initially dismissed AI but later witnessed its growing influence in education and research. (thetheorygirlie.substack.com)
Aidlc introduces adaptive workflow steering rules for AI coding agents to improve their efficiency and reliability. It aims to enhance the lifecycle management of AI development processes. (github.com)
Felix Rieseberg discusses how to be more ambitious with AI by focusing on speed, altitude, depth, and range in tasks. He emphasizes raising abstraction levels and integrating knowledge across fields to unlock greater potential with AI tools like Claude. (felixrieseberg.com)
Geoffrey Hinton warns that AI development is creating alien-like beings and humanity has only a few years to adapt. He criticizes Donald Trump's understanding of superintelligence and emphasizes the need to prioritize human interests in AI progress. (theguardian.com)
Hardwired converts JavaScript code into a neural network that runs in a browser without GPU, with no training needed. It allows for real-time weight adjustments and complex tasks like search and parsing using WebGPU kernels. (chenglou.me)
Next-Concept Modeling (NCM) is a two-stage, coarse-to-fine framework that generates text faster and with better quality than existing diffusion language models. It uses hierarchical encoding and parallel prediction to outperform benchmarks in speed and accuracy across various tasks. (arxiv.org)
Today's best Hacker News stories, summarized and screenshotted, one email a day.