hn.today

Satya Nadella Rethinks Whether More Powerful AI Is Safer

businessinsider.com6 points1 comments
Screenshot of Satya Nadella Rethinks Whether More Powerful AI Is Safer

Microsoft CEO Satya Nadella says he has revised his view that better AI capabilities would naturally produce safer, more human-aligned systems. Speaking on the 20VC podcast, he said he once expected alignment - the process of ensuring AI follows human values and goals - to “fall out” as models improved. Scaling has broadly progressed as he anticipated, but alignment has not automatically followed. He now sees it as a distinct and potentially harder problem, rather than a safety benefit that comes along with greater intelligence.

Nadella’s revised position supports his call for practical safeguards around increasingly capable AI. In an October 10 post on X, he urged companies to treat models as potential insider threats and assume they could be compromised. He argued for enclosing unpredictable models within reliable, deterministic system designs, with human oversight, robust operating procedures, and industry standards where current rules are inadequate. His concerns echo warnings from OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei, as well as a July letter signed by more than 1,000 AI workers. The signatories cautioned that AI capabilities may advance faster than people’s ability to understand or control them. Nadella’s central point is that progress in capability does not itself guarantee control; safety requires deliberate engineering and governance.

Read on businessinsider.com1 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.