hn.today

We Need Smart People Who Give a Shit

violetpixel.com801 points400 comments
Screenshot of We Need Smart People Who Give a Shit

Complex systems often appear reliable not because their underlying design is sound, but because knowledgeable, committed people continually compensate for their flaws. The example is ACH, an old and fragile banking network that remains broadly safe, cheap, and dependable because experts understand its quirks and patch, bypass, or manually resolve failures. The same principle applies across infrastructure and software: people who know a system deeply can spot trouble early, handle unusual cases, and put in the effort needed to keep it running. A cluster of recent disruptions affecting Microsoft 365, air traffic control, United Airlines, the NSA, major banks, and Apple suggests that this human support may be thinning, even if the failures have no single immediate cause.

The central warning is that companies are replacing or sidelining such workers in the belief that generative AI can deliver equivalent output more cheaply. But AI does not understand systems or care about their consequences; its fluent text and code can conceal the absence of judgment, practical knowledge, and responsibility. Layoffs and AI-centered workflows also weaken the remaining experts by distancing them from the work, reducing their ownership and firsthand understanding. As that expertise declines, fragile systems become more likely to fail. The author frames this as a “hot stove” lesson for capitalism: leadership has been warned that treating AI as a substitute for skilled, invested people is dangerous, but may only learn after the resulting failures harm everyone.

Read on violetpixel.com400 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in Culture

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.