hn.today

Black high school students sue after AI mistakes Doritos bag for gun

lawyerscommittee.org117 points89 comments
Screenshot of Black high school students sue after AI mistakes Doritos bag for gun

Four Black current and former students in Baltimore County, Maryland, are suing the company behind an AI gun-detection system, the county school district and officials, and local police. The case concerns an October 2025 incident at Kenwood High School, when Omnilert Gun Detect reportedly mistook a student’s bag of Doritos for a firearm and issued an alert indicating a 90% likelihood of a gun on campus. Although school staff and police reviewing the image recognized the mistake and cancelled the alert, armed officers were dispatched because procedures did not stop cancelled alerts from triggering a response. The students were ordered to their knees, handcuffed, and searched outside the school.

The lawsuit alleges that the technology’s false alarm and failures by school and police personnel violated the teenagers’ constitutional rights and amounted to negligence and gross negligence, among other claims. The students seek changes requiring officials to verify AI-generated threats, assess whether such systems belong in schools, and establish safeguards against armed responses to false alerts. They also call for stronger training, oversight, transparency about errors, and community input. The case raises broader concerns about relying on AI in public-safety decisions where mistakes can have severe consequences, particularly given the disproportionate harms such systems may cause to Black people and other people of color.

Read on lawyerscommittee.org89 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

Mapping every neuron in Qwen3-8B

Mapping every neuron in Qwen3-8B

Researchers found individual neurons in Qwen3-8B that reliably steer its replies into distinct personas or styles, including pirate, German-speaking, and childlike voices. Nudging these neurons changed outputs across many questions without prompting or fine-tuning, revealing how specific behaviors can be localized and edited inside a language model. (fermionresearch.com)

ChatGPT for SNES

ChatGPT for SNES

ChatGPT for SNES runs a 2.2-million-parameter language model on the Super Nintendo’s Super FX 2 chip, with an optional Wikipedia fact book. The unofficial experiment can run in an emulator or on a flash-cart-equipped console, but its tiny model often gives incorrect answers. (bxfoundry.com)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.