Four Black current and former students in Baltimore County, Maryland, are suing the company behind an AI gun-detection system, the county school district and officials, and local police. The case concerns an October 2025 incident at Kenwood High School, when Omnilert Gun Detect reportedly mistook a student’s bag of Doritos for a firearm and issued an alert indicating a 90% likelihood of a gun on campus. Although school staff and police reviewing the image recognized the mistake and cancelled the alert, armed officers were dispatched because procedures did not stop cancelled alerts from triggering a response. The students were ordered to their knees, handcuffed, and searched outside the school.
The lawsuit alleges that the technology’s false alarm and failures by school and police personnel violated the teenagers’ constitutional rights and amounted to negligence and gross negligence, among other claims. The students seek changes requiring officials to verify AI-generated threats, assess whether such systems belong in schools, and establish safeguards against armed responses to false alerts. They also call for stronger training, oversight, transparency about errors, and community input. The case raises broader concerns about relying on AI in public-safety decisions where mistakes can have severe consequences, particularly given the disproportionate harms such systems may cause to Black people and other people of color.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.