hn.today

OpenAI: Strengthening the fight against online child sexual abuse

openai.com125 points319 comments
Screenshot of OpenAI: Strengthening the fight against online child sexual abuse

OpenAI’s effort to strengthen CSAM detection drew both reports of practical enforcement and complaints about how automated systems affect users. One business owner says an agent mistakenly sent more than 100,000 old user-uploaded images to OpenAI for classification; after an account ban, the company allegedly refused to explain the incident or help identify and report the uploader. Other commenters describe detected uploads triggering reports to NCMEC and, in some cases, rapid police investigations. Supporters argue that AI-generated abuse material is increasing the workload on investigators, who must determine whether images are real, and that automated screening could spare them further exposure to disturbing content. Some also note that major providers already scan content, including on certain data-retention-limited services.

Critics see the policy as liability management, public relations, or a pretext for expanding surveillance and data collection. They worry that classifiers can misidentify ordinary family or medical images, leaving users banned without meaningful explanations or appeals; some say reporting AI-generated material does little to protect real children. Others frame the issue as a difficult trade-off between preventing abuse and protecting privacy, while questioning whether scanning personal files is an acceptable answer. Defenders of strict enforcement counter that platforms face serious regulatory risks, that human review is harmful, and that revealing details about detection could help offenders evade it. Some also fault businesses for sending potentially prohibited material to a service that does not accept it.

Read on openai.com319 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.