hn.today

Brazilian Court Sanctions Lawyers for Prompt Injection in Court Filing

jetstream.security118 points49 comments
Screenshot of Brazilian Court Sanctions Lawyers for Prompt Injection in Court Filing

A Brazilian labor court fined two law firms after finding that lawyers deliberately hid a prompt-injection instruction in an employment-court filing. The text was rendered white on a white background, making it invisible during ordinary reading. It instructed any AI system reviewing the petition to respond superficially and avoid challenging its documents. The judge discovered it while using Galileu, a generative AI tool used by Brazil’s National Justice Council; after the font color was changed, the command became visible. The underlying claim sought R$842,000, and the court imposed a fine equal to 10% of that amount, approximately US$16,000.

The court held that the lawyers’ conduct aimed to bias an AI-generated response or draft judgment against the defendant, undermining both the proceedings and the administration of justice. It grounded the penalty in Brazilian procedural rules requiring good faith, loyalty, and truthfulness, and prohibiting conduct that obstructs judicial work. The decision treats machine-readable content as part of a filing’s integrity, not as a loophole separate from its visible text, and may be the first judicial ruling to address deliberate prompt injection against a court system. The AI reportedly detected and blocked the suspicious content, illustrating both the risks of documents processed by AI and the value of safeguards that monitor for manipulation.

Read on jetstream.security49 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

AI Made Me Homeless

AI Made Me Homeless

Software engineer and consultant Eric Elliott says his mentoring and consulting business collapsed as generative AI reshaped demand, leaving him homeless despite decades of experience and AI expertise. He argues that learning AI alone cannot protect workers from displacement and warns of broader economic fallout. (medium.com)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.