Both lawyers in case use hallucinating AI, causing judge to throw up hands, bar them for 2 years, fine everybody, and call the whole thing off for 60 days
In a case described as a “comedy of AI errors,” both lawyers representing opposing sides in a dispute between Tom Withers and the city of Aberdeen relied on hallucinating AI tools to generate legal citations, prompting a judge to impose strict sanctions. When the legal teams submitted arguments containing entirely fabricated case law created by large language models, the judge responded with frustration and unprecedented action.
The judge imposed a two-year ban on both lawyers from using AI in courtroom proceedings, issued fines to all parties involved, and declared a 60-day recess on the case itself. The incident exemplifies a troubling trend of legal professionals incorporating unverified AI-generated content into courtrooms, despite large language models’ well-documented tendency to produce convincing but entirely fictional legal citations.
This case underscores critical gaps in AI literacy among legal professionals and the dangers of deploying LLMs in high-stakes environments where accuracy is paramount. Legal citations require precision and verification; fabricated references undermine case arguments and waste court resources. While AI tools offer potential efficiency gains in legal research and writing, this incident demonstrates the essential importance of thorough human verification and proper understanding of AI limitations before integrating such technology into professional legal practice.