Provenance record

ChatGPT-using lawyer punished for citing fake testimony from made-up witnesses

Ars Technica: AI (tier 1, news) 2026-09-11T19:34:09.000Z Original ↗

Discourse valence
-62
Adverse
confidence 85% · 5 items · range -100 to -40
Adverse readingFavourable reading
Consensus of 5 models from different labs. Spread 60 points, agreement low.
Existential and catastrophic riskSynthetic media and manipulationConcentration of power
Excerpt as ingested

The New Mexico Supreme Court held a ChatGPT-using lawyer in direct contempt of court for submitting a brief with "false testimony from wholly fabricated witnesses," including fake police testimony and other mistakes. The state's top court referred the lawyer to a disciplinary board for further proceedings and concluded that he "demonstrated a lack of remorse and a lack of concern for his client." Attorney Stephen Aarons "admitted to the Court that he did not verify the factual claims and legal authority in his AI-generated brief before signing it and filing it with the Court, and that he did not inform his client of this failure or that the brief in chief contained multiple factual and legal misrepresentations," the state Supreme Court said in an order on Wednesday. Aarons has been a criminal defense lawyer in New Mexico for over 40 years and was hired by a defendant's family members to appeal a murder conviction. Aaron's now-former client, Oscar Renee Sandoval, was sentenced to life in prison in February 2025 after being convicted of killing Shiereen Al-Jibury, who was his partner and the mother of his children. Read full article Comments

Every model that read this

ModelProviderStageScoreConf.LatencyPromptWhen
Llama 3.3 70BMetaanalysis -75 80%3520ms v1.0.0 / m1.0.1 2026-09-12 00:17
GPT-4.1 miniOpenAIconsensus -40 90%4200ms v1.0.0 / m1.0.1 2026-09-12 00:17
Claude Sonnet 5Anthropicconsensus -40 75%5159ms v1.0.0 / m1.0.1 2026-09-12 00:17
Gemini 2.5 FlashGoogleconsensus -100 90%2316ms v1.0.0 / m1.0.1 2026-09-12 00:18
Mistral Small 3.1 24BMistral AIconsensus -55 90%5858ms v1.0.0 / m1.0.1 2026-09-12 00:18
Llama 3.3 70B · reading

AI-generated brief led to false testimony

evidence: reported horizon: n/a
GPT-4.1 mini · reading

The lawyer's submission of AI-generated false testimony without verification shows a risk of AI misuse in legal contexts, undermining justice and potentially harming defendants. This event reflects concerns about negligence and trust with AI assistance in critical professions. The evidence is solid and the implication material but not extreme.

evidence: reported horizon: now capability 50 societal 0 existential 0 economic 0
Claude Sonnet 5 · reading

This is a concrete, documented case of AI misuse causing real harm in a high-stakes legal proceeding, with institutional accountability following. It illustrates a recurring failure mode of unverified AI output in professional contexts rather than a systemic AI risk to society broadly.

evidence: reported horizon: n/a
Gemini 2.5 Flash · reading

An attorney used AI to generate legal arguments, leading to the submission of fabricated evidence and testimony to the Supreme Court. This direct and unverified reliance on AI severely compromised professional obligations and the legal process, resulting in punishment for the attorney and potential harm to the client's appeal. The incident demonstrates a clear, negative impact on human flourishing within the justice system.

evidence: reported horizon: n/a
Mistral Small 3.1 24B · reading

A lawyer's misuse of AI led to false testimony and legal misrepresentations. This highlights risks of AI misuse in critical fields. The lawyer's lack of verification and remorse exacerbates the concern.

evidence: primary horizon: n/a existential 0

Evidence extracted

The chain
SOURCE     Ars Technica: AI (tier 1)
   ↓
DOCUMENT   c098c193-cf45-43cf-a134-0899a0a3a2a1
           https://arstechnica.com/tech-policy/2026/09/chatgpt-using-lawyer-punished-for-citing-fake-testimony-from-made-up-witnesses
   ↓
EVIDENCE   3 extracted excerpts
   ↓
MODEL RUN  5 runs, methodology 1.0.1
   ↓
SCORE      -62  (Adverse)
   ↓
CONFIDENCE 85%