On this page

In this article, “citable case studies” means verified AI-failure incident reports: sourced accounts of real AI system failures, complete with technical analysis and documented fixes, published with permanent, citable URLs. Courts have already sanctioned attorneys for filing briefs with AI-hallucinated citations, and the record on this is no longer thin. Judges have treated fabricated authorities as competence failures under professional conduct rules, and in more than one case, defending the fabrication after the fact made the penalty worse than the original mistake.
The immediate action for anyone drafting with AI assistance:
- Verify every citation against a primary reporter or docket before it leaves your hands.
- Never let an AI tool’s confidence substitute for a resolved case name, docket number, or pin cite.
- Use a documented pre-filing checklist (see the verification runbook below) so verification is provable, not just claimed.
Key Takeaways
Courts sanction hallucinated legal citations as competence and candor failures, and concealment after discovery consistently increases the penalty beyond the original error.
| Point | Details |
|---|---|
| Definition matters | ”Citable case studies” here means sourced AI-failure reports with permanent URLs, not citation-formatting guides. |
| Verification is a gate, not a step | A named reviewer must resolve every citation against a primary source before filing, with no exceptions. |
| Cover-ups cost more than errors | Courts in Mata v. Avianca and the Brigandi lineage treated concealment or defense of fabrications as aggravating factors. |
| Disclosure mitigates sanctions | Sullivan & Cromwell’s public corrective letter shows proactive disclosure can limit further exposure. |
| Glitchive documents the pattern | Glitchive’s case repository provides sourced, citable incident reports with documented fixes for teams building AI governance. |
This article is general information, not a substitute for advice from a qualified lawyer. Consult a qualified legal professional about your own circumstances before acting on anything here.
Table of Contents
- How Do LLMs Produce Hallucinated Citations?
- What Happens When Courts Catch Hallucinated Citations?
- What Does a Pre-Filing Verification Runbook Look Like?
- What Do Verified Hallucination Cases Show?
- What Prevention Controls Actually Reduce Risk?
- Where Glitchive Fits in Verified AI Failure Documentation
- What Legal Teams Get Wrong About This Risk
- Get Verified AI Failure Reports From Glitchive
- Sources
- FAQ
How Do LLMs Produce Hallucinated Citations?
Large language models generate text by predicting the next most probable token, not by retrieving verified facts from a legal database. When a model is asked to cite authority for a proposition, it produces something that reads like a citation because citations follow a predictable pattern: reporter, volume, page, year. Nothing in that pattern check confirms the case exists.
This is fundamentally different from retrieval. A properly built retrieval-augmented generation (RAG) system pulls text from a fixed corpus and cites what it actually found. But RAG fails too, in three common ways: the corpus is stale or incomplete, the retrieval step returns a loosely related but wrong document, or a downstream editing pass overwrites a correctly retrieved citation with a model-generated one during “cleanup.”
Process failures compound the technical ones. Four patterns show up repeatedly in the court record:
- An AI draft goes through late-stage edits after the verification step, reintroducing unchecked citations.
- No single named reviewer is accountable for sign-off, so verification becomes everyone’s job and no one’s job.
- There’s no hard verification gate, meaning a document can be filed even with unresolved citations.
- Errors get compounded rather than caught, with a party filing a second brief that repeats or defends the fabricated authority.
Courts have also flagged a specific evidentiary tell: hallucinated opinions that look entirely plausible, with realistic party names, plausible court names, and internally consistent formatting, but that correspond to no real docket anywhere.
Pro Tip: Treat any AI-suggested citation as an unverified claim until you’ve personally opened the reporter or docket and confirmed the case exists with the language attributed to it. A citation that “sounds right” is not evidence it is right.
What Happens When Courts Catch Hallucinated Citations?
The consequences are documented, not hypothetical. In Mata v. Avianca, a federal court found that attorneys had filed a brief citing fabricated opinions generated by ChatGPT, and the judge imposed sanctions including a joint a monetary payment and orders to notify every judge named in the fake decisions. The court’s reasoning centered on subjective bad faith, not mere carelessness, and it specifically flagged the attorneys’ continued reliance on fabricated excerpts during the show-cause hearing as an aggravating factor.
Courts generally ground these sanctions in a handful of overlapping rules:
- Rule 1.1 (competence): an attorney must understand the tools used to prepare a filing, including their failure modes.
- Rule 3.3 (candor to the tribunal): citing nonexistent authority misleads the court regardless of intent.
- Rule 11 / local rules: attorneys certify that legal contentions are warranted by existing law after reasonable inquiry.
One pattern shows up across nearly every documented incident: the cover-up costs more than the mistake. Courts consistently treat re-filing, defending, or minimizing a fabricated citation as worse than the original error, because it turns a competence problem into a candor problem. A firm-level consequence follows too: disciplinary referrals, disqualification from a matter, and monetary penalties that in at least one case reached six figures combined.
What Does a Pre-Filing Verification Runbook Look Like?
A verification workflow only works if it is a hard gate, not a suggestion. Build it around five steps applied to every citation before a document leaves the building:
- Pull the citation from the draft and open the actual reporter, database, or court docket, not a search engine summary.
- Confirm the case name, court, date, and holding match what’s cited in the brief.
- Normalize the citation into a structured record (case name, docket number, resolved URL, verifier name, timestamp).
- If the citation cannot be resolved within a set time window, flag it and escalate to a named supervising attorney rather than guessing.
- Log the completed verification in an append-only record before the document is cleared for filing.
That structured record needs a home. Here’s a minimal schema teams can adapt:
| Field | Purpose |
|---|---|
| Verifier name | Assigns individual accountability for the check |
| Verification step | Records what was checked (reporter, docket, database) |
| Resolved reference | Docket number or permanent URL confirming the case exists |
| Timestamp | Establishes when verification occurred, relative to filing |
| Unresolved flag | Blocks export until a supervising attorney clears it |
On tooling, the strongest technical recommendation from incident postmortems is to treat authorities as immutable facts sourced only from vetted corpora, with a citation-resolution service that returns either a definitive match or a hard “unresolved” flag that blocks document export entirely. No silent pass-through. Enforcement matters as much as design: automated export blocking on unresolved citations, audit logs that can’t be edited after the fact, and periodic spot audits of filed documents against the verification log.
Pro Tip: If your verification tool can’t produce a timestamped log entry for a specific citation on demand, you don’t have a verification workflow. You have a policy document.
What Do Verified Hallucination Cases Show?
These summaries describe verified, court-documented incidents. Details are drawn from published orders and primary-source trackers; general lessons drawn from them are labeled as such.
- Mata v. Avianca (2023): A federal court found six fabricated ChatGPT-generated opinions in a filed brief. Sanctions followed, including a monetary payment and mandatory notice to the judges named in the fake cases. The court treated continued reliance on the fabricated material as an aggravating factor.
- TOV Realty (Connecticut Supreme Court, 2026): The state’s highest court held that Rule 1.1 competence requires independently verifying generative AI citations, and that remedial sanctions can be appropriate even without intent to deceive.
- Brigandi / Couvrette lineage (Oregon): A federal magistrate imposed combined penalties of roughly $110,000 and dismissed the case with prejudice after briefs contained numerous nonexistent cases and fabricated quotations, criticizing attempts to minimally correct the record as aggravating conduct.
- Sullivan & Cromwell (Chapter 15 filing, 2026): The firm discovered AI-generated hallucinations in its own filing and issued a public corrective letter with a Schedule A cataloguing every correction, using disclosure and remediation to limit further exposure.
The throughline across these orders isn’t the existence of the error. It’s what happened in the hours after discovery. One firm buried it and got dismissed with prejudice. Another disclosed it publicly, in writing, with a corrected schedule attached, and used candor to shrink the consequence.
What Prevention Controls Actually Reduce Risk?
The controls that hold up under scrutiny combine policy, engineering, and enterprise AI governance, not just one of the three.
- Make verification mandatory and require a named individual’s sign-off on every citation, not a team-level checkbox.
- Build retrieval-only pipelines for authorities so a model can summarize retrieved case text but never originate a citation from its own generation.
- Run periodic spot audits comparing filed documents against verification logs, not just at intake.
- Train staff on the actual failure mechanism (probabilistic generation, not retrieval) so “the AI cited it” stops sounding like a defense.
- Disclose an error the moment it’s found. Courts and firms that self-report and correct in writing consistently see this treated as mitigating, not incriminating.
Pro Tip: Draft your disclosure letter template before you need it. The firms that handled disclosure well moved fast because the format and approval chain already existed.
Where Glitchive Fits in Verified AI Failure Documentation
Glitchive maintains a repository of verified AI failure incidents, each with permanent, citable URLs and sourced references, following an editorial verification process detailed in its methodology. Citing a Glitchive case page in technical or academic work works the same way as citing a court order: link the specific case URL, not the homepage, so the claim traces to its source.
- Each entry documents the incident, contributing factors, and the specific remediation applied.
- Related incidents, like a support chatbot that invented a refund policy, follow the same documentation standard.
What Legal Teams Get Wrong About This Risk
The conventional advice, “double-check AI output,” undersells the actual failure pattern. Verification isn’t the hard part. Verification isn’t a hard problem, but it is one nobody has forced to be mandatory. Every documented sanction case involved a moment where a human could have caught the error and didn’t, usually because no one was specifically accountable for catching it.
The bigger blind spot is what happens after discovery. Most firms build policies around prevention and almost none around disclosure, but the record shows the disclosure decision carries more weight with courts than the original mistake. Sullivan & Cromwell’s outcome and the Brigandi lineage aren’t different because one firm used better AI. They’re different because one firm treated the discovery moment as a compliance event and the other treated it as a problem to manage quietly.
If you take one thing from this record: build the disclosure protocol with the same rigor as the verification gate. Courts consistently reward candor and punish concealment, sometimes by an order of magnitude.

Get Verified AI Failure Reports From Glitchive
Legal teams building internal AI governance rarely have time to reconstruct case law from scattered court trackers and law firm blog posts. Glitchive is built for exactly that gap: a searchable library of verified AI failure incidents, each documenting what went wrong, why, and the specific fix applied, with permanent URLs you can cite directly in a compliance memo or internal training deck. Unlike a general legal-tech blog, every entry traces back to a primary source, so the citation you pull from Glitchive holds up the same way a docket number does.
Browse the full case index to find incidents relevant to your stack, from legal drafting to coding agents, and start building your team’s verification training around documented, sourced failures instead of secondhand summaries.
Sources
- Mata v. Avianca, Inc.: Opinion and Order on Sanctions | AI Court Tracker | Open Bankruptcy Project
- Connecticut Supreme Court: Duty of Competence Requires Independent Verification of Generative AI Citations; Sanctions for “Hallucinated” Authorities
- Brigandi case: How a $110,000 AI hallucination sanction rewrites risk for legal AI systems | CoreProse
- Compliancehub
FAQ
What Counts as a Citable Case Study for AI Failures?
A citable case study is a sourced, verifiable incident report documenting an AI failure, its causes, and its fix, published with a permanent URL, as opposed to an unverified anecdote or marketing claim.
Which Court Case First Established Sanctions for AI-Hallucinated Citations?
Mata v. Avianca in 2023 is the widely cited federal case where a court sanctioned attorneys for filing a brief with six fabricated AI-generated opinions.
Can a Lawyer Be Sanctioned Even Without Intent to Deceive?
Yes. The Connecticut Supreme Court’s TOV Realty ruling held that remedial sanctions can apply under competence rules even absent intent to deceive.
Does Self-Reporting an AI Citation Error Reduce Penalties?
Documented cases suggest it can. Sullivan & Cromwell’s proactive public disclosure and corrective schedule are treated as an example of remediation that limits further sanction exposure.
Where Can Engineers and Legal Teams Find Verified AI Failure Reports?
Glitchive maintains a repository of verified AI failure case studies with documented fixes and citable URLs, covering legal, support, and engineering incidents.