Yes, AI regularly cites sources that do not exist. Language models fabricate studies, court cases, and DOIs that look completely real, then hand them to you in the same confident voice they use for genuine ones. Independent tests put the fabrication rate anywhere from 18 percent to more than 50 percent depending on the model. Verify every citation before you publish it.
This is not a rare glitch that a better model will iron out. It is a direct consequence of how these systems generate text, and it has already sanctioned lawyers, slipped past peer review, and forced newsrooms into mass corrections. This guide walks through the documented cases, the mechanism underneath them, the subtler failure that most citation checkers miss, and a practical way to catch a fabricated source before it ships with your name on it.
The disasters: when invented sources got published
The fastest way to understand the problem is to look at the people who got caught by it, professionals with every reason to check who trusted the output because it looked right.
The original example is Mata v. Avianca. In 2023, New York attorney Steven Schwartz used ChatGPT to write a brief that cited six court cases which did not exist, including a fictitious Varghese v. China Southern Airlines. ChatGPT even assured him the cases could be found in Westlaw and LexisNexis. Judge P. Kevin Castel sanctioned the lawyers and their firm 5,000 dollars, and the case became a cautionary headline worldwide (opinion and order). It was not a one-off from a careless solo practitioner. In April 2026, Sullivan and Cromwell, one of the most prestigious firms in the world, admitted to a federal bankruptcy judge that one of its filings contained AI-fabricated citations, more than 40 errors in all, including quotations attributed to the court that were never said. Opposing counsel caught it, not the firm's own review (reported by Bloomberg Law and CNN, April 2026).
These are not isolated headlines. Researcher Damien Charlotin maintains a public database of court decisions involving AI-hallucinated content; by mid-2026 it had logged more than 1,600 cases worldwide, and the count climbs almost daily. And the problem is not confined to law. A Columbia University School of Nursing audit published in The Lancet in May 2026 verified 97 million references across 2.5 million biomedical papers and found 4,046 fabricated citations, sources that do not exist in any scientific database, across 2,810 published, peer-reviewed papers (Columbia). A separate Nature investigation the same year estimated that more than 110,000 papers published in 2025 may carry invalid, AI-generated references (Nature).
A few of the documented cases
| Case | What the AI invented | What it cost | Year |
|---|---|---|---|
| Mata v. Avianca | Six court cases, including a fictitious Varghese v. China Southern Airlines | $5,000 sanction and worldwide headlines | 2023 |
| Sullivan & Cromwell filing | ~28 fabricated or misquoted citations in a court brief | Public apology to a federal judge | 2026 |
| Columbia / The Lancet audit | 4,046 fake references across 2,810 papers | Invented sources inside peer-reviewed science | 2026 |
| Nature investigation | An estimated 110,000+ papers with invalid AI references | Polluted scientific literature | 2026 |
The through-line is not carelessness. It is that a fabricated citation looks exactly like a real one, so normal review slides right over it. For the full running catalogue across law, academia, and media, see our reference of AI fake-citation disasters.
Why a language model invents a citation
To catch the failure reliably, it helps to understand why it happens, because the reason tells you exactly where to look.
A language model does not retrieve a citation from a database. It generates the most probable next token, one after another, based on patterns in its training data. A citation has a highly predictable shape, an author, a year, a journal, a volume, a page range, so the model can produce a flawlessly formatted reference with nothing real behind it. The format is easy to fake; the object it points to is not something the model ever checked. That is the whole trick. It is also why the same failure runs underneath why AI citations are wrong and traces back to the structural cause of AI hallucination.
The obvious fix, give the model a real database to draw from, helps but does not solve it. A 2024 Stanford study tested the leading grounded legal research tools, the ones sold specifically to eliminate hallucination, and found that Lexis+ AI and Westlaw's AI-Assisted Research still hallucinated between 17 and 33 percent of the time, with Westlaw's tool wrong about a third of the time (Stanford HAI). Retrieval narrows the gap; it does not close it.
The raw rates are worse than most people assume. In controlled studies, ChatGPT-3.5 fabricated roughly half of its references, 47 percent in one Cureus analysis and 55 percent in Scientific Reports. GPT-4 cut fabrication to about 18 percent, real progress, but among the citations that were genuine it still got substantive details wrong about a quarter of the time (Walters and Wilder). And newer does not mean safe: a 2026 benchmark of legal citations found GPT-5.1 fabricated references at 6.57 percent, up from 1.23 percent for the GPT-4o release a year earlier (Who Checks the Citations?). The number moves with the model and the topic. It never reaches zero.
The harder failure: real source, wrong claim
Most people picture one kind of fake citation: a source that simply does not exist. That one is comparatively easy to catch. The more dangerous failure is a real source, cited correctly, that does not say what the AI claims it says.
The same benchmark that counted fabricated legal citations sorts the failures into five distinct types, and only the first is caught by checking whether a link resolves. The model can point you to a genuine paper that argues the opposite of the claim. It can attach a real, working DOI that opens an unrelated study. It can quote a source that never contained the quote. Each of these passes the shallow test, does the link work, while still being wrong.
Five ways an AI citation fails
| Failure type | What it looks like | Caught by a link check? |
|---|---|---|
| Non-existent source | The paper or case does not exist at all | Yes |
| Wrong source | A real, working DOI that opens an unrelated paper | No |
| Wrong location | Real source, but the wrong page or section | No |
| Misquote | A quote attributed to a real source that never said it | No |
| Misrepresentation | Real source that does not support the claim | No |
This is not a rare edge case. When researchers checked ChatGPT-5's citations against the papers it was citing, roughly a third of its claims misrepresented what the real, correctly-cited source actually said (Journal of Technology in Behavioral Science, 2026). A separate study found that of the fabricated citations that came with a DOI, 64 percent resolved to a real but unrelated published paper, so someone clicking the link would land on a legitimate article and assume the citation checked out (JMIR Mental Health, 2025). This is exactly why a citation checker that only confirms the URL loads gives you false confidence. The link working is not the question. Whether the source says what the AI says it says is the question.
Why asking the AI to check itself fails
The instinct almost everyone reaches for is to ask the same AI whether its citation is real. It does not work, and understanding why points straight at what does.
A model asked to verify its own output runs the same probability distribution that produced the citation in the first place. If it invented a reference because the pattern looked right, then asking is this reference real returns the same confident yes, for the same reason, because nothing independent has entered the loop. Re-pasting into a fresh window of the same model is weaker than it feels, too: same architecture, same training, same blind spots. Real verification requires independence, a source of judgment that was trained differently and does not share the original error. This is the core of why <a href="/blog/why-ai-cant-check-its-own-work" class="text-cyan-400 hover:text-cyan-300 underline">AI cannot check its own work</a>.
This is the exact gap TrueStandard is built to close. Instead of trusting one model to grade itself, it runs your draft across four to five frontier models from different labs at once. A source that only one model recognizes, because only that model hallucinated it, is precisely what the others fail to corroborate, and that disagreement is the flag. Independence is the mechanism, not more careful reading.
How to catch a fake citation before you publish
You do not need to become a forensic librarian. You need a habit and, for anything you publish at volume, a faster version of it.
Start with the mindset shift: treat every AI-produced citation as a claim to verify, not a fact you already have. Then go to the primary source and ask two questions, not one. Does this source exist, and does it actually say what the draft claims? Checking only the first, does the link resolve, is what lets misrepresented and misquoted sources through. For a single high-stakes citation, tracing it by hand is the gold standard and worth the few minutes. The problem is that hand-checking every citation in every draft under a deadline does not scale, which is why most people skip it and hope.
The efficient version keeps the independence and drops the manual grind: ask several models trained by different labs the same question and read where they disagree. A source that one model fabricated cannot be corroborated by models that never shared the hallucination, so a fabricated citation shows up as a split rather than a consensus. When independent models converge, that agreement is a real signal the source is sound. When they diverge, they have pointed you at the exact citation a human needs to confirm, instead of leaving you to reread the whole draft hunting for the one that is wrong.
Ways to check an AI citation, compared
| Method | What it catches | Time cost |
|---|---|---|
| Ask the same AI to check itself | Little; it shares the original blind spot | Seconds |
| Click the link to see if it resolves | Only fully-invented sources; misses misrepresentation | Seconds |
| Trace each citation to its primary source by hand | Nearly everything, if you have the time | High, per citation |
| Cross-check across independent models | Fabrications, plus the exact claims to verify | About 60 seconds |
That last row is what TrueStandard does automatically. Paste your draft, and four to five frontier models from different vendors check every claim and citation in parallel; in about 60 seconds you get back the ones they cannot agree on, ranked by how far apart they are. If you want the manual method first, our guide to checking whether AI citations are fake walks through it step by step, and how accurate is ChatGPT puts the wider error rate in context.
Frequently Asked Questions
Does ChatGPT make up citations and sources?
Yes, routinely. Because a language model generates the most probable text rather than retrieving a real record, it can produce a perfectly formatted citation, author, journal, year, DOI, with nothing real behind it. In controlled studies, fabrication rates ran from about 18 percent for GPT-4 to over 50 percent for GPT-3.5, and even retrieval-grounded tools still fabricated 17 to 33 percent of the time. Treat any AI citation as unverified until you check it.
Why does AI invent citations?
A citation has a very predictable structure, so it is easy for a model to generate a convincing one from pattern alone. The model was never checking a database; it was predicting what a plausible reference looks like. The format is trivial to fake, and the underlying source is something the model never actually consulted, which is why the reference can look flawless and still point to nothing.
How common are fabricated AI citations?
Common enough to assume it will happen. Lab studies measured fabrication rates of roughly 47 to 55 percent for GPT-3.5 and about 18 percent for GPT-4, and a 2024 Stanford study found that grounded legal AI tools still hallucinated 17 to 33 percent of the time. In the wild, a 2026 audit found fabricated citations in nearly 3,000 peer-reviewed medical papers, so the problem is reaching published work, not just draft output.
If the citation link works, is the source real?
Not necessarily. A working link only tells you a page exists, not that it supports the claim. In one 2025 study, 64 percent of fabricated citations that included a DOI resolved to a real but unrelated paper, so the link opened a legitimate article that had nothing to do with the claim. You have to check whether the source actually says what the AI says it says, not just whether it loads.
Can AI check whether its own citations are real?
No, not reliably. Asking a model to verify its own output runs the same process that produced the error, so it tends to confirm a fabricated citation with the same confidence it invented it. Re-pasting into a fresh window of the same model has the same blind spot. Reliable verification needs independence, either a human tracing the primary source or several models trained by different labs cross-checking each other.
How do I check if an AI citation is real?
Go to the primary source and ask two things: does it exist, and does it actually support the claim. For a single important citation, trace it by hand. For a whole draft, run the claims across several independent models and look for disagreement, since a fabricated source cannot be corroborated by models that did not share the hallucination. That points you at exactly which citation to confirm.
Which AI hallucinates the fewest citations?
It varies by model and topic, and newer does not reliably mean safer, one 2026 benchmark found a later GPT model fabricated legal citations more often than an earlier one. Picking a single best model is not a fix, because whichever one you choose still fabricates on the specific claims that matter most. The durable answer is to verify with independence rather than to trust one model.
Keep reading
Why AI Hallucinations Are Structural
DELEGATE 52, GPT-5.5, and a Purdue impossibility proof. Three April 2026 results that move 'hallucinations are structural' from take to documented fact.
Why AI Citations Keep Showing Up Wrong
A 12-fold rise in fake biomedical references, four legal sanctions in 30 days, public defenders flooded with ChatGPT case theories. The same failure shape, across professions.
How to Check If AI Citations Are Fake
Four checks catch a fabricated reference before your readers do. One of them is new: in 2026, a DOI that resolves no longer means the citation is real.
AI Detector vs Fact Checker
One asks who wrote this. The other asks is this true. Before you publish, only one of those questions protects your reputation — and most teams are watching the wrong one.
Can One AI Reliably Fact-Check Another AI?
If ChatGPT wrote the draft, can Claude safely verify it? Sometimes helpful, not sufficient by default — and the reason is what these models share, not what they don't.
Catch the Fake Citation Before Your Readers Do.
AI fabricates sources that look identical to real ones, and a working link does not mean the source is real. Paste your draft into TrueStandard and four to five frontier models check every claim and citation in about 60 seconds, flagging the ones they cannot corroborate before your readers or your editor find them first.
Check Your Draft →