AI accuracy and fact-checking, tested

Tests and guides on where AI gets facts and citations wrong, for writers who publish AI-assisted drafts. Where we ran the test ourselves, the data is on the page.

AI Architecture 9 min read

What Is Context Rot?

An agent gets less reliable as notes, history and tools pile up. Here are four ways it fails.

Read article
AI Verification 11 min read

Four AI Models vs One at Fact-Checking: 600 Claims Tested

We sell a fact checker that asks four AI models at once. So we tested whether four beat one. On 600 hard claims, the four models flagged about half of the true ones as false. One cheap model did the same. One of the four, alone, did far better than the group.

Read article
AI Reliability 9 min read

Jev Images Tested Against Three Vision LLMs

We gave Jev 1.14 and three cheap vision models 360 screenshots of AI search answers. Jev and Claude Haiku 5.5 made no mistakes. Jev was 3 to 7 times faster and the cheapest per image.

Read article
AI Writing 6 min read

Does Gemini Use Em Dashes? Fewer, but More AI Words

We gave Gemini 3.7 Flash and Gemini 3.8 Flash the same 35 writing jobs as Claude and GPT, three times each. Then we counted every em dash and 22 other AI writing tells. In October we added Gemini 4 Argon, and in November three more Gemini 4 models.

Read article
AI Reliability 9 min read

We Put Jev in Our Pipeline and Saved Nothing

The per-judgment price said we would cut the bill by a quarter. Measured against the real pipeline, it saved nothing at all. The reason is more useful than the saving would have been.

Read article
AI Reliability 10 min read

Can Jev Fact-Check Claims? It Declined 12 of 13

We handed TypeSafe's decision model thirteen factual claims with nothing to check them against. It refused to guess on twelve of them, and that is the best thing we can say about it.

Read article
AI Reliability 11 min read

Is Jev Really 193x Faster?

We measured the same model two ways and got 1.7x and 100x. Both numbers are honest. What separates them is the thing you put on the other side.

Read article
AI Reliability 12 min read

How Accurate Is Jev? Jev 1.14 and 1.13 Tested on 108 Claims

On 108 claims checked against their sources, Jev 1.14 matched Jev 1.13's 96.3 percent in two of three runs. It scored 91.7 percent on the hardest ones, where two cheap chat models fell to the low eighties. Its calibration, how well its stated confidence matches how often it is right, was no better than theirs.

Read article
AI Reliability 9 min read

Can ChatGPT Check Your Citations?

Eight AI judges graded the same answer with live sources, dead sources and none. Two could tell live from dead, and only from memory.

Read article
AI Verification 10 min read

AI Fact-Checker False Positive Rate: We Measured Ours

We measured how often our checker flags a true claim, on 30 labelled claims. Recall is easy to advertise, since a tool that flags everything scores 100 percent on it. How often a checker flags something true decides whether you can use it. The more useful result was what our test could not tell us.

Read article
AI Reliability 11 min read

Why Hallucination Benchmarks Disagree

Hallucination benchmarks disagree because they ask different questions. Changing only the question set moved one model from 10.9 to 30.9 percent. Changing the model, across nine of them, moved it from 8.3 to 33.1.

Read article
AI Reliability 8 min read

Does Claude Fable 5 Hallucinate Less?

It leads AA-Omniscience with a score of 40, the highest recorded. Artificial Analysis says that score comes from accuracy, not from low hallucination. And 9% of its answers came from a different model.

Read article
AI Reliability 12 min read

AI Model Rankings Don't Measure Truth. We Ran the Missing Test.

A developer who built a $200k business on AI ranked 11 companies and 17 models across six categories. It is a good ranking. But in 27 minutes the words hallucination, accurate and sycophancy never come up. And one model gets marked down, in so many words, for checking its work. So we ran the missing column ourselves: nine models, both failure modes, three times each. It separates, and it does not agree with any capability ranking.

Read article
Model Selection 11 min read

We Benchmarked the Models Behind Our Own Product

Six jobs in our product each pick an AI model. Exactly one of those choices had ever been tested. We built a deterministic benchmark. It ran 227 graded calls against a slate of four to five candidates. We changed five of the six. Two of the tables decided nothing. One of our own test labels turned out to be wrong. And the exercise found three bugs it was not looking for.

Read article
AI Reliability 10 min read

Does GPT-5.6 Fabricate Fewer Citations Than GPT-5.5?

We asked both generations for peer-reviewed sources on the same 30 claims, on the same day. We resolved each DOI they produced against a real registry. GPT-5.6 came out lower. Then we noticed something in the data that matters more than which model won.

Read article
AI Reliability 9 min read

Does Grok 4.5 Fabricate Fewer Citations Than 4.3?

Grok 4.5 shipped on 8 July, and our benchmark ran three weeks later. It tested Grok 4.3, so the number we published was already a generation old. To fix that, we ran both models through the same 30 claims on the same day. The rate dropped from 11.1% to 4.4%, and here is why we are not calling that a win.

Read article
AI Reliability 12 min read

Which AI Fabricates Citations? We Tested Four Models

We asked four frontier models for peer-reviewed sources on 30 claims. Then we resolved every DOI they gave us against Crossref and DataCite, and 21 of 146 did not exist. The fabrication rate varies three and a half times between vendors. Every fake landed on a claim that has real literature behind it.

Read article
AI Reliability 11 min read

AI Hallucination Rates in 2026, by Model

On hard factual questions, AI hallucination rates across 26 top models run from 22 to 94 percent, per the Stanford AI Index 2026. Each number here names the benchmark it came from and what that benchmark measured.

Read article
AI Architecture 12 min read

Why the Best AI Systems Use Multiple Models

In 2026, the strongest AI systems stopped trusting one model. They send each task to a different one. That choice has a plain lesson for anyone who publishes AI-assisted work.

Read article
AI Verification 12 min read

Is AI Deep Research Reliable?

Deep research tools are fast, fluent, and wrong about their sources more often than not. Here is what the audits found, and the two-part fix.

Read article
AI Reliability 11 min read

Why AI Can't Check Its Own Work

A model carries the same blind spots into review that it had while writing. Dressing it up as a critic is a costume, not a second mind.

Read article
Comparisons 9 min read

TrueStandard vs Omniscient AI

Both run several models, and both show where those models agree. The difference is the moment each one is built for. Omniscient checks what you are reading. TrueStandard checks what you are about to publish.

Read article
AI Reliability 12 min read

AI Fake-Citation Disasters: A 2026 Reference

A running list of documented cases where AI made up citations in law, academia, and media. Every entry is sourced, and it is here to be linked, cited, and updated as new cases surface.

Read article
AI Verification 10 min read

Are AI Detectors Accurate? They Ask the Wrong Question

They flag honest writers and mark famous human documents as AI, and OpenAI shut down its own detector. The deeper problem is the question itself. Knowing 'was this written by AI?' has never protected anyone who publishes.

Read article
Comparisons 9 min read

GPTZero Hallucination Detector, Explained

It catches citations that don't exist. By GPTZero's own admission, it does not check whether what you wrote is true. Here is exactly what its hallucination and source tools do. Here is where the gap is, and what closes it.

Read article
AI Reliability 15 min read

When AI Cites Studies That Don't Exist

AI can invent whole sources: court cases, studies and DOIs. A DOI is the permanent ID that links a citation to its paper. AI cites fake ones with the same confidence it uses for real ones. Here is why it happens, the damage so far, and how to catch a fake before your name is on it.

Read article
AI Reliability 12 min read

How Accurate Is ChatGPT?

Independent benchmarks put frontier models, ChatGPT included, at 17 to 34 percent hallucination on factual claims. Its accuracy depends on the question, and it is reliable on well-documented basics.

Read article
AI Architecture 12 min read

Why AI Hallucinations Are Structural

DELEGATE 52, GPT-5.5, and a Purdue impossibility proof. Three April 2026 results that move 'hallucinations are structural' from take to documented fact.

Read article
AI Reliability 12 min read

How to Check If AI Citations Are Fake

A citation is fake when the source does not exist, or does not say what it is cited for. Check four things: the source exists, its details match, it supports the claim, and it is the right authority.

Read article
AI Reliability 11 min read

Should You Stop Using ChatGPT?

No. Keep using ChatGPT to draft, and stop trusting it unchecked. Researchers found AI made experts measurably worse on hard tasks, and it tends to agree with you when it should push back.

Read article
AI Verification 9 min read

AI Detector vs Fact Checker

One asks who wrote this. The other asks is this true. Before you publish, only one of those questions protects your name, and most teams are watching the wrong one.

Read article
Creator Economy 11 min read

What Is AI Slop, and How to Avoid It

AI slop is mass-produced, low-effort content made with little regard for whether it is accurate. What separates AI-assisted work from slop is whether you verified the output, and can prove it.

Read article
AI Reliability 11 min read

Why AI Is Confidently Wrong

AI is confidently wrong because a model has no internal sense of when it is wrong. In one Carnegie Mellon task, chatbots showed about 90 percent confidence at about 65 percent accuracy.

Read article
Comparisons 10 min read

An Originality.AI Alternative

If your job is checking claims before you publish, TrueStandard is an Originality.AI alternative built only for that. It runs each claim past four models from different labs. Originality.AI's fact check is one of five bundled checks, on one model.

Read article
Comparisons 9 min read

TrueStandard vs Parafact

Both verify claims before you publish. The real difference is what one model can miss, and whether your long-form draft fits inside the check at all.

Read article
Comparisons 9 min read

TrueStandard vs FactCheckTool

These two tools look alike, but they solve opposite problems. One tells you if the media you read is fake. The other tells you if the draft you are about to publish is true.

Read article
Legal and Compliance 13 min read

Do Lawyers Have to Verify AI Output? California's Rule

Increasingly, yes. On May 5, 2026, California's State Bar proposed that lawyers independently review and verify AI output used in client work. Connecticut and New York moved to the same standard of independent checking.

Read article
AI Architecture 11 min read

Multi-Agent vs Multi-Model AI in 2026

Multi-agent AI runs many roles of one model. Multi-model AI runs different models from different labs. Only multi-model can catch an error the first model is blind to.

Read article
AI Reliability 12 min read

What Are AI Hallucinations?

An AI hallucination is a false claim a model states with confidence. It might be a research paper that does not exist, a made-up statistic, or a wrong fact about a real person.

Read article
Case Studies 11 min read

3 AI Stress Tests from Q2 2026

In April 2026, top AI builders ran real experiments instead of demos, and the results said more than the demos did. Here is what each test shows, and why none of them fully answers the question writers care about.

Read article
AI Architecture 13 min read

Long Context vs RAG in 2026

Under about 100 pages, put your documents in a long context window. From 100 to 500 pages, Karpathy's wiki method works, and past 500, graph RAG wins. Better retrieval still does not make the answer true.

Read article
AI Reliability 10 min read

What Is AI Sycophancy?

AI sycophancy is when a language model tells you what you want to hear instead of what is true. It agrees with a flawed premise, praises weak work, and drops a correct answer when you push back.

Read article
AI Reliability 12 min read

Karpathy's 3 AI Methods, and What They Don't Fix

Andrej Karpathy's three 2026 methods are autoresearch, the LLM Wiki and brevity constraints. Autoresearch tunes metrics, the wiki organizes memory, and brevity cuts reasoning loops. None of them checks whether a writer's claims are true.

Read article
AI Fundamentals 12 min read

Every Type of AI, Explained

From large language models to coding agents: what each type of AI does, which tools lead each group, and how to pick the right one for your work.

Read article