How to Fact-Check AI Answers Before You Rely on Them

An AI assistant produces text by predicting what a good answer would look like. Most of the time that prediction matches reality. Sometimes it produces a fluent, specific, completely wrong statement, and nothing in the wording tells you which is which. You do not need to distrust everything. You need a routine for the answers that matter.

In short: Treat an AI answer like a tip from a confident stranger: useful, often right, and worth checking in proportion to what happens if it is wrong.

Know where errors cluster

Some kinds of content are far riskier than others. Slow down when an answer contains:

• Specific numbers: statistics, prices, dates, measurements, dosages.
• Quotations and citations: invented quotes, papers, court cases and web addresses are a well-documented failure.
• Recent events: a model's built-in knowledge stops at its training date.
• Niche or local detail: small organisations, lesser-known people, local regulations.
• Legal, medical and financial claims: where rules vary by country and errors are costly.
• Arithmetic and counting buried inside a longer answer.

General explanations of well-established topics, rewording your own text, and brainstorming are comparatively low-risk.

A five-step checking routine

1. Pick out the claims that carry weight

You rarely need to check every sentence. Identify the handful of facts your decision or document actually depends on.

2. Ask where each one comes from

Ask the assistant for its sources. Then open them. Confirm that the page exists, that it is a source you would trust on its own, and that it actually says what was claimed. A real link attached to a claim the page does not make is a common and easily missed error.

3. Confirm independently

Search for the claim yourself and look for a primary or authoritative source: official statistics, the organisation's own site, the original paper, the text of the law. Two websites repeating each other are not two sources.

4. Redo the sums

Check any calculation with a calculator or spreadsheet. If the assistant can run code, asking it to compute the result with code rather than “in its head” is much more reliable.

5. Match the effort to the stakes

A recipe substitution needs a sanity check. A figure in a report with your name on it needs a source you can cite. Anything touching health, law or money needs a qualified person.

Prompts that make checking easier

• “List the factual claims in your answer that I should verify, most important first.”
• “Which parts of this are you least certain about, and why?”
• “Quote the exact passage from the document that supports that.”
• “If you do not know, say so rather than guessing.”

Working from material you supply also cuts errors sharply. Paste the report and ask questions about it, rather than asking what the assistant remembers about the topic. More on that in how to write better AI prompts.

Warning signs worth a second look

• A suspiciously perfect statistic that supports your point exactly.
• A citation with plausible authors and title that no search can find.
• Details that change when you ask the same question again.
• An answer that agrees with a false assumption built into your question. Try asking neutrally.

The habit that matters

Use AI to get to a draft, an outline or a list of leads quickly, and treat facts in that output as unconfirmed until you have seen them somewhere reliable. That one habit keeps nearly all the speed and removes most of the risk.

Worked example: checking one answer

Suppose you ask an assistant when a well-known bridge opened and how long it is, and it replies with a year, a length and a quotation from the chief engineer.

1. Split the answer into claims. There are three: the year, the length and the quotation.
2. Rank them. The year and length are simple facts that are easy to confirm. The quotation is the kind of detail assistants sometimes invent.
3. Check the facts against a primary or reference source. The bridge authority’s own website or a national encyclopaedia will confirm the year and length in a minute.
4. Search for the quotation in quotation marks. If the exact words appear only on pages that give no source, or nowhere at all, do not use it.
5. Note what you verified. If you pass the information on, you can say which parts you confirmed.

Sources worth knowing

• For statistics: national statistics offices and international bodies such as the World Bank, the OECD and the World Health Organization publish their data and methods.
• For research claims: search the title in an academic index such as Google Scholar or PubMed. A real paper has authors, a journal and usually a DOI.
• For laws and regulations: the official government or legislature website for the country concerned.
• For quotations: the original speech, book or interview, or a quotation reference that gives the source.

Asking the assistant for its sources helps only if you then open them. A reference that looks perfectly formatted can still point to a paper that does not exist, or to a real paper that says something different.

What to check, by type of claim

How much checking is enough?

Scale the effort to the stakes. A suggested film needs none. A figure going into a school essay needs its source found. Anything affecting health, money, legal standing or someone’s reputation deserves a primary source and, where it matters, a professional’s view. If you cannot verify a claim, either leave it out or say plainly that it is unconfirmed.