Verification Tutorial · 5 Min Read

How to Check AI Answers: The 4-Step Verification Guide

AI models do not possess a concept of truth. They generate text that sounds convincing, fluent, and authoritative—even when completely fabricated. Here is how to protect your work from hallucinations.

Why Language Models Fabricate Facts

A language model is a probabilistic prediction engine. It predicts tokens that fit the linguistic pattern of your question. When asked about a historical figure, a legal statute, or a scientific paper, it produces wording that looks identical to real citations.

Because the writing style never changes between a true fact and an invented one, you cannot detect hallucinations by reading the tone. You must inspect the claims.

The 4-Step Verification Checklist

1. Isolate the Factual Claims

Separate stylistic phrasing from verifiable assertions. Circle or highlight every proper noun, date, statistic, quote, and URL. If the output says “Sales increased by 14% in Q3,” that is a claim that requires proof.

2. Trace to an Authoritative Source

Never ask the AI: “Are you sure about this?” The AI will almost always say yes, doubling down on the hallucination with more persuasive detail. Instead, search an external, authoritative source (an official database, court record, company financial filing, or peer-reviewed journal).

3. Perform Arithmetic & Date Sanity Checks

LLMs frequently produce arithmetic errors because numbers are represented as token sequences rather than numeric values. Always recalculate sums, percentages, and date spans using a calculator or spreadsheet.

4. Test Edge Cases & Assumptions

If the AI generated code, a formula, or a legal clause, test it against boundary conditions: zero values, negative numbers, missing data, or conflicting requirements.

Worked Example: The Mars Landing

Prompt: “Who was the first human to land on Mars?”

AI Output: “In 2038, Commander Elena Rostova became the first human to step foot on Mars during the international Ares IV mission.”

Notice how persuasive this is: specific year, realistic name, believable mission title. Yet humans have never landed on Mars. An uncritical reader might skim past it; an inspector immediately flags the claim.

Build Your Fact-Checking Muscle

Practice spotting subtle hallucinations with interactive exercises in Chapter C10: Check an Answer.