The Writing System 9 min read

How to Fact-Check an AI-Written Business Book Before You Publish

AI drafts invent statistics, quotes, and sources that sound right. A step-by-step check, a copyable claim ledger, and what to do with claims you can’t support.

To fact-check an AI-written book, pull every checkable claim into a ledger, trace each one to a source you open yourself, confirm the source says exactly what your sentence says, and cut, soften, or re-source anything that fails. Start with the errors that damage an expert’s credibility fastest: invented statistics, quotes, studies, citations, and client results that sound plausible.

The errors that hurt experts most

Hunt these first, because they look exactly like the proof a credible book needs:

  • Invented statistics. A line like “73 percent of buyers ignore cold outreach” with no source, or a real organization’s name attached to a number it never published.
  • Invented or polished quotes. A famous executive “said” something you can’t find anywhere, or your client’s words were smoothed into a sentence they never spoke.
  • Phantom studies. “Research from a leading university shows…” with no study behind it.
  • Real sources, wrong claims. The book or paper exists but doesn’t say what the sentence says.
  • Inflated client results. “Hundreds of leaders” becomes “500 leaders,” and a 30 percent improvement becomes “doubled.”
  • Misattributed frameworks. A well-known model credited to the wrong person, or presented as yours.

The same process works to fact-check any AI content you publish under your name, from newsletters to sales pages.

Why AI drafts invent things that sound right

Language models generate likely-sounding text; unless they are connected to a search or retrieval system, they don’t look anything up. A 2025 paper, Why Language Models Hallucinate, describes the resulting errors as “plausible yet incorrect statements” and argues that training and evaluation “reward guessing over acknowledging uncertainty.” A citation has a predictable shape (author, title, year, publisher), so a model can produce one that looks real whether or not the work exists.

A well-documented example comes from a courtroom. In Mata v. Avianca, a federal judge in New York found that two lawyers and their firm “submitted non-existent judicial opinions with fake quotes and citations created by the artificial intelligence tool ChatGPT” (opinion and order on sanctions, June 22, 2023). When one lawyer asked ChatGPT whether a case was real, it replied that the case “does indeed exist” and could be found on Westlaw and LexisNexis.

The court ordered a $5,000 penalty, and it noted that most of the real decisions the lawyers did cite “did not support the propositions for which they were offered.” The same opinion says there is “nothing inherently improper about using a reliable artificial intelligence tool for assistance.” The failure was skipping the check.

Your name on a business book puts you in that gatekeeping role. The cost of a miss just shows up differently: a prospect who spots an invented statistic may never book the discovery call.

How to fact-check an AI-written book, step by step

  1. Work on a near-final draft. Finish structural edits first, or checked sentences get rewritten and need checking again. The KSJ fact-checking guide from Knight Science Journalism at MIT starts the same way: annotate a near-final draft and “cite every source for every fact.”
  2. Pull every checkable claim into a ledger. Read sentence by sentence. Anything that could be true or false goes in. Opinions clearly framed as yours can stay out.
  3. Rank by risk. Client results, quotes, statistics, claims about named people or companies, and legal, financial, or health guidance come first.
  4. Trace each claim to a source you open yourself. For your own material, that means the transcript timestamp, the client email, or the CRM report. For outside facts, it means the original study or report, not an article quoting it. Note page numbers for books, and save a PDF or screenshot of web pages, because pages change.
  5. Confirm the match. Same number, same population, same timeframe, same direction. A survey of 200 HR leaders doesn’t support a sentence about “most companies.”
  6. Decide and record. Keep, fix, soften, re-source, cut, or ask. Every row gets an owner and an action.
  7. Recheck after edits. Copyediting and late rewrites can change meaning, so rerun the high-risk rows on the final file.

Don’t use the tool that wrote the draft as the checker. It can help you list claims to verify, but as the Mata lawyers learned, it can confirm its own inventions.

A copyable claim ledger

Copy this table into a spreadsheet or the end of your manuscript file. The rows are illustrative.

Claim (chapter) Type Source Status Owner Action
“Most first-time managers get no training.” (Ch. 2) Statistic None in your material Unsupported Author Find a primary study or reframe as your observation
“Research from a leading university shows…” (Ch. 3) Citation No study found Not found Author Cut
Client quote: “This saved our year.” (Ch. 4) Quote Call transcript, 32:10 Wording matches; permission pending Client Approve the passage
“Revenue grew 40% in six months.” (Ch. 5) Client result Client email Email says nine months Author Fix the timeframe and confirm with the client
“The first framework built for agencies” (Ch. 1) Superlative None Unverifiable Author Remove “first”
“Unclear roles cause burnout.” (Ch. 6) Causal claim Your client work only Opinion stated as fact Author Rephrase as your view, with an example

Keep status values short and consistent: verified, fixed, softened, pending, cut, waiting on source. When a client has to confirm something, make the client the owner so you can see what you are waiting on.

Error types to hunt

Error type What it looks like How to check
Numbers Percentages, dollar figures, counts, multiples Find the original data; check the base, unit, and timeframe
Names People, companies, job titles, spellings Official bios, company sites, the person’s own profile
Dates Years, sequences, “since 2015” Primary records and archived pages
Quotes Anything in quotation marks The recording, transcript, or original text; otherwise paraphrase without quotation marks
Citations Books, papers, articles, reports Find the item and read the cited passage
Superlatives First, only, best, leading, most Usually unprovable; cut or narrow
Causal claims “Because,” “led to,” “drives” Does the evidence show cause, or only that two things happened together?
Client outcomes Results, timeframes, who did the work Client records, plus the client’s approval
“Research shows” “Studies show,” “experts agree,” “data proves” Name the study you read, or delete the phrase

“Research shows” claims matter beyond the book. When they appear in your marketing, the FTC expects a reasonable basis for objective claims before they run, and when an ad says it rests on tests or studies, “at least the advertised level of substantiation” (FTC policy statement).

How to verify that a citation exists and says what the text claims

  1. Find it yourself. Search the exact title in Google Scholar, a library catalog such as WorldCat, or the publisher’s site, and resolve any DOI at doi.org. Don’t trust a link supplied by the draft until you’ve seen where it goes.
  2. Match the details. Author, title, year, publisher or journal, and pages should all agree. Invented citations can pair a real author with a title they never wrote, or a real journal with the wrong year.
  3. Read the passage. Go to the cited page or section and check the exact number, who was studied, when, and whether the finding shows cause or only correlation.
  4. Describe the evidence accurately. A vendor’s customer survey, a peer-reviewed study, and an anecdote in a popular book are different kinds of support. Say which one you have.
  5. Go to the original. If a blog post cites a report, read the report. Statistics drift as they are repeated.
  6. Save it. Keep a PDF or screenshot, plus the page number, in your ledger.

If you can’t find the source after a reasonable search, treat the claim as unsupported.

What to do when a claim can’t be supported

You have three honest options: cut it, soften it to what you can support, or ask the source.

Situation Best move Example rewrite
Invented statistic Cut, or replace with a figure you have read in the original Use the sourced number, or your own observation labeled as yours
Quote you can’t trace Remove the quotation marks and attribution, or cut State the idea in your own words
Client result you can’t document Ask the client Describe only what you saw directly until they confirm
Real source, overstated claim Narrow the sentence “Research proves” becomes “one study of [group] found”
Correlation written as cause Rephrase “X causes Y” becomes “teams that did X also tended to report Y”

Softening has a trap. “Many studies suggest” is still a research claim; if you can’t name the studies, it is an invented claim in vaguer words. Soften toward your own experience instead (“In the leadership teams I’ve worked with…”), which is a claim you can stand behind. Client stories carry their own permission rules, covered in how to use client stories in a business book.

When to bring in a professional fact-checker or reviewer

Hire a professional fact-checker when the book leans on outside research, names real people or companies critically, or gives legal, financial, tax, or health guidance. Give them the annotated manuscript, the ledger, and your source files; the KSJ guide describes exactly that handoff.

Ask a subject-matter reviewer, a respected peer in your field, to read for technical accuracy: does your account of established methods match how practitioners use them, and is anything out of date? If the book criticizes named companies or discusses legal disputes, have a lawyer review those passages before publication.

Fact-checking fits after structural and voice edits and before copyediting. The guide to editing an AI-written book shows the full sequence, and the publishing checklist covers what comes after.

Settle one publishing fact at the same time. If you publish on Amazon KDP, its content guidelines count text created by an AI tool as AI-generated even if it was substantially edited afterwards, and require you to disclose it. Fact-checking makes the book accurate; it doesn’t change that classification.

Who this process is for

This process is for anyone whose name goes on an AI-assisted book meant to earn client trust, and for ghostwriters and book coaches checking a draft before it goes back to a client; the guide to AI tools for ghostwriters and book coaches covers that side. If your draft came from a one-line prompt with none of your material behind it, most claims will have no source at all, and starting again from your talks, notes, and client work is usually faster. The comparison of ChatGPT and a book platform that drafts from your sources explains why. No software removes the need to read the sources yourself.

How WritebookAI helps

WritebookAI is designed to keep your ledger short, not to replace it. Every chapter is written from your own material and your interview answers. Collect shows what the material covers, what is missing, and where sources conflict. The one interview asks only where the material is missing, unclear, or contradictory, and each question shows where it came from, often quoting your own words. Anything you skip is left out of the book, never invented.

In Write, each chapter’s factual claims are checked against that material, and anything unsupported is left out or comes back to you as a question. A whole-book manuscript review follows, and exports stay marked as drafts until you approve the manuscript.

You still verify. The checks compare the draft with your material, so a claim that matches a wrong number in your notes will still be wrong, and any outside statistic you add later needs its own row in the ledger. Fact-checking stays your responsibility as the author. You can start your book free with no card and read the first 3 chapters. Finishing the book costs $497 one time, not a subscription (pricing), with a 30-day “Sounds Like You” guarantee: if it does not read in your voice, WritebookAI works with you to refine it and refunds the purchase in full if it cannot.

Frequently asked questions

Why does AI make up sources and quotes?

Language models generate likely-sounding text rather than retrieving verified facts. A 2025 paper, Why Language Models Hallucinate, calls the resulting errors “plausible yet incorrect statements” and argues that training and evaluation reward guessing over admitting uncertainty. Citations and quotes follow predictable patterns, so a model can produce convincing ones for works and remarks that don’t exist. Treat every reference in an AI draft as unverified until you open it.

Can I ask ChatGPT to check its own facts?

Not reliably. In Mata v. Avianca, a lawyer asked ChatGPT whether a case it had cited was real, and it replied that the case existed and could be found on Westlaw and LexisNexis. It didn’t exist, and the court sanctioned the lawyers. An AI tool can help you list the claims that need checking, but verify each one against a source you open yourself.

How long does it take to fact-check a business book?

It depends on how many checkable claims the book makes more than on its length. A book built mostly from your own client work has few outside facts, so the work centers on client results, quotes, and permissions. A research-heavy book takes much longer. To estimate, build the ledger for one representative chapter, time the checks, multiply by your chapter count, and allow time for clients to reply.

Do I need a professional fact-checker for my business book?

Hire one when the book relies heavily on outside research, names real people or companies critically, or gives legal, financial, tax, or health guidance. For a book grounded in your own experience, a careful author-led ledger plus a review by a respected peer may be enough. Either way, hand reviewers the annotated manuscript, the ledger, and your source files so the work goes quickly.

What if I can’t find the source for a statistic I’ve quoted for years?

Stop using it until you find the original. Search for the report or study it came from and read the relevant page. If you can’t find it, replace it with a figure you have verified, or with your own observation framed as experience. A number you can’t trace undermines the trust the book is meant to build, and in your marketing it becomes an advertising claim you can’t support.

Sources

Continue the book-building workflow

Turn your expertise into a book that sounds like you.

WritebookAI interviews you, organizes your talks, client stories, and notes, and drafts in your Writing DNA. Your first 3 chapters are free, then $497 one-time to finish the book.

Start your book free

See pricing