Fact Check Prompt

SkillAI & models

Generates a systematic fact-checking checklist from a draft article, categorizing every verifiable claim by type and priority, with the specific verification question, recommended source type, and appropriate verification strategy for each — across six distinct claim categories with tailored methodologies.

Available today. Use it from your connected AI after setup.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the Fact Check Prompt skill

What this skill tells your AI

The instructions your AI receives, as published by ur-grue/autopunk-media-skills in skills/magazine-journalism/editing/fact-check-prompt/SKILL.md and read by ahel’s review.

What This Skill Does

Generates a systematic fact-checking checklist from a draft article, categorizing every verifiable claim by type and priority, with the specific verification question, recommended source type, and appropriate verification strategy for each. Handles six distinct claim categories — each with its own methodology, red flags, and common errors.

When To Use This Skill

  • You have finished a draft and want to ensure you have not missed any checkable claim before submitting
  • You are fact-checking a piece written by another reporter and need a structured inventory of everything that requires verification
  • You are on deadline and need to triage — identify which claims carry the most risk and need to be checked first
  • You are training a new researcher or fact-checker and want a model for what a systematic check looks like
  • You are reviewing an interview-heavy piece and need to verify quotes, titles, credentials, and biographical claims
  • You are checking a data-driven article and need to verify statistical claims, survey methodology, and numerical comparisons
  • You are editing a piece with legal or regulatory claims and need to confirm statutory citations, court rulings, and regulatory actions
  • You are reviewing a story that references scientific studies and need to verify research findings, sample sizes, and journal citations
  • You are working on a historical feature and need to verify dates, sequences of events, causation claims, and archival references

What You Need To Provide

For any fact-check

Required: The draft article text (or the section to be fact-checked); the publication type (news, magazine feature, investigative, profile, opinion with reported elements, data journalism piece). Optional: Which claims you are already confident about (to exclude from the list); any specific high-risk areas you are concerned about; the publication's fact-checking standard (light editorial check vs. full verification with source documentation); whether the piece will appear in print (corrections are permanent) or online (corrections can be appended).

Additional inputs by claim category

For interview-heavy pieces: Whether original recordings or transcripts exist; whether the subject has approved or reviewed quotes; whether the subject holds a public or private role. For statistical pieces: Whether raw data or the underlying dataset is available; whether the writer computed figures independently or is citing a secondary source; the date range of the data. For legal/regulatory pieces: The jurisdiction (federal, state, local, international); whether cases cited are concluded or pending; whether the writer has consulted legal counsel. For scientific/medical pieces: Whether the study cited has been peer-reviewed; whether the writer accessed the full paper or only the abstract/press release; whether the findings have been replicated. For historical pieces: Whether claims come from primary sources (archives, documents, firsthand accounts) or secondary sources (books, articles, encyclopedias); the time period involved.

How the Assistant Approaches This

The assistant selects the appropriate verification mode based on the dominant claim types in the draft. Most articles contain claims from multiple categories — the assistant applies each category's methodology to the relevant claims within the same checklist.

Mode 1: Feature Article Claims

Standard mode for narrative magazine pieces, reported essays, and general-interest features.

  1. Reads through the draft and extracts every verifiable claim — statistics, dates, names and titles, institutional descriptions, historical facts, legal statements, causal claims ("X caused Y"), and direct quotes attributed to named sources
  2. Categorizes claims by risk level: High (statistics, specific numbers, legal or medical claims, anything that could expose the publication to a defamation claim), Medium (biographical details, historical claims, institutional descriptions), Low (widely known facts, claims easily verified in seconds)
  3. For each claim: writes the verification question in plain language, recommends the source type, and flags any claim where the draft text itself is ambiguous or internally inconsistent
  4. Identifies structural dependencies — claims that rely on each other, where one being wrong invalidates another
  5. Closes with a triage recommendation: which High Priority item to verify first, estimated total checking time, and whether to run house-style-enforcer after fact-checking is complete

Mode 2: Interview and Profile Verification

For profiles, Q&A pieces, and any article built primarily on interviews with named sources.

  1. Extracts every direct quote and identifies whether it is attributed to a named source, an anonymous source, or paraphrased
  2. For each named source: flags their current title, institutional affiliation, credentials, and any description of their expertise — each of these is a separate verifiable claim
  3. Checks biographical claims against what can be verified through public records, institutional directories, and published sources
  4. Flags "resume inflation" risks — claims about degrees, awards, founding roles, publication credits, or professional affiliations that sources sometimes overstate
  5. For direct quotes: notes whether the quote sounds like spoken language or has been cleaned up to the point of misrepresentation; flags composite quotes (combining statements from different parts of an interview) as a separate risk
  6. For anecdotes told by sources: identifies which elements are verifiable (dates, locations, other people present) and which rest entirely on the source's account
  7. Closes with a recommendation on which sources to re-contact for quote approval and which biographical claims to verify independently

Mode 3: Statistical and Data Claims

For data journalism, trend pieces, economic reporting, and any article that depends on numerical claims.

  1. Extracts every number in the draft — percentages, dollar amounts, counts, rates, rankings, growth figures, and dates
  2. For each number: identifies whether it comes from a named source (a report, agency, or study), the writer's own calculation, or is unattributed
  3. Checks mathematical consistency — do the numbers in the piece add up? If a claim says "32 percent," does the underlying figure support that rounding? If a claim says "tripled," is the actual ratio between 2.5x and 3.5x?
  4. Flags comparison traps: numbers from different time periods compared without inflation adjustment, percentages computed from different base populations, rates vs. raw numbers mixed in the same paragraph, cherry-picked start/end dates that exaggerate a trend
  5. Identifies methodology questions: was the survey nationally representative? What was the margin of error? Is the sample size large enough to support the conclusion drawn?
  6. Checks unit consistency: are all dollar figures in the same year's dollars? Are all geographic comparisons using the same boundaries (city vs. metro area vs. county)?
  7. Flags "single-source statistics" — numbers that appear nowhere outside the one report or study cited, which means there is no independent confirmation available

Mode 4: Historical Claims

For historical features, anniversary pieces, retrospectives, and any article that makes claims about past events.

  1. Extracts every date, sequence claim ("X happened before Y"), duration claim ("lasted six years"), and causation claim ("X led to Y")
  2. Checks dates against multiple independent sources — a single source can contain the same error repeated across secondary works
  3. Flags the "first/earliest/only" trap: claims that something was the first, the largest, the only, or otherwise superlative are among the hardest to verify and the easiest to get wrong
  4. Identifies anachronism risks — modern terms, titles, or concepts applied to historical periods where they did not exist or meant something different
  5. Separates factual claims (what happened, when, where) from interpretive claims (why it happened, what it caused) — both require checking, but by different methods
  6. For causation claims: identifies whether the draft asserts direct causation, correlation, or contribution — and whether the evidence cited supports the level of causation claimed
  7. Flags "conventional wisdom" claims — widely repeated historical claims that recent scholarship has revised or overturned

Mode 5: Legal and Regulatory Claims

For court reporting, regulatory coverage, policy analysis, and any article citing laws, rulings, or government actions.

  1. Extracts every legal citation — statutes, case names, regulatory codes, executive orders, court rulings
  2. Verifies the correct citation format: is the statutory section number accurate? Is the case name correctly styled? Is the court identified correctly?
  3. Checks whether the law or ruling cited is still current — has it been amended, repealed, overturned on appeal, or superseded?
  4. For claims about what a law "does" or "requires": verifies that the draft's characterization matches the actual statutory language, not just a press summary or advocacy group's interpretation
  5. Flags pending vs. concluded cases — a case "decided" by a trial court may be on appeal; a law "passed" by one chamber may not have been signed
  6. Identifies jurisdictional accuracy: is the correct court, agency, or legislative body cited? Federal vs. state vs. local distinctions matter
  7. Flags "legal conclusion" claims — where the draft states a legal outcome as fact ("this violates the law") when it is actually the writer's or a source's interpretation

Mode 6: Scientific and Medical Claims

For health reporting, science journalism, environmental coverage, and any article citing research findings.

  1. Extracts every research claim — study findings, sample sizes, effect sizes, journal names, institutional affiliations of researchers
  2. Checks whether the study cited has been published in a peer-reviewed journal (vs. a preprint, conference paper, press release, or institutional report)
  3. Verifies the study actually says what the draft claims it says — the most common error in science journalism is overstating a study's conclusions
  4. Flags the "single study" problem: one study showing an effect is not the same as scientific consensus; checks whether the draft implies broader certainty than a single finding supports
  5. Identifies sample size and population concerns: was the study conducted on humans or animals? On a specific demographic that may not generalize? Was the sample large enough for the conclusion drawn?
  6. Checks for retracted or corrected papers — especially in fast-moving fields where preprints are common
  7. Flags correlation-as-causation errors: the draft says "causes" when the study found "is associated with"
  8. For medical claims: flags any claim that could affect health decisions (dosage, treatment effectiveness, risk factors) as highest priority regardless of other risk factors

Claim Type Taxonomy and Verification Strategies

Every claim in a draft falls into one of the categories below. The verification strategy differs by type — applying the wrong strategy wastes time or misses the error.

Identity Claims

What they are: A person's name, title, institutional affiliation, credentials, age, location. Common errors: Outdated titles (a department chair whose appointment ended), wrong institutional name (university renamed or merged), misspelled names, wrong middle initial, wrong age (calculated from birth year without checking whether the birthday has passed). Verification strategy: Check the institution's current directory or website. For public figures, cross-reference at least two independent sources. For titles that rotate (department chair, board president), confirm the appointment is current as of publication date. For spelling, check the person's own published work or institutional bio — do not rely on previous news coverage, which may repeat the same error. Red flags: The source's LinkedIn profile lists a different title than the one in the draft. The institution's website does not list the person at all. The person's name is spelled differently in different published sources.

Numerical Claims

What they are: Any specific number — percentages, dollar amounts, counts, rates, rankings, dates, durations, distances, measurements. Common errors: Transposed digits, wrong unit (millions vs. billions), wrong year, wrong geographic scope (city vs. metro vs. county), percentage vs. percentage point confusion, nominal vs. inflation-adjusted dollars, rounding that changes the meaning. Verification strategy: Trace every number to its primary source — the original dataset, report, or record. Do not verify a number by finding it repeated in another news article; the second article may have copied the error. Check whether the number is current or from a specific reporting period. Verify the unit and the base. Red flags: A number that appears in no source other than the one cited. A percentage that does not specify what it is a percentage of. A dollar figure with no year attached. A ranking with no stated universe ("the third-largest" — third-largest in the state, the country, or the world?).

Quotation Claims

What they are: Direct quotes attributed to a named person, paraphrased statements, and characterizations of what someone said or believes. Common errors: Quotes cleaned up beyond recognition, composite quotes (combining statements from different moments), quotes taken out of context (the surrounding sentences reverse the meaning), quotes attributed to the wrong person in a multi-source piece, fabricated quotes. Verification strategy: Compare the quote in the draft against the original recording or transcript. If no recording exists, confirm the quote directly with the source. For paraphrases, confirm with the source that the characterization is accurate. For historical quotes, trace to the earliest published source — many famous quotes are misattributed or apocryphal. Red flags: A quote that sounds too polished for spoken language. A quote that perfectly supports the writer's thesis (sources rarely speak in thesis statements). A historical quote that appears only in secondary sources with no citation to the original.

Institutional Claims

What they are: Descriptions of organizations — their size, founding date, mission, structure, actions, policies. Common errors: Wrong founding date, wrong headquarters location, wrong employee count (headcount vs. FTE, or an outdated figure), mischaracterized mission or mandate, wrong parent company or corporate structure, describing a proposed action as completed. Verification strategy: Check the organization's own public filings, annual reports, or official website — but verify independently when possible, since organizations sometimes misrepresent their own history. For government agencies, check the enabling statute or executive order. For nonprofits, check IRS Form 990 filings (publicly available). Red flags: A founding date that differs between the organization's website and independent sources. An employee count with no date attached. A description of an organization's purpose that sounds like it was copied from marketing material.

Causal Claims

What they are: Assertions that X caused Y, X led to Y, X resulted in Y, or X is responsible for Y. Common errors: Confusing correlation with causation, omitting confounding variables, asserting direct causation when the relationship is indirect or partial, reversing the direction of causation, implying intent where none is documented. Verification strategy: Identify what evidence the draft cites for the causal relationship. Is it a study that controlled for confounding variables? An expert's opinion? A temporal sequence (X happened, then Y happened)? A temporal sequence alone does not establish causation. Check whether the source cited actually claims causation or merely correlation — the draft may overstate the source. Red flags: "Because of," "as a result of," or "led to" without a cited source or mechanism. A causal chain with missing links. A claim that a single factor caused an outcome that experts describe as multi-causal.

Legal/Regulatory Claims

What they are: Citations to laws, court decisions, regulations, penalties, legal standards, rights, or obligations. Common errors: Wrong statutory section number, wrong court, case overturned on appeal but cited as good law, law amended since the draft was written, characterizing a bill as a law (passed one chamber but not signed), describing a legal standard incorrectly. Verification strategy: Check every statutory citation against the current version of the statute (not a summary or press release). For case law, check whether the decision has been affirmed, reversed, or vacated on appeal. For regulatory actions, verify the current status — proposed rules are not final rules. Use official legal databases or government websites, not news summaries. Red flags: A statutory citation that does not match the subject matter described. A court ruling cited without specifying which court. A law described in present tense ("the law requires") when it has been repealed or amended.

Scientific/Medical Claims

What they are: Research findings, health claims, treatment effectiveness, risk factors, environmental data, study conclusions. Common errors: Overstating a study's conclusions (the study found a correlation; the draft says "proves"), wrong sample size, confusing relative risk with absolute risk, citing a preprint or press release as a published study, citing a retracted paper, applying animal study results to humans without noting the limitation. Verification strategy: Access the actual paper (not the press release or abstract). Verify the journal name, publication date, and authors. Check the paper's own limitations section — what the researchers themselves say their study does not prove. For medical claims, check whether major medical organizations or systematic reviews support the conclusion. Search retraction databases (Retraction Watch). Red flags: A finding described as "groundbreaking" or "the first to show" — these phrases often signal a single unreplicated study. A health claim with no citation. A study from a journal you have never heard of. A finding that contradicts the consensus of major medical organizations.

Historical Claims

What they are: Dates, sequences, durations, descriptions of past events, characterizations of historical figures' actions or motives. Common errors: Wrong year (especially for events near a year boundary — December vs. January), wrong sequence (event A actually happened after event B), "first" claims that are wrong (someone else did it earlier), modernized language applied to historical context, simplified causation (reducing a complex historical process to a single cause). Verification strategy: Cross-reference dates in at least two independent sources — not two sources that cite the same original. For "first" claims, search for earlier instances. For causation claims, check whether current historiography supports the causal story told in the draft. Be alert to the difference between primary sources (documents, letters, records from the period) and secondary sources (later accounts that may contain errors). Red flags: A specific date cited from memory rather than a source. A "first" claim with no documentation. A historical anecdote that is too perfect — it may be apocryphal. A claim that relies entirely on one secondary source.


Verification Chain Methodology

A verification chain tracks each claim from the draft back to its original source, through every intermediary. This section explains how to build and evaluate a chain.

The Chain Structure

Every claim in a published article has a provenance:

Draft text → Writer's source → Intermediary (if any) → Primary source

Example:

  • Draft says: "42 percent of teachers reported burnout in 2024"
  • Writer got the number from: a newspaper article
  • The newspaper got it from: a press release from a teachers' union
  • The union got it from: a survey they commissioned from a polling firm
  • The polling firm's methodology: online survey of 1,200 union members (not all teachers)

The claim is only as strong as the weakest link. In this example, the draft implies a finding about all teachers, but the primary source surveyed only union members — a specific subset with different demographics and working conditions.

Building the Chain

  1. Start at the draft. Copy the exact claim as written.
  2. Identify the cited source. What does the draft say is the source? If no source is cited, that is itself a red flag.
  3. Access the cited source. Read what it actually says — not what the draft says it says.
  4. Trace backward. Where did the cited source get the information? If it is a news article, what report or data did it cite? If it is a report, what methodology did it use?
  5. Reach the primary source. The primary source is the original data, document, record, or firsthand account. Stop here.
  6. Evaluate each link. At each step, ask: did the intermediary accurately represent what the source below it said? Did anything get lost, simplified, or distorted?

Common Chain Failures

FailureWhat HappensHow to Catch It
Circular sourcingTwo articles cite each other; neither has a primary sourceTrace back — if the chain loops, the claim is unverified
Telephone effectEach intermediary slightly changes the claim; by the draft, it is materially different from the originalCompare the draft's claim word-for-word against the primary source
Dead sourceThe original report, dataset, or webpage no longer existsTry the Wayback Machine; contact the issuing organization; note in the checklist that verification is impossible
MisattributionThe draft attributes a finding to Organization A, but Organization A was citing Organization BFollow the chain until you reach the organization that actually produced the finding
Cherry-pickThe primary source contains caveats, limitations, or opposing data that the intermediaries droppedRead the full primary source, including methodology sections and footnotes
Outdated sourceThe data was accurate when published but has since been updated or correctedCheck whether the issuing organization has published a newer version

When the Chain Breaks

If you cannot complete the chain — the cited source does not exist, the primary source contradicts the draft, or the intermediary materially changed the claim — flag the claim as UNVERIFIED in the checklist and note exactly where the chain broke. The writer or editor must decide whether to:

  • Find an alternative source that supports the claim
  • Rewrite the claim to match what the primary source actually says
  • Remove the claim from the draft

Red Flags Reference

These patterns signal claims that are likely wrong or unverifiable. When a claim triggers a red flag, escalate it to High Priority regardless of its initial category.

Shortened here. Read the whole file on GitHub.

Signals

GitHub stars
32
Forks
1
Last commit
Aug 2026
Advanced
Catalog kind
skill
Gateway key
fact-check-prompt
Source
github.com/ur-grue/autopunk-media-skills