BibTeX Verification Skill

SkillFiles & storage

Verify a BibTeX file for hallucinated or fabricated references by cross-checking every entry against CrossRef, arXiv, and DBLP. Reports each reference as verified, suspect, or not found, with field-level mismatch details (title, authors, year, DOI). Use when the user wants to check a .bib file for fake citations, validate references in a paper, or audit bibliography entries for accuracy.

Available today. Use it from your connected AI after setup.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the BibTeX Verification Skill skill

What this skill tells your AI

The instructions your AI receives, as published by agentscope-ai/openjudge in skills/bib-verify/SKILL.md and read by ahel’s review.

Check every entry in a .bib file against real academic databases using the OpenJudge PaperReviewPipeline in BibTeX-only mode:

  1. Parse — extract all entries from the .bib file
  2. Lookup — query CrossRef, arXiv, and DBLP for each reference
  3. Match — compare title, authors, year, and DOI
  4. Report — flag each entry as verified, suspect, or not_found

Prerequisites

pip install py-openjudge litellm

Gather from user before running

InfoRequired?Notes
BibTeX file pathYes.bib file to verify
CrossRef emailNoImproves CrossRef API rate limits

Quick start

# Verify a standalone .bib file
python -m cookbooks.paper_review --bib_only references.bib

# With CrossRef email for better rate limits
python -m cookbooks.paper_review --bib_only references.bib --email your@email.com

# Save report to a custom path
python -m cookbooks.paper_review --bib_only references.bib \
  --email your@email.com --output bib_report.md

Relevant options

FlagDefaultDescription
--bib_onlyPath to .bib file (required for standalone verification)
--emailCrossRef mailto — improves rate limits, recommended
--outputautoOutput .md report path
--languageenReport language: en or zh

Interpreting results

Each reference entry is assigned one of three statuses:

StatusMeaning
verifiedFound in CrossRef / arXiv / DBLP with matching fields
suspectTitle or authors do not match any real paper — likely hallucinated or mis-cited
not_foundNo match in any database — treat as fabricated

Field-level details are shown for suspect entries:

  • title_match — whether the title matches a real paper
  • author_match — whether the author list matches
  • year_match — whether the publication year is correct
  • doi_match — whether the DOI resolves to the right paper

Additional resources

Signals

GitHub stars
830
Forks
69
Last commit
Sep 2026
Advanced
Catalog kind
skill
Gateway key
bib-verify
Source
github.com/agentscope-ai/openjudge