Check every reference of a paper against real scholarly records before you submit. No LLM guessing, no false accusations.
Agenten stärken
Der eigene Befehl des Herausgebers. Kein PlugMCP-Endpunkt.
Host a copy with our keys and logs.
uvx paper-preflight==1.0.0Claude Code hat keinen Installationslink für einen lokalen Befehl. Kopieren Sie den Befehl unten und führen Sie ihn in einem Terminal aus.
claude mcp add io.github.amos689-paper-preflight -- uvx paper-preflight==1.0.0In einem Terminal ausführen.
{ "mcpServers": { "io.github.amos689-paper-preflight": { "command": "uvx", "args": [ "paper-preflight==1.0.0" ] } }}claude_desktop_config.json
Remote-URL oder ein Befehl auf Ihrem Rechner? Worin sich die beiden Installationen unterscheiden
Auf PlugMCP ausführen
A new server you create. It is not this listing's official endpoint. Use the publisher install when you want their URL and their credentials.
StartenEnglish · 简体中文 · Quick start · User guide · Releases · Feedback

Language models invent references, and copy-pasted BibTeX carries wrong years, wrong authors and dead DOIs. paper-preflight reads your paper (LaTeX, Word, Markdown, Typst, a PDF or a plain reference list) and asks Crossref, dblp, arXiv, DataCite, PubMed and OpenAlex about every cited work, with Semantic Scholar too if you have a free key, Open Library for books without a DOI, and GitHub, PyPI, CRAN, Hugging Face and OpenML for software, models and datasets:
Every finding is backed by a record, or by every source that could know the work answering "no". When it cannot tell, it says "cannot determine" and why, instead of guessing. No language model takes part in a verdict.
Status: 1.0. On three weeks of real arXiv papers held out for the release: 0.79 false alarms per 100 references, against 409 real problems found (accuracy). Rule IDs, the JSON report, settings, commands and the Python API are kept through 1.x (what is stable). False positives are the bugs we most want to hear about: please open an issue.
With uv nothing needs installing:
uvx paper-preflight check path/to/paper
path/to/paper is the project's folder, its main .tex file or a .bib file. To install it
for good (Python 3.11 or later):
pip install paper-preflight
The repository's demo paper cites eleven works, several of them wrong on
purpose. The animation above is a real run of paper-preflight check examples/demo-paper
against the live sources. In it, the correct NeurIPS paper is verified through dblp although
Crossref only holds fake copies of it, the book without an identifier is confirmed by Open
Library, and the Chinese book, whose script is not supported yet, is "cannot determine", not
"not found".
$ paper-preflight check examples/demo-paper
paper-preflight 1.0.0 · main.tex · 12 entries, 12 cited keys
error CIT001 main.tex:31
Citation key 'nonexistent2023' is not defined in any bibliography file (1 use(s)).
error REF001 refs.bib:43
The doi of 'devlin2019bert' (10.1109/cvpr.2016.90) resolves to a different work in Crossref: "Deep Residual Learning for Image Recognition" (He et al., 2016).
error REF003 refs.bib:66
'lindqvist2024quantum' was not found in Crossref, dblp and Semantic Scholar, and every source responded. Check that the work exists and that its title is correct.
error REF004 refs.bib:73
'wakefield1998ileal' has been retracted (reported by Crossref, OpenAlex). Cite it only if the text discusses the retraction.
error CIT002 refs.bib:128
Entry key 'kingma2015adam' is already defined at line 47; BibTeX ignores this one.
warning REF015 refs.bib:31
'he2015residual' cites a preprint that has been published in CVPR (2016), DOI 10.1109/cvpr.2016.90. Cite the published version and keep the eprint field.
warning CIT004 refs.bib:37
Entries 'devlin2019bert' and 'he2016deep' look like the same work (same DOI).
warning REF013 refs.bib:51
'kingma2015adam' gives the year 2016, but dblp records 2014, 2015.
warning REF017 refs.bib:112
The doi of 'tacl2019example' contains LaTeX escapes: '10.1162/tacl\_a\_00276'. Write it as: 10.1162/tacl_a_00276
info REF005 refs.bib:73
'wakefield1998ileal' has a published correction (reported by Crossref).
info REF090 refs.bib:95
'zhou2016ml' could not be verified: non-Latin titles are not supported yet; grey literature without an identifier (book, report, software, web page).
info CIT003 refs.bib:116
Entry 'lecun1998gradient' is never cited.
References: 7 verified · 1 metadata mismatch · 1 identifier conflict · 1 not found · 1 cannot determine
5 error(s) · 4 warning(s) · 3 info
What each input can and cannot tell, in detail: docs/inputs.md.
Every reference gets one verdict:
The findings say what is wrong:
Every rule has a page: what it checks, when it can be wrong, and what to
do. paper-preflight explain REF003 prints it in the terminal.
Four measurements, all against the live sources:
Precision comes first: a reference is called fabricated only on positive evidence, and an
unanswered or ambiguous lookup is reported as "cannot determine", never as "not found". The
evaluation harness and every run's summary are in evals/.
Each week is 20 arXiv papers (cs, stat, q-bio, quant-ph and astro-ph) chosen mechanically. For
1.0, three weeks never used before were committed together, before the changes they measure,
and each was run once on the same code. The gate was at most 1.5 false alarms per 100
references in each week and at most 1.0 on average. Above them are the more recent weeks that
stayed under 1.0, each run once with the version of its time; every week measured, those over
1.0 too, is in evals/README.md.
[software] and [dataset] labels after a
title 2; three others. When a finding is wrong says what to do.evals/README.md.GPTZero published 151 hallucinated references it found in NeurIPS 2025 papers and ICLR 2026 submissions, each confirmed by its staff. Pasted as plain text, as the papers printed them:
evals/results/gptzero.md.HALLMARK (v1.2.3) is a public benchmark of real and hallucinated BibTeX entries. Fabrication counts a wrong identifier, a work not found and no author in common; any issue also counts wrong authors, title, year or venue.
test_public was run with 1.0.0, dev_public with 0.8.0; no rule was tuned on test_public.
dev_public entry
labelled VALID was checked by hand: the 11 that remain are not correct citations (DOIs that
belong to other papers, author lists naming people who did not write the paper, a shifted
year, a truncated title). Without them, both modes reach 100% precision. The list, each with
a reason one lookup confirms: evals/hallmark_disputed.toml.evals/results/.Badalova & Mayr (2026) checked 104 references by hand and published what five tools flagged. On the same references, with their labels:
The sample is small, so the intervals are wide. The study labels a reference correct when the
work exists, so five of paper-preflight's "false" flags point at real errors (a wrong author, a
broken DOI). Two causes of false flags found in this data were fixed before the run above (the
first run measured 62.8%); see evals/results/badalova-mayr.md.
support
reads the claims).--offline works from the
cache. A source that is down, with nothing to answer in its place, makes the run incomplete
(exit code 2), never "clean".Instead of writing an entry from memory, ask for it by DOI, arXiv ID or title. Every field comes from the registry record, which a comment above the entry names:
paper-preflight bib fetch 1810.04805
% Verified with paper-preflight against dblp (conf/naacl/DevlinCLT19), 2026-10-03
@inproceedings{devlin2019bert,
title = {{BERT:} Pre-training of Deep Bidirectional Transformers for Language Understanding},
author = {Devlin, Jacob and Chang, Ming-Wei and Lee, Kenton and Toutanova, Kristina},
booktitle = {NAACL-HLT (1)},
year = {2019},
doi = {10.18653/v1/n19-1423},
eprint = {1810.04805},
archivePrefix = {arXiv},
}
eprint kept (--prefer preprint for the preprint itself).--title (with --author/--year if needed) lists the candidates instead of
choosing when several works match.--format json.bib fix turns findings into edits of your .bib files, taken from the verified records. It
prints a diff and changes nothing until you add --apply:
paper-preflight bib fix path/to/paper --level unsafe
--- a/refs.bib
+++ b/refs.bib
@@ -48,7 +47,7 @@
title = {Adam: A Method for Stochastic Optimization},
author = {Kingma, Diederik P. and Ba, Jimmy},
booktitle = {International Conference on Learning Representations (ICLR)},
- year = {2016},
+ year = {2015},
}
--level safe (the default) only fixes what cannot change which work is cited: identifiers
written so that links break, and DOIs the registry has but the entry lacks.--level unsafe also rewrites authors, title, year and venue from the record, removes
identifiers that point to another work, and cites a preprint as its published version (the
entry type, venue, year, volume, pages and DOI; the eprint is kept). Review the diff first.The JSON report follows a published JSON Schema
(schema_version 1.0): fields may be added, but none is removed or changes meaning within 1.x.
Every option, the cache and its lifetimes: docs/configuration.md.
For a whole project, put the settings in paper-preflight.toml next to the paper (or in a
folder above it, up to the repository's root), or in [tool.paper-preflight] of
pyproject.toml:
ignore-rules = ["REF016"] # never report these rules
ignore-keys = ["internal2024*"] # nor anything about these entries
severity = { REF015 = "info" } # report published preprints as infos
disable-sources = ["s2"] # optional sources only
fail-on = "warning" # as --fail-on; the command line wins
check --config <path> names the file instead. The optional sources are s2, openlibrary,
github, pypi, cran, huggingface, openml, web (links to web pages) and wayback;
the registries that judge a reference cannot be turned off. A mistake in the file (an unknown
rule or setting) is an error, never silently ignored. The JSON report names the file in
run.notes, and the MCP server reads it too.
A comment directly above an entry silences rules for that entry, with an optional reason:
% preflight: ignore[REF003] reason="internal technical report, not indexed anywhere"
@techreport{lab2024internal,
...
}
The verdict stays in the JSON report; only the finding is dropped. A suppression that silenced nothing is reported as CFG001 (info), so stale comments do not pile up (for reference rules, only after a complete online run, since offline answers and outages may leave them unrun).
paper-preflight works without any account. These optional environment variables make it faster and more complete; their values are never printed or logged.
paper-preflight doctor shows which are set and whether each source answers right now.
Claude Code: install the plugin. It bundles an MCP server and a skill that makes Claude check the references before calling a paper finished, fix only what is proven wrong, and never invent a reference.
claude plugin marketplace add amos689/paper-preflight
claude plugin install paper-preflight@paper-preflight
Codex, Gemini CLI, Copilot, Cursor and other agents: install the same skill
(gh skill install amos689/paper-preflight paper-preflight works too). It runs the CLI when no
MCP server is configured:
npx skills add amos689/paper-preflight
MCP clients (Codex, Cursor, VS Code, …): run paper-preflight mcp (the mcp extra). The
tools are read-only and confined to your workspace; see docs/mcp.md.
GitHub Actions: uses: amos689/paper-preflight@main checks the paper on every push, with
the report in the job summary and optional code-scanning alerts; see
docs/github-action.md.
pre-commit: check citation keys and cached verdicts on every commit in seconds; see docs/pre-commit.md.
Python:
import paper_preflight
report = paper_preflight.check_paper("paper/")
for ref in report.references:
print(ref.key, ref.verdict, [f.rule for f in ref.findings])
The results are plain, frozen dataclasses; see docs/python-api.md.
support looks in each cited work for a passage that says what the citing sentence claims. It
reads the work's text (the arXiv source, an open-access full text or PDF, or else the abstract)
and a small local model (HHEM-2.1-open, 0.4 GB) scores the passages ranked best for the claim.
It needs the support extra.
paper-preflight support path/to/paper --download-model --all
--download-model fetches the model's weights once; --all also lists the confirmed citations
with their quotes. arxiv:<id> works as a target, as it does for check.
evals/results/support.md.preflight_cited_passages returns each claim with
the cited work's best passages, for the agent to judge by the same rules, without the model.
On 100 gold-set citations, a Claude agent judging from it confirmed 39% of the real ones,
against HHEM's 9%, every confirmation at least partly supported (the labels come from the
same model family).\iffalse blocks and
\includeonly are respected, .aux files are used when they are fresh, and the first
definition of a duplicated key wins, as in BibTeX.--offline
works.Help evade plagiarism or AI-text detection, scrape paywalled or bot-protected sites, recommend or "complete" references from memory, or name and shame authors.
What each release brought is in the changelog; day-to-day progress in docs/PROGRESS.md (in Chinese).
Bug reports with a reproducible .bib entry are the most valuable contribution, especially
false positives. See CONTRIBUTING.md; security issues:
SECURITY.md.
MIT. See THIRD_PARTY_NOTICES.md for adapted code.
Checks every LaTeX reference against Crossref, dblp, arXiv, DataCite, PubMed and OpenAlex. No LLM.
{ "mcpServers": { "io.github.amos689-paper-preflight": { "command": "uvx", "args": [ "paper-preflight==1.0.0" ] } }}Tools
Noch keine Tool-Liste. Remote-Server erhalten eine nach dem ersten Health-Check.
FAQ
Kopieren Sie auf dieser Seite die stdio-Konfiguration für Cursor, Claude Desktop, Claude Code oder VS Code. Sie nutzt die Installation des Herausgebers, keinen PlugMCP-Proxy.
In diesem Eintrag ist keine erforderliche Umgebungsvariable aufgeführt.
Paper Preflight läuft lokal über stdio.
Zuletzt geprüft: 2026-11-09. Checks every LaTeX reference against Crossref, dblp, arXiv, DataCite, PubMed and OpenAlex. No LLM.