Audit tools for AI literature reviews. CiteProof checks that a review's citations, quotes, counts and risk-of-bias judgements hold up. It comes in two parts: an MCP server for Claude Science and other research agents, and a full research assistant app that writes evidence-grounded papers.
Open-source research assistant and MCP audit toolkit for systematic reviews: cited research reports, PRISMA tracking, evidence and claim checks, and reproducible exports with human oversight.
AI research agents are now good at finding and reading papers. They are less good at proving their work: which databases were searched, how many records were screened, whether a quoted sentence is really in the paper, whether two reviewers agreed. CiteProof is built around that gap.
CiteProof MCP
CiteProof Research
What it is
An MCP server with 24 audit tools
A web app with a 24-agent research pipeline
Who does the research
Your agent (Claude Science, or any MCP client)
The app's own agents
Language model inside
None. It needs no API key
Yes, any OpenAI-compatible endpoint
Best for
Systematic reviews that need an audit trail
Fast cited reports and full evidence-grounded papers
A small first benchmark (two reviews against Claude Science) showed that agents with strong search find far more of the known included studies than CiteProof Research does. That is why the MCP server does not try to search: it audits the work of the agent that does.
CiteProof MCP
CiteProof MCP keeps the records a systematic review needs and checks them: a protocol, a PRISMA record, a screening log, an evidence table, claim checks, risk-of-bias records and an exportable audit trail. It works with Claude Science and with other tools that can run a stdio MCP server, such as research agents and desktop AI clients.
The server has no language model inside. The agent searches, reads, decides and writes. The server stores each decision, checks the evidence it points to, computes the numbers and refuses bad input.
The agent sends the quote and the text. The server matches them after normalising case, whitespace, quotes, dashes and line-break hyphens, on word boundaries. The result is stored as quote_verified.
Numbers in the evidence table come from the quote
Sample size, estimate and confidence limits must be written in the quote. Estimates outside their interval are refused.
PRISMA numbers add up
Counts come from the recorded searches, the deduplication step and the screening decisions, and the flow invariants are checked on every call.
Two reviewers agree
Cohen's kappa over the papers both reviewers decided, with the disagreements listed.
DOIs exist and are not retracted
Crossref and doi.org lookups. An unreachable registry gives "unverified", never "not found".
Citations match the reference list
In-text citations are matched by DOI, author and year, or title. "Resolved" means matched, not supported.
Risk-of-bias overall judgements follow the published rules
RoB 2, ROBINS-I and Newcastle-Ottawa (AHRQ thresholds).
Duplicates
Deterministic clustering by DOI, PMID, then title plus year plus first author.
Quick start
One command, in any MCP client that runs local (stdio) servers:
npx -y citeproof-mcp
The citeproof-mcp npm package is a small launcher. It finds uv (or installs it, unless CITEPROOF_NO_AUTO_INSTALL=1), then runs the Python server from the wheel attached to the matching GitHub release. You need Node.js 18 or newer. Python and git are not required: uv downloads Python 3.12 when needed.
Client
How to add CiteProof MCP
Status
Claude Science
Customize → Connectors → Add connector → Local command. Name citeproof, command npx -y citeproof-mcp.
npx install tested on Claude Science 0.1.70 (Windows 11, 24 tools listed); bundle install tested on 0.1.67
Claude Desktop
Download citeproof.mcpb and open it (Settings → Extensions), or add the JSON below to claude_desktop_config.json.
New in 0.2.0
Claude Code
claude mcp add citeproof -- npx -y citeproof-mcp
New in 0.2.0
Cursor, VS Code, Windsurf, other clients
Add the JSON below to the client's MCP settings (VS Code: the servers form further down).
Everything runs on your computer. Review files go to CITEPROOF_MCP_HOME, or to ~/.citeproof-mcp when it is not set. The server's only network calls are DOI and retraction lookups to Crossref and doi.org. On first run the launcher also downloads its own files: the npm package, and, when no compatible Python is found, uv, Python 3.12 and the server wheel. claude.ai custom connectors need a remote server, so they are not supported.
If Claude Science reports that a file is not readable inside its sandbox, set CITEPROOF_UV_HOME (Advanced settings → environment variables) to a folder inside the connector's workspace, so uv keeps its cache and Python there. The older bundle install in MCP/docs/CLAUDE_SCIENCE.md still works.
pip install ./MCP
Then point the client at the citeproof-mcp command (stdio), optionally with "env": { "CITEPROOF_MCP_HOME": "/path/to/your/review-data" }.
It does not search for papers. Use your agent's search, or the CiteProof Research app below.
It does not judge anything. A label such as "supported" is the agent's judgement. The server only checks that the quote is in the text.
It does not read PDFs. The agent supplies the text.
The PRISMA checklist and the report number check are keyword checks. They show what is mentioned, not whether it is reported well.
CiteProof Research (the app)
An AI-powered multi-agent research workspace with two modes: fast web research that returns a cited report, and a full evidence-grounded academic pipeline that writes complete research papers whose cited claims link back to source passages, with human-in-the-loop quality gates.
Each gate genuinely pauses graph execution via LangGraph interrupt(), allowing the author to approve or request targeted revisions in natural language:
Gate
Phase
Review Artifacts
Guarantees
Gate 1: Planning & Protocol
Phase 1
PICOC Protocol, Objectives, Research Questions, Boolean Keywords
Prevents query divergence before initiating multi-source retrieval
Gate 2: Evidence & Corpus
Phase 3
PRISMA Flow Tracker, Screened Literature, Extracted Evidence Records
Verifies empirical grounding before theoretical synthesis begins
Gate 3: Hypotheses & Framework
Phase 4
Conceptual Framework, Research Gaps, Formulated Hypotheses (H1..H5)
Confirms theoretical validity before committing to full paper generation
Academic integrity and research invariants
Deterministic Flow-Tracking State Machine (PRISMA 2020-aligned):
PRISMATracker.validate_invariants() asserts these internal conservation relations:
full_text_requested is the tracker's internal shortcut for PRISMA's reports sought for retrieval. The distinct PRISMA stages reports not retrieved (full_text_unavailable) and reports assessed for eligibility (full_text_assessed) are tracked as separate fields, but the hand-off between them is not asserted—so the equations above are internal invariants rather than the complete PRISMA 2020 flow. Every count is tracked deterministically in code—never generated or estimated by an LLM.
Immutable Evidence Store:
PaperRecord.paper_id: first 16 hex characters of a SHA-256 digest (a truncated representation, not the full digest) computed over a source-qualified key: doi:<canonicalized DOI> when a DOI is available, otherwise title:<normalized title>:<year>. Normalized titles are not assumed unique, so the fallback key also folds in the publication year (nd when unknown).
EvidenceRecord.evidence_id: deterministic composite identifier {paper_id}_ev001 (the composite is not itself hashed) anchoring exact quote, metric, baseline value, and effect direction.
ReviewClaim.claim_id: deterministic composite identifier {section}_cl001 (section slug truncated to 8 characters) linking paper claims to supporting evidence IDs.
Deterministic Validation Pipeline:
citation_validator: Resolves every in-text citation against known PaperRecord metadata and every ReviewClaim through its claim → evidence → paper → DOI/URL chain; flags citations and claims that do not resolve. This is a resolution check only: it does not test that the cited passage supports the sentence, so a resolving claim is marked resolved, never verified.
claim_validator: Matches numbers in quantitative sentences against extracted EvidenceRecord benchmark metrics (numeric match only).
integrity_auditor: Validates PRISMA invariants and issues comprehensive ValidationReport; passed_all_gates means the resolution and numeric-match gates passed, not that sources support the prose.
CiteProof MCP: the server package citeproof_mcp, its tests and docs, the npm launcher (MCP/npm), the Claude Desktop extension (MCP/mcpb), the companion skill (MCP/skills) and the Claude Science install script
backend/
CiteProof Research: FastAPI app, LangGraph agents, academic API adapters
frontend/
The web UI (vanilla JS, no build step)
tests/
Offline tests for the app (pytest)
docs/
Design notes for the app
scripts/
Helper scripts for the app
Contributing
Contributions are welcome, from typo fixes to new academic source adapters and new MCP checks. Start with CONTRIBUTING.md for setup and a project map, then pick an issue labelled good first issue or help wanted. The test suites run offline with pytest: run pytest --ignore=MCP from the repository root for the app, and python -m pytest inside MCP/ for the MCP server.
Licence
MIT, see LICENSE. Two files inside the MCP server are adapted from Anthropic's Claude Science under the Apache License 2.0; see MCP/NOTICE.md.
Star History
C
CiteProof AI
Aryan-Pardeshi·91 sao·
Open-source research assistant and MCP audit toolkit for systematic reviews: cited research reports, PRISMA tracking, evidence and claim checks, and reproducible exports with human oversight.
Chưa có danh sách công cụ. Máy chủ từ xa sẽ có danh sách sau lần kiểm tra tình trạng đầu tiên.
Câu hỏi thường gặp
Câu hỏi
Làm thế nào để cài đặt CiteProof AI?
Sao chép cấu hình stdio cho Cursor, Claude Desktop, Claude Code hoặc VS Code trên trang này. Cấu hình dùng bản cài đặt của nhà phát hành, không phải proxy của PlugMCP.
CiteProof AI có cần khóa API không?
Bản ghi này không liệt kê biến môi trường bắt buộc nào.
CiteProof AI dùng giao thức truyền tải nào?
CiteProof AI chạy cục bộ qua stdio.
CiteProof AI được kiểm tra lần cuối khi nào?
Kiểm tra lần cuối: 2026-10-27. Open-source research assistant and MCP audit toolkit for systematic reviews: cited research reports, PRISMA tracking, evidence and claim checks, and reproducible exports with human oversight.