Merged into anymd (2026-09-25). anymd reads PDFs, Office files, EPUB, web pages, images and video into clean Markdown for AI agents:
npx -y @sylphx/anymd. This repository is archived.
Cue
Video answers with timestamp-level proof
Cue gives agents a local video timeline they can search and cite. The default read returns container metadata, streams, chapters, and embedded subtitles. Scenes and frames are separate.
npx -y @sylphx/cue
For Claude Code:
claude mcp add cue -- npx -y @sylphx/cue
Read a local video
{
"sources": [{ "path": "/absolute/path/to/demo.mp4" }]
}
That call uses the fast profile. It returns container metadata, streams,
chapters, and embedded subtitles. It does not detect scenes, extract frames,
or run speech recognition.
Then ask:
“Which chapter covers the pricing change?”
Cue returns chapter and subtitle locators with timestamp_ms and the source
hash. It does not invent a transcript. A quote search matches embedded
subtitles only. Render or crop a frame afterwards with video_evidence, once
you have a timestamp.
Jobs Cue is built for
| Ask your agent | Cue returns |
|---|---|
| “Find this quote.” | a timestamped match in embedded subtitles, when those subtitles exist |
| “Summarize this meeting.” | chapters and embedded subtitles |
| “Where is the code shown?” | one frame from video_evidence at a known timestamp |
| “What changed in this demo?” | scene boundaries when profile is quality or include_scenes is set |
| “Give me the useful moments.” | chapters, embedded subtitles, warnings, and gaps |
Tool surface
| Tool | Purpose |
|---|---|
read_video | Default fast profile: container metadata, streams, chapters, and embedded subtitles. Scenes are opt-in. |
search_video | Search embedded subtitle cues. It does not run speech recognition. |
video_evidence | Named follow-up: render, crop, or OCR one frame at a timestamp |
Predictable defaults
- Omitted
profileisfast: container metadata, streams, chapters, and embedded subtitles. No scenes, frames, or speech recognition. profilequalityadds ffmpeg scene detection. It does not extract frames or run speech recognition.include_keyframesandinclude_transcriptstay off. Setting either one on the shipped server returns a warning and an empty array.- OCR stays on
video_evidence. - No cloud video API or frame-by-frame vision model is required.
- Missing ffprobe or embedded subtitles is reported as a gap, not guessed around.
Why agents trust it
Every claim can point back to timestamp_ms, a stream index, a subtitle range,
or the source hash. A frame index is present only after video_evidence.
Companion MCP tools
| Product | Job |
|---|---|
| Citra | PDF answers with page-level proof |
| Iris | Image facts and pixel evidence |
| Spine | Repository architecture and impact |
| Locus | Exact code-chunk retrieval |
| Lookout | Web research with source excerpts |
Each product is independent. Install only the tools your agent needs.
Development
bun install
bun run build
bun test
cargo test
bun run benchmark:public-proof
bun run benchmark:release-gate
License
MIT