@sylphx/cue

Cue

Video answers with timestamp-level proof

Cue gives agents a local video timeline they can search and cite: streams, chapters, subtitles, scenes, frames, and exact timestamps.

npx -y @sylphx/cue

For Claude Code:

claude mcp add cue -- npx -y @sylphx/cue

The fastest useful workflow

{
  "sources": [{ "path": "/absolute/path/to/demo.mp4" }],
  "include_subtitles": true
}

Then ask:

“Find the moment where the presenter explains the pricing change.”

Cue returns the matching timestamp, surrounding transcript, source hash, and a route to render or crop the exact frame.

Jobs Cue is built for

Ask your agent	Cue returns
“Find this quote.”	timestamped transcript evidence
“Summarize this meeting.”	chapters and subtitle-backed notes
“Where is the code shown?”	timestamped frame and crop evidence
“What changed in this demo?”	timeline and structural scene boundaries
“Give me the useful moments.”	compact timeline with warnings and gaps

Tool surface

Tool	Purpose
read_video	Build a local timeline from streams, subtitles, scenes, and keyframes
search_video	Search subtitles/transcripts and return timestamped matches
video_evidence	Render, crop, or OCR a frame at a known timestamp

Predictable defaults

• fast probes streams and reads embedded metadata/subtitles.
• quality explicitly requests scene detection, keyframes, OCR, or local ASR.
• No cloud video API or frame-by-frame vision model is required.
• Missing ffprobe, subtitles, or ASR is reported as a gap, not guessed around.

Why agents trust it

Every claim can point back to timestamp_ms, stream index, subtitle range, frame index, or source hash. Structural keyframes are preferred over sampling every frame.

Companion MCP tools

Product	Job
Citra	PDF answers with page-level proof
Iris	Image facts and pixel evidence
Spine	Repository architecture and impact
Locus	Exact code-chunk retrieval
Lookout	Web research with source excerpts

Each product is independent. Install only the tools your agent needs.

Development

bun install
bun run build
bun test
cargo test
bun run benchmark:public-proof
bun run benchmark:release-gate

License

MIT