Skip to content
plugmcp
DirectorySkillsCategoriesBlog
EN/δΈ­ζ–‡
Sign inSign up
Home/Servers/LLM Latency Tracker

LLM Latency Tracker

by dev.llmlatency

Measured latency, time to first token and uptime for ~45 AI inference APIs, by region.

Power your agent

Add this server

The publisher's own URL. Not a PlugMCP endpoint.

Server URL
https://llmlatency.dev/mcp
Provider
Add in Claude

Claude opens with the name and URL filled in. You still confirm it there.

Claude Code
claude mcp add --transport http dev.llmlatency-llm-latency-tracker https://llmlatency.dev/mcp

Run in a terminal.

Claude Desktop
{
  "mcpServers": {
    "dev.llmlatency-llm-latency-tracker": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://llmlatency.dev/mcp"
      ]
    }
  }
}

claude_desktop_config.json

Step-by-step: add this in Claude

Remote URL or a command on your machine? How the two installs differ

Run on PlugMCP

Host a copy with our keys and logs.

A new server you create. It is not this listing's official endpoint. Use the publisher install when you want their URL and their credentials.

Launch

Related MCP

View more
  • FirecrawlπŸ”₯ Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
  • N
    NotionToken-auth Notion MCP: pages, databases, blocks, comments, files. Runs headless in CI and agents.
  • Context7Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors

Related skills

View all
  • reaReverse engineer anything with agents, from app behavior down to native binaries.
  • rea-changelog-updatePrepare or rewrite REA release changelogs and GitHub release notes from pinned Git history, with verified contributor thanks and Release Please synchronization.
  • rea-tool-designDesign or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.

Questions

How do I install LLM Latency Tracker?
Copy the http config for Cursor, Claude Desktop, Claude Code, or VS Code on this page. It uses the publisher's install, not a PlugMCP proxy.
Does LLM Latency Tracker need an API key?
No required environment variable is listed on this record.
What transport does LLM Latency Tracker use?
LLM Latency Tracker is reached over HTTP.
When was LLM Latency Tracker last checked?
Last checked 2026-10-16. Measured latency, time to first token and uptime for ~45 AI inference APIs, by region.

Measured latency, time to first token and uptime for ~45 AI inference APIs, by region.

πŸ“Š LLM Latency Tracker

Measure AI API latency and uptime across regions, and publish the results as open data.

🌐 Live rankings · JSON API · MCP endpoint

⚑ What it does

  • 🌍 Regional measurements β€” compare provider response times and availability from distributed probe nodes.
  • ⏱️ Two probe types β€” network time to first byte (TTFB) and optional inference time to first token (TTFT).
  • πŸ“ˆ Open dataset β€” daily rankings, historical snapshots and regional p50 / p95 statistics.
  • πŸ€– Agent access β€” JSON API, MCP, Markdown pages and an llms.txt index.
  • πŸ—“οΈ Model lifecycle β€” a deprecation calendar with links to provider announcements.

πŸ”§ Built for measurement

  • Python standard-library core for edge probes; provider keys are needed for inference probes.
  • SQLite storage and regional aggregation, with remote nodes shipping measurements to a central node.
  • Static publishing for the website and JSON datasets.
  • CI checks for tests and linting; published snapshots include their measurement date.

Reading the results: edge TTFB measures network/API responsiveness, not model generation speed. Compare it separately from inference TTFT; results depend on region, probe type and time window.

πŸš€ Quick start

Use the public data without installing anything:

curl https://llmlatency.dev/api/rankings.json

Or run edge probes locally with Python 3.12+:

git clone https://github.com/mazamaka/llm-latency-tracker.git
cd llm-latency-tracker
REGION=local python3 run.py
python3 aggregate.py --region local

For a local stdio MCP server over the published API (stdlib only, no keys):

python3 mcp_server.py

Tools: get_ai_api_latency (provider leaderboard per region), get_provider_latency (one provider across regions), get_model_deprecations (model shutdown calendar), get_coding_agent_health (Claude Code / Codex speed and accuracy drift). All read-only.

Inference probes, API access & site generation β†’ Β· Deployment β†’

πŸ§ͺ Contributing

Add a provider, bring a new probe region, or improve the measurement code. See CONTRIBUTING.md for setup and checks.


Python Β· SQLite Β· JSON API Β· MCP Β· Cloudflare Pages

Code: MIT Β· Data: CC-BY-4.0, with attribution to llmlatency.dev.

Daily snapshot β€” 2026-10-21

Measured latency across 46 AI inference providers in 4 regions. Method: distributed edge (DNS→TCP→TLS→TTFB) + inference (TTFT) probes, last 24h. License: CC-BY-4.0.

RegionFastest provider (p50)p50p95Uptime
Asia (Tokyo)fireworks18 ms58 ms100%
Europe (Germany)fireworks97 ms199 ms100%
South America (SΓ£o Paulo)openrouter62 ms100 ms100%
US (Central)fireworks29 ms75 ms100%
  • Full dataset: data/rankings/2026-10-21.json (latest)
  • Citable archive (DOI): 10.5281/zenodo.23388429 β€” daily aggregates, CC-BY-4.0
  • Hugging Face dataset: https://huggingface.co/datasets/llmlatency/llm-latency-tracker
  • Kaggle dataset: https://www.kaggle.com/datasets/llmlatency/llm-latency-tracker
  • Archived in Software Heritage: swh:1:snp:2778cbabd72a70a629ee35fbd5ac536d1ccb7a9a
  • Python client: https://pypi.org/project/llmlatency/
  • Live rankings and methodology: https://llmlatency.dev
  • Machine-readable API: https://llmlatency.dev/api/rankings.json
  • Model deprecation calendar: https://llmlatency.dev/deprecations

Snapshot generated 2026-10-21T07:23:54Z β€” this table is regenerated daily.

How do I install LLM Latency Tracker?
Copy the http config for Cursor, Claude Desktop, Claude Code, or VS Code on this page. It uses the publisher's install, not a PlugMCP proxy.
Does LLM Latency Tracker need an API key?
No required environment variable is listed on this record.
What transport does LLM Latency Tracker use?
LLM Latency Tracker is reached over HTTP.
When was LLM Latency Tracker last checked?
Last checked 2026-10-16. Measured latency, time to first token and uptime for ~45 AI inference APIs, by region.

No tool list yet. Remote servers get one after the first health check.

plugmcp

Plug any tool into any agent. MCP servers for people who do not write servers. Gateway for volume, n8n for apps.

  • github.com/TODO
  • x.com/TODO
  • linkedin.com/company/TODO

PlugMCP, 2026

Product
  • Browse
  • Install
  • Host your own
  • Pricing
  • Voice mode
  • Browser
Directory
  • All MCP servers
  • MCP Apps
  • Tools
  • Agent skills
  • Categories
  • New
  • Voice
  • Submit a server
Developers
  • Docs
  • Blog
  • Club
  • Work with us
  • What is MCP
  • What is WebMCP
  • Status
Company
  • About
  • Contact
  • Terms
  • Privacy
  • DPA