π LLM Latency Tracker
Measure AI API latency and uptime across regions, and publish the results as open data.
π Live rankings Β· JSON API Β· MCP endpoint
β‘ What it does
- π Regional measurements β compare provider response times and availability from distributed probe nodes.
- β±οΈ Two probe types β network time to first byte (TTFB) and optional inference time to first token (TTFT).
- π Open dataset β daily rankings, historical snapshots and regional p50 / p95 statistics.
- π€ Agent access β JSON API, MCP, Markdown pages and an
llms.txtindex. - ποΈ Model lifecycle β a deprecation calendar with links to provider announcements.
π§ Built for measurement
- Python standard-library core for edge probes; provider keys are needed for inference probes.
- SQLite storage and regional aggregation, with remote nodes shipping measurements to a central node.
- Static publishing for the website and JSON datasets.
- CI checks for tests and linting; published snapshots include their measurement date.
Reading the results: edge TTFB measures network/API responsiveness, not model generation speed. Compare it separately from inference TTFT; results depend on region, probe type and time window.
π Quick start
Use the public data without installing anything:
curl https://llmlatency.dev/api/rankings.json
Or run edge probes locally with Python 3.12+:
git clone https://github.com/mazamaka/llm-latency-tracker.git
cd llm-latency-tracker
REGION=local python3 run.py
python3 aggregate.py --region local
For a local stdio MCP server over the published API (stdlib only, no keys):
python3 mcp_server.py
Tools: get_ai_api_latency (provider leaderboard per region), get_provider_latency (one provider across regions), get_model_deprecations (model shutdown calendar), get_coding_agent_health (Claude Code / Codex speed and accuracy drift). All read-only.
Inference probes, API access & site generation β Β· Deployment β
π§ͺ Contributing
Add a provider, bring a new probe region, or improve the measurement code. See CONTRIBUTING.md for setup and checks.
Python Β· SQLite Β· JSON API Β· MCP Β· Cloudflare Pages
Code: MIT Β· Data: CC-BY-4.0, with attribution to llmlatency.dev.
Daily snapshot β 2026-10-21
Measured latency across 46 AI inference providers in 4 regions. Method: distributed edge (DNSβTCPβTLSβTTFB) + inference (TTFT) probes, last 24h. License: CC-BY-4.0.
| Region | Fastest provider (p50) | p50 | p95 | Uptime |
|---|---|---|---|---|
| Asia (Tokyo) | fireworks | 18 ms | 58 ms | 100% |
| Europe (Germany) | fireworks | 97 ms | 199 ms | 100% |
| South America (SΓ£o Paulo) | openrouter | 62 ms | 100 ms | 100% |
| US (Central) | fireworks | 29 ms | 75 ms | 100% |
- Full dataset:
data/rankings/2026-10-21.json(latest) - Citable archive (DOI):
10.5281/zenodo.23388429β daily aggregates, CC-BY-4.0 - Hugging Face dataset: https://huggingface.co/datasets/llmlatency/llm-latency-tracker
- Kaggle dataset: https://www.kaggle.com/datasets/llmlatency/llm-latency-tracker
- Archived in Software Heritage:
swh:1:snp:2778cbabd72a70a629ee35fbd5ac536d1ccb7a9a - Python client: https://pypi.org/project/llmlatency/
- Live rankings and methodology: https://llmlatency.dev
- Machine-readable API: https://llmlatency.dev/api/rankings.json
- Model deprecation calendar: https://llmlatency.dev/deprecations
Snapshot generated 2026-10-21T07:23:54Z β this table is regenerated daily.