Major search engines block datacenter and VPS IP addresses with CAPTCHAs. Daedra solves this with a multi-backend fan-out. All available backends run the query at once, and the results merge by relevance:
Mwmbl → Brave → Marginalia → Bing RSS → Bing → Google News → Hacker News → Google → Wikipedia → StackOverflow → GitHub → Wiby → DDG Instant → DuckDuckGo HTML
Self-contained web search MCP server in Rust. 13 search backends with automatic fallback. No API keys for basic search.
ดาว
17
เครื่องมือ
—
อัปไทม์
—
Three backend groups exist. Scraper backends read HTML and sometimes meet a CAPTCHA. Machine-format backends read RSS and JSON feeds that engines publish for integrations. Knowledge backends query Wikipedia, StackOverflow, GitHub, Wiby, and DDG Instant. All fourteen backends need no paid search key.
Unkeyed general coverage depends on where daedra runs. Mwmbl and Marginalia answer from any IP. Brave HTML may rate-limit. The knowledge and machine-format backends (wiki, HN, StackOverflow, GitHub, Bing RSS, Google News) work from any IP.
Per-backend circuit breakers and per-backend rate limits keep the chain stable under load. The chain retries only transient errors. Bot protection and rate-limit errors fail fast, so the next backend starts at once.
Features
14 unkeyed search backends with automatic fallback (see the table below)
Circuit breaker (BackendHealth): opens after repeated failures, with a 30 second cooldown
Per-backend rate limits via governor, with separate quotas for knowledge and scraper backends
Classified retry: the chain retries only transient errors
Readability extraction: dom_smoothie extracts the article body from HTML pages
PDF support: infer detects the MIME type, pdf-inspector extracts Markdown (OCR-needing pages are reported)
Content classification: FetchedContent (Html / Pdf / Binary) on every fetch
URL classification: src/url_classification.rs maps search result URLs to content types
MCP tools: web_search, visit_page, crawl_site, and the search_duckduckgo alias
Install
cargo install daedra
Search backends
Backend
Type
API Key
Works from VPS?
Mwmbl
Public JSON API
None
Always
Brave
HTML scraping
None
Sometimes (rate limits)
Marginalia
Public JSON API
None / MARGINALIA_API_KEY
Always (no SLA)
Bing RSS
format=rss machine output
None
Always
Bing
HTML scraping
None
Sometimes (CAPTCHA risk)
Google News
News RSS feed
None
Always
Hacker News
Algolia JSON API
None
Always
Google
HTML scraping
None
Rarely (CAPTCHA risk)
Wikipedia
OpenSearch API
None
Always
StackExchange
Public API
None
Always
GitHub
Public API
None / GITHUB_TOKEN
Always
Wiby
Indie web search
None
Always
DDG Instant
Knowledge graph API
None
Always
DuckDuckGo
HTML scraping
None
Rarely (blocked since mid-2025)
The merge ranks every result by how much of the query it shares. Results that share no query token land after every matched result. When no result matches at all, the search reports this. It does not return unrelated feed noise. Backends that ignore the query cannot outvote backends that found nothing relevant.
This crate does not accept paid search keys. Mwmbl and Marginalia are the unkeyed general indexes. HTML scrapers may meet a CAPTCHA. Knowledge and feed backends stay on wiki, HN, StackOverflow, GitHub, and RSS.
--backend and --exclude select or skip backends by name. --time-range d|w|m|y filters by recency on the backends that support it (Hacker News, Google News).
Usage
MCP server (for Claude, Cursor, pawan, and similar agents)
search_duckduckgo is an alias for web_search. It exists for backward compatibility.
visit_page
Fetch a page and extract the content as Markdown. HTML pages use dom_smoothie Readability extraction. The infer crate detects PDFs, and pdf-inspector extracts Markdown. Office documents (docx, doc, odt, rtf, epub, pptx, xlsx, csv) convert via anydoc.
Crawl a site from a root URL and return Markdown for each page. The crawler always fetches the root page, honors robots.txt (longest-match rule; ignore_robots opts out), expands one level of sitemap indexes, and can follow same-origin link layers with depth (max 5). delay_ms staggers fetches. The command exits non-zero when it fetched zero pages.