Affiliate product search for AI agents. Merchant feeds, not web scraping. Works with any MCP client.
Convert PDF, Word, Excel, PowerPoint, e-mails and web pages to clean Markdown for LLMs.
Check what AI crawlers may read and what a page permits, generate llms.txt and schema.
Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
Weibo posts, hot search, comments and profiles to JSON. No login or cookies needed.
Publish web pages to spacesheep.dev from a terminal or CI: `npx spacesheep deploy ./dist`
Open-source web scraper for AI agents with scrape, crawl, and map tools
Due diligence on Canadian companies: registry status, sanctions and risk signals via Apify.
Screen names/IDs against Ukraine's NSDC State Sanctions Register (snapshot) via Apify.
Domain reputation over time: Domain Rating, Tranco rank, TLS, and AI crawler policy.
Find agent skills that render videos, decks, images and web pages, and get their install command.
EU tenders from TED with competition data: bids per buyer, single-bid rate, winners. Via Apify.
Web scraping, inference, DNS, monitoring from residential IPs — pay per request in USDC
AEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.
Unofficial ScrapeCreators MCP — wraps the ScrapeCreators social-media + ad-library scraping API…
Unofficial ScraperAPI MCP — wraps ScraperAPI (scraperapi.com), a proxy-based web scraper with…
Unofficial ScrapingAnt MCP — wraps the ScrapingAnt web scraping API (scrapingant.com)
Unofficial ScrapingBee MCP — wraps the ScrapingBee headless-scraping API (scrapingbee.com)
Unofficial Scrapingdog MCP — wraps Scrapingdog (scrapingdog.com), a proxy-based web scraping API…
Public Telegram channel posts, views, reactions, media and subscriber counts. No login needed.
Watch web pages and get a short summary of what changed. Create monitors and read changes.
AliExpress search results as JSON: price, discount, rating, units sold. Runs on Apify.
Open jobs and hiring changes for any company, from its domain. Runs on Apify.
Hiring, Google ads and SEO signals for a company domain, with a 0-100 intent score. Runs on Apify.
Google Jobs listings for any role and city: company, salary, job type, apply link. Runs on Apify.
Jobs, ads, SEO, keywords, YouTube and AliExpress data for AI agents. Runs on Apify.
Transcripts of YouTube videos and Shorts in bulk, with timestamps. Runs on Apify.
AI speech-to-text for public TikTok videos: SRT, VTT, word timings, speaker labels, 90+ languages.
Geocode US addresses to census tracts and add ACS demographics. Runs on Apify.
Spreadsheet, census tract, PDF-to-Markdown, SEO/AI audit and video frame tools for agents, on Apify.
PDF, DOCX and scans to Markdown, CSV tables and RAG chunks with OCR. Runs on Apify.
Audit pages for SEO and AI search: scores, fixes, AI crawler access, llms.txt. Pay per use.
Clean, dedupe, join and reconcile CSV/Excel files. Runs on Apify, pay per use.
Evidence-bearing public webpage monitoring with hashes, diffs, signed webhooks, REST, and MCP.
Web pages your agent can quote: 1,000 full fetches a month free, no card, then $0.01 a page.
Instagram reel transcripts from the audio, in the language spoken, via Apify. Silent reels free.
Gesamtes Verzeichnis
Das öffentliche Web crawlen, extrahieren und überwachen. 1,406 Server, die meistgenutzten zuerst. Jeder öffnet die Seite des Herausgebers.