Cited AI crawler registry (training, search or user fetch) plus robots.txt checks. No fetching.
See what GPTBot, ClaudeBot and other crawlers get from a site: robots.txt checks and AI scans.
Publish webpages and documents, send private review links, and collect comments and approvals.
BSE India filings as JSON: announcements, ex-dates, board meetings, result dates, deals. $3/1k
AI-crawler readiness checks and fixes: GEO score, robots.txt, schema.org, FAQ and llms.txt.
Audit a site for AI readiness: AI-crawler access, schema, FAQ, content structure. Generates fixes.
Cutshort India startup & tech jobs as JSON: salary range, skills, remote, company, JD. $0.80/1k
Search technical documentation and read web pages as markdown.
MCP server for technical & on-page SEO audits — crawlability, HTTPS, Core Web Vitals, sitemap, robots.txt, structured data, and AI-crawler access. Reports as Markdown, JSON, or a shareable HTML file.
AI-visibility audit: AI crawler access, identity files, page signals, hosted analysis.
MCP server for Riveter's enrichment, scraping, and monitoring API
WCAG 2.2 scanners for web pages, Office, PDF, ePub and Markdown: contrast, axe, veraPDF and more.
Web page or HTML to clean LLM-ready Markdown or JSON. x402 pay-per-call, $0.005, no API key.
Bing Webmaster, IndexNow and Google Search Console for AI: rankings, indexing gaps, AI crawlers.
Micro-settled web content extraction and JSON schema validation utilities for AI agents via XRPL.
Track brand mentions & keywords on Bluesky. Sentiment, engagement, author reach. Pay per result.
Bulk Bluesky profiles plus full follower/following exports via the open AT Protocol. Pay per record.
Local stdio MCP server for AnyAPI - hundreds of scraping and data APIs behind one key, priced per request in USD. Proxies to the hosted AnyAPI MCP server.
IIMJobs MBA/finance jobs JSON, full JD. $2/1k + $0.001/run. Apify Bearer token required.
Google Trends for agents: trend verdict, stats, rising queries, regions, trending now.
Dubai Ejari rent contracts as JSON: annual rent AED, rent/sqm, area, new vs renewed. $1/1k
Parse user-agent strings into browser, engine, OS and device, and flag crawlers - fully local.
Scrapingdog web-scraping & SERP APIs: web scrape, Google, Amazon, LinkedIn, YouTube, and more.
DEPRECATED — G2's Cloudflare anti-bot defeats free scraping. Not commercially viable without paid
Pixel-perfect webpage screenshots rendered in a real browser, full-page or viewport, via one POST.
Convert any webpage to clean LLM-ready markdown, extraction-first, with article and news modes.
40+ competitive intel tools. Brand.dev, Coresignal, Keywords Everywhere, Exa, Firecrawl.
64 public Apify Actors for public-record, jobs, lead, SEO and social data, as MCP tools.
Undetectable cloud browser sessions for AI agents and scrapers. Navigate, extract, click, captcha.
Gupy (Brazil) jobs as JSON: full description, city, state, workplace and contract type. $0.80/1k
ImportYeti US import records as JSON: bills of lading per company, top suppliers. $2/1k
Query webpages and extract structured data using natural language
India company lookup by CIN or name (MCA): status, capital, email, directors with DIN. $3/1k
Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.
New Indian companies (MCA) as JSON daily: CIN, type, state, activity, capital, address. $3/1k
Magicbricks India listings as JSON: price, price/sq ft, carpet area, BHK, locality. $1/1k
Annuaire complet
Explorez, extrayez et surveillez le web public. 1,406 serveurs, les plus utilisés en premier. Chacun ouvre la page de l'éditeur.