Thu thập, trích xuất và giám sát web công khai. 1,406 máy chủ, dùng nhiều nhất xếp trước. Mỗi máy chủ mở ra trang của nhà phát hành.
Cited AI crawler registry (training, search or user fetch) plus robots.txt checks. No fetching.
See what GPTBot, ClaudeBot and other crawlers get from a site: robots.txt checks and AI scans.
Publish webpages and documents, send private review links, and collect comments and approvals.
BSE India filings as JSON: announcements, ex-dates, board meetings, result dates, deals. $3/1k
AI-crawler readiness checks and fixes: GEO score, robots.txt, schema.org, FAQ and llms.txt.
Audit a site for AI readiness: AI-crawler access, schema, FAQ, content structure. Generates fixes.
Cutshort India startup & tech jobs as JSON: salary range, skills, remote, company, JD. $0.80/1k
Search technical documentation and read web pages as markdown.
MCP server for technical & on-page SEO audits — crawlability, HTTPS, Core Web Vitals, sitemap, robots.txt, structured data, and AI-crawler access. Reports as Markdown, JSON, or a shareable HTML file.
AI-visibility audit: AI crawler access, identity files, page signals, hosted analysis.
MCP server for Riveter's enrichment, scraping, and monitoring API
WCAG 2.2 scanners for web pages, Office, PDF, ePub and Markdown: contrast, axe, veraPDF and more.
Web page or HTML to clean LLM-ready Markdown or JSON. x402 pay-per-call, $0.005, no API key.
Bing Webmaster, IndexNow and Google Search Console for AI: rankings, indexing gaps, AI crawlers.
Micro-settled web content extraction and JSON schema validation utilities for AI agents via XRPL.
Track brand mentions & keywords on Bluesky. Sentiment, engagement, author reach. Pay per result.
Bulk Bluesky profiles plus full follower/following exports via the open AT Protocol. Pay per record.
Local stdio MCP server for AnyAPI - hundreds of scraping and data APIs behind one key, priced per request in USD. Proxies to the hosted AnyAPI MCP server.
IIMJobs MBA/finance jobs JSON, full JD. $2/1k + $0.001/run. Apify Bearer token required.
Google Trends for agents: trend verdict, stats, rising queries, regions, trending now.
Dubai Ejari rent contracts as JSON: annual rent AED, rent/sqm, area, new vs renewed. $1/1k
Parse user-agent strings into browser, engine, OS and device, and flag crawlers - fully local.
Scrapingdog web-scraping & SERP APIs: web scrape, Google, Amazon, LinkedIn, YouTube, and more.
DEPRECATED — G2's Cloudflare anti-bot defeats free scraping. Not commercially viable without paid
Pixel-perfect webpage screenshots rendered in a real browser, full-page or viewport, via one POST.
Convert any webpage to clean LLM-ready markdown, extraction-first, with article and news modes.
40+ competitive intel tools. Brand.dev, Coresignal, Keywords Everywhere, Exa, Firecrawl.
64 public Apify Actors for public-record, jobs, lead, SEO and social data, as MCP tools.
Undetectable cloud browser sessions for AI agents and scrapers. Navigate, extract, click, captcha.
Gupy (Brazil) jobs as JSON: full description, city, state, workplace and contract type. $0.80/1k
ImportYeti US import records as JSON: bills of lading per company, top suppliers. $2/1k
Query webpages and extract structured data using natural language
India company lookup by CIN or name (MCA): status, capital, email, directors with DIN. $3/1k
Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.
New Indian companies (MCA) as JSON daily: CIN, type, state, activity, capital, address. $3/1k
Magicbricks India listings as JSON: price, price/sq ft, carpet area, BHK, locality. $1/1k