Power your agent
การติดตั้งจากผู้เผยแพร่ ไม่ใช่เอนด์พอยต์ของ PlugMCP
URL แบบรีโมตหรือคำสั่งบนเครื่องของคุณ? การติดตั้งสองแบบต่างกันอย่างไร
รันบน PlugMCP
A new server you create. It is not this listing's official endpoint. Use the publisher install when you want their URL and their credentials.
เปิดจากผู้เผยแพร่
DJAI Academy community-built, free open-source technical SEO crawler and Screaming Frog alternative with JavaScript audits, reports, a local dashboard, and an MCP server for AI agents. Theoretical 100M+ URL architecture.
SEO Screaming Toad, also called DJAI Toad, is a free, open-source technical SEO crawler and website audit tool. It crawls sites locally, preserves evidence in SQLite, audits raw and JavaScript-rendered pages, compares recrawls, exports reports, and exposes a guarded Model Context Protocol (MCP) server so AI agents can operate real SEO audits.
The product is co-created by DJAI Academy trainers and community members, with Siamese Cat Dev as its creator. It brings together practical SEO, product development, AI-agent workflows, and the DJAI community's build-in-public spirit.
If you are searching for an open-source Screaming Frog alternative, a self-hosted SEO spider, a Go website crawler, or an MCP-powered SEO audit tool, this project is built for that workflow—without uploading your crawl database to a hosted service.
[!IMPORTANT] SEO Screaming Toad is an independent project and is not affiliated with or endorsed by Screaming Frog Ltd. “Screaming Frog” is used only for descriptive comparison; this project does not claim feature parity. The current project is a release candidate, so review the project state before production use.
These are real screenshots from a local 10-page DJAI Academy verification crawl—not mockups or fabricated audit data.
The dense desktop-style workbench keeps projects, bounded crawl profiles, audit evidence, recrawl history, and service links visible without turning a technical audit into a collection of disconnected screens.
Guarded, reusable crawl setup. Define the seed, URL ceiling, raw or JavaScript-rendered mode, compression compatibility, subdomain scope, and path exclusions. Preview scope before starting; robots, DNS/IP, redirect, response-size, and rate controls remain enforced.
SEO Screaming Toad is not merely a free crawler with a different mascot. It is built around workflows that matter when an audit must be repeatable, explainable, automatable, and safe:
If you already use Screaming Frog SEO Spider, test Toad on a representative authorized site and compare coverage, false positives, rendered output, exports, and the workflows your team actually depends on. Teams that value open code, first-class MCP automation, local evidence, and community-driven rules may find a compelling reason to switch; teams dependent on a mature commercial integration should validate that dependency before migrating.
Requirements: Go version from .go-version. Node and pnpm are needed only for rendered mode or frontend development.
git clone https://github.com/lovecatisgood-sudo/Free-Opensource-SEO-Screaming-Toad-not-Frog-tool-with-100million-url-crawl-potential.git
cd Free-Opensource-SEO-Screaming-Toad-not-Frog-tool-with-100million-url-crawl-potential
make bootstrap
go run ./cmd/seo-auditor
Open http://127.0.0.1:7331, create a project and crawl profile, preview its scope, and start an authorized public-site audit.
For a sandboxed development environment:
docker compose up -d dev
docker compose exec dev bash
make test
See DEVELOPMENT.md for container boundaries and the host-toolchain path. Only crawl websites you own or are authorized to test.
SEO Screaming Toad includes seo-auditor-mcp, a stdio MCP server built with the official Go SDK. An MCP-compatible AI agent can create bounded profiles, preview scope, start or control crawls, inspect SEO issues and page evidence, compare runs, and export managed reports.
AI agent / MCP client
│ stdio
▼
seo-auditor-mcp
│ authenticated loopback API
▼
SEO Screaming Toad → guarded crawler → SQLite evidence
Build the two executables:
mkdir -p bin
go build -o bin/seo-auditor ./cmd/seo-auditor
go build -o bin/seo-auditor-mcp ./cmd/seo-auditor-mcp
Start bin/seo-auditor, configure your MCP client to run the absolute path to bin/seo-auditor-mcp, and call health_get. A connected result reports api_connected: true.
The MCP interface deliberately exposes no generic shell, arbitrary filesystem access, SQL execution, or unrestricted HTTP fetch. Read the complete MCP setup and tool guide or copy the generic MCP client configuration.
The versioned audit engine currently covers:
Every check documents its limitations. Findings are technical observations—not promises about indexing, rankings, traffic, or rich-result eligibility. See the audit rule catalog.
The system has segmented-campaign and distributed-coordination prototypes intended to process bounded batches repeatedly instead of holding an entire enormous crawl in memory. Local synthetic persistence/analysis campaigns have completed at 1 million and 5 million URLs, and a 100,000-URL single-crawl gate has passed.
100M+ is a theoretical architectural potential—not a verified live-network capacity, benchmark, support promise, or guarantee. Actual scale depends on hardware, storage, site behavior, politeness settings, rendering, network conditions, and operational design. Read the scale strategy and benchmark evidence.
SEO Screaming Toad is a collaborative open-source product created by Siamese Cat Dev together with DJAI Academy trainers and community members. DJAI is where learners, builders, trainers, and working developers turn AI-assisted ideas into useful software—and this crawler is one result of that community working together.
The service and community links are promotional and open external sites. They never influence crawl results, issue severity, evidence, or recommendations.
cmd/ Go application, CLI, MCP, SBOM, and scale commands
internal/crawler/ crawl engine, robots, sitemaps, links, and traps
internal/fetchpolicy/ target safety, transport, redirects, and scope
internal/rules/ versioned technical SEO audit rules
internal/database/ SQLite/WAL persistence, frontier, and recovery
internal/mcpserver/ bounded Model Context Protocol tools
web/app/ React technical audit dashboard
web/renderer/ isolated optional JavaScript renderer
docs/ PRD, architecture, operations, security, and evidence
Bug reports, new SEO rules, UX improvements, platform testing, documentation, and thoughtful performance work are welcome. Start with CONTRIBUTING.md, review the security model, and choose an issue that matches your experience.
Please give the repository a ⭐ if an open-source, MCP-enabled SEO crawler is useful to you. Stars help more SEO practitioners and AI builders discover the project.
Do not put vulnerabilities, private URLs, credentials, or raw client crawl data in public issues. Follow SECURITY.md for responsible disclosure. The crawler must only be used against systems you are authorized to audit.
Released under the MIT License. Third-party dependency and source notices are recorded in THIRD_PARTY_NOTICES.md.
Created by Siamese Cat Dev, co-created with trainers and community members from DJAI Academy.
DJAI Academy community-built, free open-source technical SEO crawler and Screaming Frog alternative with JavaScript audits, reports, a local dashboard, and an MCP server for AI agents. Theoretical 100
# Free Opensource SEO Screaming Toad Not Frog Tool With 100million Url Crawl Potentialภาพรวม
DJAI Academy community-built, free open-source technical SEO crawler and Screaming Frog alternative with JavaScript audits, reports, a local dashboard, and an MCP server for AI agents. Theoretical 100M+ URL architecture.
เครื่องมือ
ยังไม่มีรายการเครื่องมือ เซิร์ฟเวอร์แบบรีโมตจะได้รายการหลังการตรวจสอบสถานะครั้งแรก
FAQ
คัดลอกคอนฟิก stdio สำหรับ Cursor, Claude Desktop, Claude Code หรือ VS Code ได้ในหน้านี้ คอนฟิกนี้ใช้การติดตั้งของผู้เผยแพร่ ไม่ใช่พร็อกซีของ PlugMCP
ระเบียนนี้ไม่ได้ระบุตัวแปรสภาพแวดล้อมที่จำเป็น
Free Opensource SEO Screaming Toad Not Frog Tool With 100million Url Crawl Potential ทำงานแบบโลคัลผ่าน stdio
ตรวจสอบล่าสุดเมื่อ 2026-10-28 DJAI Academy community-built, free open-source technical SEO crawler and Screaming Frog alternative with JavaScript audits, reports, a local dashboard, and an MCP server for AI agents. Theoretical 100M+ URL architecture.