crawl-readiness
io.github.Grubbomatic/crawl-readiness
Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
Description as published in the official MCP registry.
What we measured
| Endpoint | None listed (runs locally) | registry |
|---|---|---|
| GitHub stars | 0 | github.com/Grubbomatic/crawl-readiness-mcp |
| Last push | 2026-09-30 | GitHub API |
| Licence | MIT | GitHub API |
| Registry version | 0.2.4 · active · updated 2026-09-30 | registry |
| Package | npm: crawl-readiness-mcp | registry |
Signed reports
No signed reports yet. A report carries a signed decision record from the reporter's gate, so it shows a real call went through, not just an opinion. How to file one.
Connect
npx -y crawl-readiness-mcpCommands are built from the registry entry. Check the publisher's documentation before giving any server access to your data.
Related servers
- Crawlie Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report…
- ShadowCrawl Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL…
- ai-crawler-readiness Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking…
- Firecrawl MCP Server MCP server for Firecrawl — search, scrape, and interact with the web.
- AI Readiness Kit Generate 18 AI readiness files (llms.txt, ai.txt, RAG indexes, schema) for any website.
- Crawleo-MCP Hosted Crawleo MCP (remote streamable HTTP endpoint).
Badge for your README
Shows the result of our latest check and links back to this page.
[](https://openforallofus.com/tools/io.github.Grubbomatic/crawl-readiness)Agents can read this page as data: MCP endpoint https://openforallofus.com/api/mcp, tool get_tool with name io.github.Grubbomatic/crawl-readiness.