robots-txt-ai-crawler-audit
Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI
Description as published in the official MCP registry.
Maintain this server? Get the badge
What we measured
| Endpoint | None listed (runs locally) | registry |
|---|---|---|
| GitHub stars | 1 | github.com/jmshinhwa/readystack-themes |
| Last push | 2026-11-18 | GitHub API |
| Registry version | 0.1.3 · active · updated 2026-09-19 | registry |
| Package | npm: @readystack/robots-txt-ai-crawler-audit | registry |
Packages
npm: @readystack/robots-txt-ai-crawler-audit
Exists · metadata read 2026-11-21
Latest version: 0.1.8. Last published: 2026-11-02.
Deprecated: yes.
Weekly downloads: unavailable · read 2026-11-21. downloads include bots and CI.
Signed reports
No signed reports yet. A report carries a signed decision record from the reporter's gate, so it shows that the gate allowed a call, not just an opinion; it does not prove which server answered. How to file one.
Connect
npx -y @readystack/robots-txt-ai-crawler-auditCommands are built from the registry entry. Check the publisher's documentation before giving any server access to your data.
Related servers
- Site SEO & AI Crawler Audit Check public pages for SEO tags, AI crawler rules, AI citation signals and landing page…
- AI Crawler Permission Check Check a site's robots.txt rules for AI crawlers (GPTBot, ClaudeBot, PerplexityBot and…
- AI Visibility Audit — Can AI crawlers read and cite your site? One-call audit: robots.txt AI-bot rules, llms.txt, JSON-LD, meta tags, sitemap. Score plus…
- ActableSite AI Crawler Monitor Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt…
- Robots.txt & AI Crawler Checker robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
- AI Crawler Checker — Robots.txt Policy for Six Bots Check declared robots.txt permissions for six AI crawlers at URL paths
Is this your server?
Show the result of our latest check where your users look first. The badge is a live image: it changes when our check does, and it links back to this page.
[](https://openforallofus.com/tools/io.github.jmshinhwa/robots-txt-ai-crawler-audit)<a href="https://openforallofus.com/tools/io.github.jmshinhwa/robots-txt-ai-crawler-audit"><img src="https://openforallofus.com/badge/io.github.jmshinhwa/robots-txt-ai-crawler-audit.svg" alt="Agora: MCP handshake check" height="20"></a>The badge reports one thing: the result of our last handshake check. A server with no remote endpoint shows as "runs locally". How we check.
Agents can read this page as data: MCP endpoint https://openforallofus.com/api/mcp, tool get_tool with name io.github.jmshinhwa/robots-txt-ai-crawler-audit.