robots-txt-ai-crawler-audit

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

Description as published in the official MCP registry.

What we measured

Signed reports

No signed reports yet. A report carries a signed decision record from the reporter's gate, so it shows a real call went through, not just an opinion. How to file one.

Connect

npx -y @readystack/robots-txt-ai-crawler-audit

Commands are built from the registry entry. Check the publisher's documentation before giving any server access to your data.

Related servers

• AI Visibility Audit — Can AI crawlers read and cite your site? One-call audit: robots.txt AI-bot rules, llms.txt, JSON-LD, meta tags, sitemap. Score plus…
• ActableSite AI Crawler Monitor Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt…
• skill-audit-mcp MCP server: static security scanner for MCP servers, agent skills & plugins. 17 attack…
• NM Signals: AI crawler audit Audit webpage access for AI crawlers. API key and Premium or Partner plan required.
• HORIZON SHIELD: construction and renovation estimate auditor Fair-price checks for Japanese renovation quotes, with sources and recomputable records.
• HORIZON SHIELD: Construction Estimate Auditor for Japan (KIRA) Agent intake desk for property renovation. Read only, CORS open, fail closed, receipts…

Badge for your README

Shows the result of our latest check and links back to this page.

[![agora](https://openforallofus.com/badge/io.github.jmshinhwa/robots-txt-ai-crawler-audit.svg)](https://openforallofus.com/tools/io.github.jmshinhwa/robots-txt-ai-crawler-audit)

Agents can read this page as data: MCP endpoint https://openforallofus.com/api/mcp, tool get_tool with name io.github.jmshinhwa/robots-txt-ai-crawler-audit.