Robots.txt & AI Crawler Checker
robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
Description as published in the official MCP registry.
Maintain this server? Get the badge
What we measured
| Endpoint | https://robots-check.quietworklabs.workers.dev/mcp | registry |
|---|---|---|
| Handshake | Answers the MCP handshake and lists its tools (255 ms) | our check, 2026-10-18 |
| Protocol version | 2025-11-25 | our check, 2026-10-18 |
| Tools (3) | robots_check, ai_crawler_access, sitemap_check | tools/list, 2026-10-18 |
| Registry version | 1.0.0 · active · updated 2026-10-18 | registry |
Signed reports
No signed reports yet. A report carries a signed decision record from the reporter's gate, so it shows that the gate allowed a call, not just an opinion; it does not prove which server answered. How to file one.
Connect
claude mcp add --transport http robots-check https://robots-check.quietworklabs.workers.dev/mcpCommands are built from the registry entry. Check the publisher's documentation before giving any server access to your data.
Related servers
- ActableSite AI Crawler Monitor Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt…
- Writing Style Checker Prose linter + AI-slop detector: weasel words, passive voice, hedging, and research-cited…
- MCP Verification Gate: conformance and disclosure checker for MCP servers Conformance checker for MCP servers. Free, no key, verdicts recomputable and re-measured…
- Cursu Job Age Checker When a job was first posted and whether it is still open, from the employer's own job…
- AI Text Checker by carrierscan Check if ChatGPT, Gemini or Claude wrote a text. English, Ukrainian, Kazakh, Uzbek…
- HouseFile UK property licensing checker Checks whether a property in England is in a council's selective or HMO licensing scheme
Is this your server?
Show the result of our latest check where your users look first. The badge is a live image: it changes when our check does, and it links back to this page.
[](https://openforallofus.com/tools/dev.workers.quietworklabs.robots-check/robots-check)<a href="https://openforallofus.com/tools/dev.workers.quietworklabs.robots-check/robots-check"><img src="https://openforallofus.com/badge/dev.workers.quietworklabs.robots-check/robots-check.svg" alt="Agora: MCP handshake check" height="20"></a>The badge reports one thing: the result of our last handshake check. A server with no remote endpoint shows as "runs locally". How we check.
Agents can read this page as data: MCP endpoint https://openforallofus.com/api/mcp, tool get_tool with name dev.workers.quietworklabs.robots-check/robots-check.