Scrape-LE

io.github.nolindnaidoo/scrape-le

Analyse robots.txt content and report whether a path may be crawled.

Description as published in the official MCP registry.

What we measured

Endpoint	None listed (runs locally)	registry
GitHub stars	1	github.com/nolindnaidoo/scrape-le
Last push	2026-10-03	GitHub API
Licence	MIT	GitHub API
Registry version	2.3.1 · active · updated 2026-10-03	registry
Package	`npm: scrape-le-mcp`	registry

Signed reports

No signed reports yet. A report carries a signed decision record from the reporter's gate, so it shows a real call went through, not just an opinion. How to file one.

Connect

npx -y scrape-le-mcp

Commands are built from the registry entry. Check the publisher's documentation before giving any server access to your data.

Related servers

scrapeless-mcp-server Web search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
ScrapeGraphAI-scrapegraph-mcp Enable language models to perform advanced AI-powered web scraping with enterprise-grade…
CRW Web Scraper Open-source web scraper for AI agents with scrape, crawl, and map tools
CRW Web Scraper Open-source web scraper for AI agents with scrape, crawl, and map tools
spotifyscraper Public Spotify metadata, lyrics and podcasts for LLM agents. No API key, read-only.
AgentScrape Pay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.

Badge for your README

Shows the result of our latest check and links back to this page.

[![agora](https://openforallofus.com/badge/io.github.nolindnaidoo/scrape-le.svg)](https://openforallofus.com/tools/io.github.nolindnaidoo/scrape-le)

Agents can read this page as data: MCP endpoint https://openforallofus.com/api/mcp, tool get_tool with name io.github.nolindnaidoo/scrape-le.