scrape-le
MCP serverWeb & browsingAnalyse robots.txt content and report whether a path may be crawled.
This server has no hosted endpoint yet, so ahel can't serve it. You can still add it. It stays paused until ahel can serve it.
Serve it through your gateway
One link, every agent. Your own credentials, stored once.
Signals
- Weekly downloads
- 70