shadow-crawl

MCP serverWeb & browsing

Lets your agent scrape websites that block bots by routing around defenses like Cloudflare and DataDome.

Available today. Use it from your connected AI after setup.

Add ahel to your AI once: Claude, ChatGPT, Cursor, Claude Code or Codex. Then ask it to use this.

Then ask your AI: use shadow-crawl

About this server

Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.

Install shadow-crawl

The server’s own address, for the clients that take one directly. Or connect ahel onceand every client you use reads it from one address, with the account kept on ahel rather than in each client’s config.

  • Claude Code

    claude mcp add --transport http --scope user shadow-crawl 'https://shadowcrawl--devshero.run.tools'

    Run it once in your project, then open /mcp to approve any sign-in the server asks for.

  • Claude Desktop

    https://shadowcrawl--devshero.run.tools

    Add a custom connector in Settings, paste this address, and approve the sign-in.

  • Cursor

    cursor://anysphere.cursor-deeplink/mcp/install?name=shadow-crawl&config=eyJ1cmwiOiJodHRwczovL3NoYWRvd2NyYXdsLS1kZXZzaGVyby5ydW4udG9vbHMifQ==

    Open the link and Cursor adds the server at that address.

  • ChatGPT

    https://shadowcrawl--devshero.run.tools

    In Settings, enable Developer mode, create an MCP app, and paste this address. Your plan and workspace must allow custom apps.

  • Codex

    codex mcp add shadow-crawl --url 'https://shadowcrawl--devshero.run.tools'

    Run it once, then sign in with codex mcp login shadow-crawl if the server asks for an account.

From the project's README

As published by devshero/shadowcrawl in README.md. This repository publishes several servers, so only the opening is shown here.


Overview

CortexScout provides a single, self-hostable Rust binary that exposes search, extraction, and stateful browser automation capabilities over MCP (stdio) and an optional HTTP server. Output formats are structured and optimized for downstream LLM use.

Shortened here. Read the whole README on GitHub.

Signals

GitHub stars
71
Forks
9
Last commit
Sep 2026
Advanced
Delivery
shadow-crawl MCP server → your ahel connector (mcp.ahel.ai) → your AI.
Item type
mcp-server
Key
io-github-devshero-shadow-crawl
Source
github.com/devshero/shadowcrawl
Hosted endpoint
https://shadowcrawl--devshero.run.tools