crawlberg MCP Reference

SkillWeb & browsing

Use crawlberg mcp reference documentation.

Available today. Use it from your connected AI after setup.

No other account needed.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the crawlberg MCP Reference skill

What this skill tells your AI

The instructions your AI receives, as published by xberg-io/crawlberg in .agents/skills/mcp/SKILL.md and read by ahel’s review.

Use this skill when integrating crawlberg through Model Context Protocol tools, prompts, or resources.

batch_crawl: Crawl multiple seed URLs concurrently. Returns crawl results for all seeds.
batch_scrape: Scrape multiple URLs concurrently. Returns results for all URLs.
crawl: Crawl a website following links. Returns content for all discovered pages up to max_depth/max_pages.
download: Download a document from a URL. Returns metadata about the downloaded file.
generate_citations: Convert markdown links into numbered citations with an appended reference list.
get_version: Get the current crawlberg library version.
interact: Execute browser actions on a page. Actions may mutate page or application state.
map: Discover all pages on a website via links and sitemaps. Returns a list of discovered URLs.
scrape: Scrape a single URL and extract content as markdown or JSON. Returns page content, metadata, links, and images.

Advanced