crawlberg CLI Reference

SkillWeb & browsing

Use crawlberg cli reference documentation.

Available today. Use it from your connected AI after setup.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the crawlberg CLI Reference skill

What this skill tells your AI

The instructions your AI receives, as published by xberg-io/crawlberg in .agents/skills/cli/SKILL.md and read by ahel’s review.

Use this skill when invoking, documenting, or changing the crawlberg command-line interface.

  • crawlberg: High-performance web crawler and scraper
    • crawlberg batch-crawl: Crawl multiple websites concurrently
    • crawlberg batch-scrape: Scrape multiple URLs concurrently
    • crawlberg citations: Convert markdown links into numbered citations
    • crawlberg crawl: Crawl a website following links
    • crawlberg download: Download a document from a URL and report its metadata
    • crawlberg interact: Execute browser actions on a single page
    • crawlberg map: Discover all URLs on a website via sitemaps and link extraction
    • crawlberg mcp: Start the MCP server (stdio transport by default).
    • crawlberg scrape: Scrape a single URL and extract metadata
    • crawlberg serve: Start the REST API server.
    • crawlberg version: Print the crawlberg version as JSON

Signals

GitHub stars
171
Forks
25
Last commit
Sep 2026
Advanced
Catalog kind
skill
Gateway key
cli-xberg-io
Source
github.com/xberg-io/crawlberg