crw-crawl

SkillWeb & browsing

Crawl an entire website or section and extract content from every page. Use when you need content from many pages under a common URL prefix: "crawl the whole site", "get all docs pages", "scrape every blog post", "download the full docs for RAG", "extract all pages under /api". Async BFS — starts a

Available today. Use it from your connected AI after setup.

No other account needed.

Then ask your AI: use the crw-crawl skill