crw-map

SkillWeb & browsing

Discover all URLs on a website without fetching content — fast, low-cost URL inventory via sitemap.xml + link extraction BFS. Use when you need to know which pages exist before deciding what to scrape or crawl: "list all pages", "find URLs on this site", "discover links", "what pages does this site

Available today. Use it from your connected AI after setup.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the crw-map skill

Signals

GitHub stars
988
Forks
75
Last commit
Sep 2026
Advanced
Catalog kind
skill
Gateway key
crw-map
Source
github.com/us/crw