Web Scraping & Data Collection — 6 Skills

SkillWeb & browsing

6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks.

Instructions available. Your AI can read the instructions. Execution depends on the setup they require.

Add ahel to your AI once: Claude, ChatGPT, Cursor, Claude Code or Codex. Then ask it to use this.

Then ask your AI: use the Web Scraping & Data Collection skill

What this skill tells your AI

The instructions your AI receives, as published by brycewang-stanford/auto-empirical-research-skills in skills/43-wentorai-research-plugins/skills/tools/scraping/SKILL.md and read by ahel’s review.

Select the skill matching the user's need, then read its SKILL.md.

SkillDescription
academic-web-scrapingEthical web scraping and API-based data collection for research
dataset-finder-guideSearch and download research datasets from Kaggle, HuggingFace, and repos
easy-spider-guideGuide to EasySpider for visual no-code web data collection
google-scholar-scraperEthical Google Scholar data collection techniques and best practices
repository-harvesting-guideHarvest metadata from open repositories using OAI-PMH protocol
web-scraping-ethics-guideScrape web data ethically and legally for research purposes

Signals

GitHub stars
4k
Forks
531
Last commit
Sep 2026

ahel review

  • K1binfo
    installs-packages (in dataset-finder-guide/SKILL.md)
  • K1binfo
    installs-packages (in easy-spider-guide/SKILL.md)

Automated review, not a security audit. Ruleset v1+k2.

Advanced
Item type
skill
Key
scraping-skills
Source
github.com/brycewang-stanford/auto-empirical-research-skills