Bright Data - Web Scraping & Search

SkillWeb & browsing

Web scraping and search via Bright Data API. Requires BRIGHTDATA_API_KEY and BRIGHTDATA_UNLOCKER_ZONE. Use for scraping any webpage as markdown (bypassing bot detection/CAPTCHA) or searching Google with structured results.

Available today. Use it from your connected AI after setup.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the Bright Data - Web Scraping & Search skill

What this skill tells your AI

The instructions your AI receives, as published by sundial-org/awesome-openclaw-skills in skills/brightdata/SKILL.md and read by ahel’s review.

Direct API access to Bright Data's Web Unlocker and SERP APIs.

Setup

1. Get your API Key: Get a key from Bright Data Dashboard.

2. Create a Web Unlocker zone: Create a zone at brightdata.com/cp by clicking "Add" (top-right), selecting "Unlocker zone".

3. Set environment variables:

export BRIGHTDATA_API_KEY="your-api-key"
export BRIGHTDATA_UNLOCKER_ZONE="your-zone-name"

Usage

Google Search

Search Google and get structured JSON results (title, link, description).

bash scripts/search.sh "query" [cursor]
  • cursor: Optional page number for pagination (0-indexed, default: 0)

Web Scraping

Scrape any webpage as markdown. Bypasses bot detection and CAPTCHA.

bash scripts/scrape.sh "url"

Output Formats

Search Results

Returns JSON with structured organic array:

{
  "organic": [
    {"link": "...", "title": "...", "description": "..."}
  ]
}

Scrape Results

Returns clean markdown content from the webpage.

Signals

GitHub stars
661
Forks
97
Last commit
Mar 2026
Advanced
Catalog kind
skill
Gateway key
brightdata-sundial-org
Source
github.com/sundial-org/awesome-openclaw-skills