bright-dataWeb scraping and search via Bright Data API. Requires BRIGHTDATA_API_KEY and BRIGHTDATA_UNLOCKER_ZONE. Use for scraping any webpage as markdown (bypassing bot detection/CAPTCHA) or searching Google with structured results.
Install via ClawdBot CLI:
clawdbot install MeirKaD/bright-dataDirect API access to Bright Data's Web Unlocker and SERP APIs.
1. Get your API Key:
Get a key from Bright Data Dashboard.
2. Create a Web Unlocker zone:
Create a zone at brightdata.com/cp by clicking "Add" (top-right), selecting "Unlocker zone".
3. Set environment variables:
export BRIGHTDATA_API_KEY="your-api-key"
export BRIGHTDATA_UNLOCKER_ZONE="your-zone-name"Search Google and get structured JSON results (title, link, description).
bash scripts/search.sh "query" [cursor]cursor: Optional page number for pagination (0-indexed, default: 0)Scrape any webpage as markdown. Bypasses bot detection and CAPTCHA.
bash scripts/scrape.sh "url"Returns JSON with structured organic array:
{
"organic": [
{"link": "...", "title": "...", "description": "..."}
]
}Returns clean markdown content from the webpage.
Generated Mar 1, 2026
Scrape competitor product pages to analyze pricing, features, and customer reviews in markdown format, enabling data-driven pricing strategies and product development. This helps businesses stay competitive by monitoring market trends and adjusting offerings accordingly.
Search Google for structured results on potential clients in specific industries, extracting company names, websites, and descriptions to build targeted lead lists. This automates prospecting efforts, saving time and increasing sales team efficiency.
Scrape news articles from various websites as markdown to aggregate and summarize content for news apps or websites, bypassing bot detection to ensure reliable data collection. This supports real-time updates and diverse sourcing for media outlets.
Scrape academic papers or web sources as markdown for literature reviews or data analysis, using the search function to find relevant studies with structured results. This aids researchers in gathering comprehensive datasets without manual web browsing.
Search Google with pagination to analyze SERP rankings and competitor content, extracting titles, links, and descriptions to optimize client websites for search engines. This helps agencies track performance and identify improvement opportunities.
Offer a subscription-based service that provides scraped web data or search results via an API to clients, such as startups needing market insights. Revenue is generated through monthly or annual fees based on data volume or features.
Provide tailored web scraping and search services for specific business needs, like one-off market reports or integration into existing systems. Revenue comes from project-based contracts and ongoing support fees.
Scrape e-commerce sites for product data to create affiliate marketing feeds, earning commissions by driving sales through aggregated links. Revenue is generated from affiliate program payouts based on traffic or conversions.
💬 Integration Tip
Ensure environment variables are securely set and test scripts with sample queries to verify API connectivity before full deployment.
Create distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
Expert frontend design guidelines for creating beautiful, modern UIs. Use when building landing pages, dashboards, or any user interface.
Use when building UI with shadcn/ui components, Tailwind CSS layouts, form patterns with react-hook-form and zod, theming, dark mode, sidebar layouts, mobile navigation, or any shadcn component question.
Create distinctive, production-grade frontend interfaces with high design quality. Use this skill when building web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
Create distinctive, production-grade static sites with React, Tailwind CSS, and shadcn/ui — no mockups needed. Generates bold, memorable designs from plain text requirements with anti-AI-slop aesthetics, mobile-first responsive patterns, and single-file bundling. Use when building landing pages, marketing sites, portfolios, dashboards, or any static web UI. Supports both Vite (pure static) and Next.js (Vercel deploy) workflows.
AI skill for automated UI audits. Evaluate interfaces against proven UX principles for visual hierarchy, accessibility, cognitive load, navigation, and more. Based on Making UX Decisions by Tommy Geoco.