web-scrapingScrape, search, and map the web for agents — clean markdown, structured JSON, and site URL discovery.
Install via ClawdBot CLI:
clawdbot install zhangqixin9527/web-scrapingGrade Fair — based on market validation, documentation quality, package completeness, maintenance status, and authenticity signals.
Generated Apr 1, 2026
Scrape competitor product listings, prices, and reviews from e-commerce sites to analyze market trends and pricing strategies. Use browser automation for dynamic filtering and pagination, outputting structured JSON for comparison.
Extract property details such as price, location, and amenities from multiple real estate websites. Handle dynamic pages with infinite scroll using browser snapshots, normalizing data into a CSV for portfolio analysis.
Scrape headlines, articles, and publication dates from news sites to track trends or generate daily summaries. Use web_fetch for static pages and browser for login-gated content, outputting concise bullet summaries.
Gather job postings including titles, companies, and application links from job boards with pagination and search filters. Employ browser automation to interact with filters, saving results as JSON for recruitment analytics.
Offer subscription-based access to scraped datasets, such as product prices or news feeds, updated regularly. Revenue comes from monthly or annual fees, with tiered pricing based on data volume and freshness.
Provide tailored web scraping services for clients needing specific data extraction, like competitor analysis or market research. Charge project-based or hourly rates, with additional fees for complex dynamic sites.
Develop APIs that deliver scraped data directly into client systems, such as CRM or analytics platforms. Generate revenue through API usage fees or licensing, with scalability for large data jobs.
💬 Integration Tip
Start with simple web_fetch for static pages to test reliability before moving to browser automation for dynamic content, ensuring output is normalized into a stable schema like JSON for easy integration.
Scored Apr 19, 2026
Real-time search engine supporting web search, vertical domain search, parallel batch search, and URL content extraction.
Manage Feishu (Lark) calendars by listing, searching, checking schedules, syncing events, and marking tasks with automated date extraction.
cad reference tool
Search, install, and create OpenClaw skills using intelligent matching across built-in, local, and GitHub skill repositories.
Use when building CLI tools, implementing argument parsing, or adding interactive prompts. Invoke for CLI design, argument parsing, interactive prompts, progress indicators, shell completions.
Publish local skills to ClawHub with customizable version, name, path, and optional changelog using command line or Python API.