web-scrape-plusEnhanced web scraping with anti-detection, proxy support, rate limiting, data validation, and multiple extraction methods. Supports static pages, dynamic con...
Install via ClawdBot CLI:
clawdbot install 534422530/web-scrape-plusGrade Fair — based on market validation, documentation quality, package completeness, maintenance status, and authenticity signals.
Calls external URL not in known-safe list
https://example.com/1Audited Jun 5, 2026 · audit v1.0
Generated Oct 25, 2026
Scrape competitor product listings across multiple online stores to track pricing changes, discounts, and stock availability. Use anti-detection and rate limiting to gather daily price snapshots without triggering bot blocks.
Collect property listings including price, location, and descriptions from multiple real estate portals, handling pagination and dynamic content. Validate and deduplicate records to build a unified searchable inventory.
Extract job postings from career sites and job boards, including login-gated portals using session management. Aggregate titles, salaries, and skills to power hiring trend analytics and salary benchmarking.
Continuously scrape news outlets and blogs for brand mentions, competitor announcements, or topic monitoring. Apply retry logic, caching, and data validation to feed downstream sentiment analysis pipelines.
Scrape business directories and public listings to build enriched lead lists with company names, URLs, and contact data. Use proxy rotation and deduplication to maintain clean, high-volume datasets for sales outreach.
Offer managed scraping endpoints that deliver structured, validated data feeds to clients on subscription. The skill's proxy, rate limiting, and validation features support reliable multi-tenant data delivery.
Sell periodic competitor and market monitoring reports generated from scraped data, such as pricing dashboards or trend briefings. Anti-detection ensures continuous, uninterrupted data collection for premium insights.
Build and sell curated lead datasets or enrichment services to sales and marketing teams. Deduplication and schema validation produce clean, reliable records that command higher prices.
💬 Integration Tip
Start by testing extraction on a single page with web_fetch before scaling to browser automation, and wrap requests with the provided RateLimiter and retry decorator. Always check robots.txt and store proxy credentials securely in environment variables.
Scored Oct 25, 2026
A fast Rust-based headless browser automation CLI with Node.js fallback that enables AI agents to navigate, click, type, and snapshot pages via structured commands.
Uses a headless browser to navigate web pages, interact with elements, and extract clean, readable text content from URLs.
Headless browser automation CLI optimized for AI agents with accessibility tree snapshots and ref-based element selection
High-performance browser automation for heavy scraping, multi-tab management, and precise DOM extraction. Use this when you need speed, reliability, or advanced state management (cookies/local storage) beyond standard web fetching.
Ultimate stealth browser automation with anti-detection, Cloudflare bypass, CAPTCHA solving, persistent sessions, and silent operation. Use for any web automation requiring bot detection evasion, login persistence, headless browsing, or bypassing security measures. Triggers on "bypass cloudflare", "solve captcha", "stealth browse", "silent automation", "persistent login", "anti-detection", or any task needing undetectable browser automation. When user asks to "login to X website", automatically use headed mode for login, then save session for future headless reuse.
Browser automation CLI (browser-act) for AI agents. MUST trigger when: (1) user mentions 'browser-act' in any form, or user needs to: (2) open/visit/browse/c...