ecommerce-scraper爬取动态电商网站数据。使用Playwright处理JavaScript渲染的页面,支持Cloudflare反爬、隐躲API发现、分页抓取。适用于: (1) 爬取京东/淘宝/拼多多等中国电商, (2) 爬取Amazon/eBay等国际电商, (3) 价格监控和竞品分析, (4) 批量商品数据采集。
Install via ClawdBot CLI:
clawdbot install chefroger/ecommerce-scraperGrade Good — based on market validation, documentation quality, package completeness, maintenance status, and authenticity signals.
Calls external URL not in known-safe list
https://example.com/productsAudited Apr 16, 2026 · audit v1.0
Generated Mar 18, 2026
Scrapes product prices from JD.com, Taobao, and Pinduoduo to track fluctuations and identify trends. Useful for retailers or brands to adjust pricing strategies in real-time based on competitor actions.
Collects product listings, reviews, and ratings from Amazon and eBay to analyze market share and customer preferences. Helps businesses benchmark their offerings against global competitors and identify gaps.
Automates scraping of large volumes of product details, including descriptions, images, and specifications, from multiple e-commerce sites. Supports data-driven decisions for inventory management or product development.
Uses Playwright to handle pages rendered with JavaScript, such as those with infinite scroll or real-time updates. Ideal for scraping modern e-commerce platforms that rely on dynamic loading for product displays.
Implements techniques to bypass Cloudflare and other anti-scraping measures, ensuring reliable data collection from secured e-commerce websites. Useful for continuous monitoring without triggering blocks.
Offers a subscription-based service that provides real-time price data and analytics to retailers and brands. Generates revenue through monthly or annual fees based on data volume and features.
Sells cleaned and structured e-commerce datasets to large corporations for market analysis and strategic planning. Revenue comes from one-time purchases or ongoing data delivery contracts.
Provides tailored scraping services to businesses needing specific e-commerce data extraction, with support for complex sites and anti-bot measures. Earns revenue through project-based fees and maintenance contracts.
💬 Integration Tip
Integrate with data pipelines using Python libraries like Pandas for analysis, and consider scheduling scrapes with cron jobs or cloud functions for automation.
Scored Apr 19, 2026
A fast Rust-based headless browser automation CLI with Node.js fallback that enables AI agents to navigate, click, type, and snapshot pages via structured commands.
Browser automation via Playwright MCP server. Navigate websites, click elements, fill forms, extract data, take screenshots, and perform full browser automation workflows.
Performs deep scraping of complex sites like YouTube using containerized Crawlee, extracting validated, ad-free transcripts and content as JSON output.
Extract structured information from websites using web_fetch for simple pages and browser automation for dynamic sites, login-gated flows, pagination, infini...
OpenClaw skill for the agent-browser CLI (Rust-based with Node.js fallback) enabling AI-friendly web automation with snapshots, refs, and structured commands.
A modern text-based browser. Renders web pages in the terminal using headless Firefox.