xcrawl-crawlUse this skill for XCrawl crawl tasks, including bulk site crawling, crawler rule design, async status polling, and delivery of crawl output for downstream s...
Install via ClawdBot CLI:
clawdbot install wykings/xcrawl-crawlGrade Fair — based on market validation, documentation quality, package completeness, maintenance status, and authenticity signals.
Sends data to undocumented external endpoint (potential exfiltration)
POST → https://run.xcrawl.com/v1/crawlCalls external URL not in known-safe list
https://www.xcrawl.com/AI Analysis
The skill sends data to a documented external API (run.xcrawl.com) consistent with its stated purpose of web crawling, and the API key is sourced from a local config file, not harvested from the user. The primary risk is the standard data transmission to a third-party service, not unauthorized exfiltration or credential theft.
Audited Apr 17, 2026 · audit v1.0
Generated Mar 22, 2026
Marketing teams can use this skill to crawl competitor websites, extracting product details, pricing, and promotional content for analysis. It supports structured output like markdown and JSON, enabling easy integration into competitive dashboards.
Media companies can automate crawling of multiple news sites to aggregate articles, headlines, and links for content curation. The skill's async polling and output formats streamline updating news feeds without manual intervention.
SEO agencies can crawl client websites to analyze link structures, metadata, and content quality for optimization. With configurable crawler rules, it helps identify broken links and improve search engine rankings efficiently.
Researchers can crawl scholarly websites or databases to gather publications, datasets, and references for literature reviews. The skill's ability to handle complex URLs and output in multiple formats aids in data organization.
Retail businesses can crawl supplier sites to automatically update product catalogs with new items, prices, and descriptions. Integration with downstream scraping workflows ensures real-time inventory management.
Offer a subscription service where businesses pay monthly for automated crawling and data extraction from target websites. Revenue comes from tiered plans based on crawl volume and output formats, leveraging the skill's API integration.
Provide free access to basic crawling features with limited credits, then charge for premium features like advanced proxy settings or higher limits. Revenue is generated through credit top-ups and enterprise plans, as hinted by the skill's credit system.
Sell customized crawling packages to digital agencies that integrate the skill into their own tools for clients. Revenue comes from one-time setup fees and ongoing support, utilizing the skill's configurable rules and output delivery.
💬 Integration Tip
Ensure the local config file is set up with the API key before use, and monitor credit consumption to avoid interruptions in crawling tasks.
Scored Apr 19, 2026
A fast Rust-based headless browser automation CLI with Node.js fallback that enables AI agents to navigate, click, type, and snapshot pages via structured commands.
Uses a headless browser to navigate web pages, interact with elements, and extract clean, readable text content from URLs.
Headless browser automation CLI optimized for AI agents with accessibility tree snapshots and ref-based element selection
通过已登录的Edge或Chrome浏览器,利用Chrome DevTools Protocol执行JS渲染页面的导航、点击、截图及数据提取等自动化操作。
High-performance browser automation for heavy scraping, multi-tab management, and precise DOM extraction. Use this when you need speed, reliability, or advanced state management (cookies/local storage) beyond standard web fetching.
Ultimate stealth browser automation with anti-detection, Cloudflare bypass, CAPTCHA solving, persistent sessions, and silent operation. Use for any web automation requiring bot detection evasion, login persistence, headless browsing, or bypassing security measures. Triggers on "bypass cloudflare", "solve captcha", "stealth browse", "silent automation", "persistent login", "anti-detection", or any task needing undetectable browser automation. When user asks to "login to X website", automatically use headed mode for login, then save session for future headless reuse.