xcrawl-mapUse this skill for XCrawl map tasks, including site URL discovery, regex filtering, scope estimation, and crawl planning before full-site crawling.
Install via ClawdBot CLI:
clawdbot install wykings/xcrawl-mapGrade Fair — based on market validation, documentation quality, package completeness, maintenance status, and authenticity signals.
Sends data to undocumented external endpoint (potential exfiltration)
POST → https://run.xcrawl.com/v1/mapCalls external URL not in known-safe list
https://www.xcrawl.com/AI Analysis
The skill's external API calls (run.xcrawl.com) are documented and directly serve its stated purpose of site mapping. While it sends the target URL to a third-party service, this is an expected function, not hidden exfiltration. The primary risk is the dependency on an external, user-configured API key and service, not malicious behavior within the skill itself.
Audited Apr 16, 2026 · audit v1.0
Generated Mar 22, 2026
Digital marketing agencies use this skill to map a client's website URL structure before an SEO audit. It helps identify orphaned pages, broken internal links, and assess crawl budget efficiency by filtering URLs with regex patterns like '/blog/' to focus on content sections.
Security professionals employ this skill to discover all accessible endpoints and subdomains of a web application as part of a penetration testing engagement. By setting include_subdomains to true and ignoring query parameters, they can plan targeted crawls to identify potential vulnerabilities in the attack surface.
Web development teams utilize this skill when migrating a website to a new platform. They map the existing site's URLs to ensure all pages are accounted for, using filters to exclude temporary or duplicate pages, facilitating a smooth transition without losing SEO value or user access.
Business analysts leverage this skill to map competitor websites for market research. By analyzing URL structures and subdomains, they gain insights into product offerings, marketing strategies, and organizational focus areas, aiding in strategic decision-making.
Researchers in digital humanities use this skill to plan crawls of cultural heritage websites for archiving purposes. It helps estimate scope by discovering URLs within specific sections, ensuring efficient use of resources while preserving web content for future study.
XCrawl offers a free tier with 1000 credits to attract users, then charges for additional credits or premium features like higher limits or faster processing. This model encourages adoption while generating revenue from heavy users such as enterprises or agencies requiring large-scale mapping.
The skill is integrated into larger SEO or security platforms as a white-labeled service. Companies pay licensing fees to embed XCrawl's mapping capabilities into their own tools, providing value-added features to their customers without developing the technology in-house.
Agencies use this skill as part of their service offerings, charging clients for site audits, security assessments, or migration projects. They may also develop custom scripts or workflows around the API to deliver tailored solutions, generating revenue through project-based fees.
💬 Integration Tip
Ensure the local config file is properly set up with the API key before use, and monitor credit usage to avoid interruptions during mapping tasks.
Scored Apr 19, 2026
A fast Rust-based headless browser automation CLI with Node.js fallback that enables AI agents to navigate, click, type, and snapshot pages via structured commands.
Uses a headless browser to navigate web pages, interact with elements, and extract clean, readable text content from URLs.
Headless browser automation CLI optimized for AI agents with accessibility tree snapshots and ref-based element selection
通过已登录的Edge或Chrome浏览器，利用Chrome DevTools Protocol执行JS渲染页面的导航、点击、截图及数据提取等自动化操作。
High-performance browser automation for heavy scraping, multi-tab management, and precise DOM extraction. Use this when you need speed, reliability, or advanced state management (cookies/local storage) beyond standard web fetching.
Ultimate stealth browser automation with anti-detection, Cloudflare bypass, CAPTCHA solving, persistent sessions, and silent operation. Use for any web automation requiring bot detection evasion, login persistence, headless browsing, or bypassing security measures. Triggers on "bypass cloudflare", "solve captcha", "stealth browse", "silent automation", "persistent login", "anti-detection", or any task needing undetectable browser automation. When user asks to "login to X website", automatically use headed mode for login, then save session for future headless reuse.