liang-tavily-crawlCrawl any website and save pages as local markdown files. Ideal for downloading documentation, knowledge bases, or web content for offline access or analysis.
Install via ClawdBot CLI:
clawdbot install matthew77/liang-tavily-crawlGrade Fair — based on market validation, documentation quality, package completeness, maintenance status, and authenticity signals.
Calls external URL not in known-safe list
https://tavily.comAudited Apr 16, 2026 · audit v1.0
Generated Mar 21, 2026
Crawl and save technical documentation from a company's website to create offline backups or migrate content to a new platform. This ensures developers have access to critical API guides and user manuals even without internet connectivity.
Extract content from competitor websites to analyze product offerings, pricing strategies, and marketing copy. This helps agencies benchmark performance and identify gaps in their clients' market positioning.
Crawl educational or government websites to gather reports, articles, and datasets for analysis in research projects. This automates the collection of publicly available information, saving time for researchers.
Download articles and blog posts from an old CMS before transitioning to a new publishing platform. This preserves historical content and streamlines the migration process without manual copying.
Crawl regulatory websites to compile updated laws, case studies, and compliance guidelines into a centralized repository. This supports legal teams in staying current with changing regulations efficiently.
Offer a cloud-based service where businesses pay a monthly fee to crawl and store web content for analytics. This model targets data scientists and analysts who need structured data for machine learning or business intelligence.
Provide customized crawling solutions to help companies migrate web content or build knowledge bases. This involves one-time project fees for setup and integration, ideal for enterprises undergoing digital upgrades.
Release a free version with basic crawling limits and charge for advanced features like higher depth, priority support, or API access. This attracts individual developers and small teams who may upgrade as needs grow.
💬 Integration Tip
Start by setting the TAVILY_API_KEY environment variable and test with a shallow depth to avoid timeouts, then gradually increase parameters based on performance.
Scored Jun 17, 2026
Create, search, and manage Bear notes via grizzly CLI.
Notion API integration with managed OAuth. Query databases, search pages, and read workspace content. Write operations require explicit user confirmation of the target resource and connection. Use this skill when users want to interact with Notion workspaces, databases, or pages. For other third par
Learns when to stop and review. Self-critiques before showing you, fewer revision rounds.
Manage Obsidian Daily Notes via obsidian-cli. Create and open daily notes, append entries (journals, logs, tasks, links), read past notes by date, and search vault content. Handles relative dates like "yesterday", "last Friday", "3 days ago".
Personal knowledge base powered by Ensue for capturing and retrieving understanding. Use when user wants to save knowledge, recall what they know, manage their toolbox, or build on past learnings. Triggers on "save this", "remember", "what do I know about", "add to toolbox", "my notes on", "store this concept".
Notion CLI for creating and managing pages, databases, and blocks.