novel-scraper-spa支持 JavaScript 加载的小说抓取工具,使用 Playwright 渲染 SPA 网站。自动检测网站类型,静态网站使用 curl,SPA 网站使用浏览器渲染。
Install via ClawdBot CLI:
clawdbot install yuzhihui886/novel-scraper-spaGrade Fair — based on market validation, documentation quality, package completeness, maintenance status, and authenticity signals.
Generated Aug 10, 2026
A user wants to monitor a specific novel on a JavaScript-heavy site for new chapters. The scraper can be scheduled to check for updates and download new chapters automatically, saving the user time from manual visits.
A reader wants to compile their favorite web novels into a local collection for offline reading. Using the scraper, they can batch download entire novels chapter by chapter, organizing files by book name.
A researcher needs to gather text data from multiple SPA-based novel sites for analysis (e.g., genre trends, writing styles). The scraper enables systematic collection of chapters across different sources.
A content creator wants to convert popular web novels into audiobooks. They use the scraper to obtain clean text files, which can then be fed into text-to-speech software.
Provide a service that automatically scrapes and delivers new chapters from multiple SPA sites to subscribers, offering convenience and time savings. Revenue comes from monthly subscription fees.
Offer free access to a limited number of chapters scraped from public sites, with premium features like offline downloads, ad-free experience, or early access for a fee.
Collect and structure novel data from SPA sites, then license the dataset to publishers, researchers, or AI training companies. Revenue comes from one-time or recurring data licensing fees.
💬 Integration Tip
Integrate with a scheduler (e.g., cron) for automated updates, and use the `--force-spa` flag when dealing with sites that require heavy JavaScript rendering to ensure content is captured correctly.
Scored Aug 10, 2026
A fast Rust-based headless browser automation CLI with Node.js fallback that enables AI agents to navigate, click, type, and snapshot pages via structured commands.
Uses a headless browser to navigate web pages, interact with elements, and extract clean, readable text content from URLs.
Headless browser automation CLI optimized for AI agents with accessibility tree snapshots and ref-based element selection
通过已登录的Edge或Chrome浏览器,利用Chrome DevTools Protocol执行JS渲染页面的导航、点击、截图及数据提取等自动化操作。
Send and receive SMS/RCS via Google Messages web interface (messages.google.com). Use when asked to "send a text", "check texts", "SMS", "text message", "Google Messages", or forward incoming texts to other channels.
High-performance browser automation for heavy scraping, multi-tab management, and precise DOM extraction. Use this when you need speed, reliability, or advanced state management (cookies/local storage) beyond standard web fetching.