ui-element-opsParse UI screenshots into structured element JSON (type, OCR text, bbox) and operate desktop UI from parsed elements. Use when a user asks to detect/locate U...
Install via ClawdBot CLI:
clawdbot install murongg/ui-element-opsGrade Fair — based on market validation, documentation quality, package completeness, maintenance status, and authenticity signals.
Calls external URL not in known-safe list
https://github.com/microsoft/OmniParserAudited Apr 17, 2026 · audit v1.0
Generated Mar 20, 2026
This skill enables automated UI testing by parsing screenshots to detect elements like buttons and text fields, then executing actions such as clicks and keystrokes. It's ideal for regression testing in development pipelines, reducing manual effort and improving test coverage across different screen configurations.
Organizations can use this skill to audit digital interfaces for accessibility by detecting UI elements and their properties, ensuring compliance with standards like WCAG. It helps identify missing labels or non-clickable elements, facilitating remediation for better user experience.
Support teams can automate troubleshooting by capturing screenshots, parsing UI elements, and performing actions like clicking or typing remotely. This speeds up issue resolution for end-users, especially in IT helpdesk environments with repetitive tasks.
Platforms can automate moderation by analyzing UI screenshots to detect and interact with specific elements, such as buttons for approving or rejecting content. It enhances efficiency in monitoring user-generated interfaces, reducing manual review workload.
Retailers can streamline operations by automating UI interactions on e-commerce platforms, such as parsing product pages and performing actions like adding items to cart. This supports tasks like inventory management or order processing with minimal human intervention.
Offer this skill as a cloud-based service with tiered pricing based on usage volume, such as number of screenshots parsed or actions performed. Target businesses needing scalable UI automation without infrastructure setup, generating recurring revenue.
Sell perpetual licenses to large organizations for on-premise deployment, including customization and support services. This model suits industries with strict data privacy requirements, providing high-value contracts and ongoing maintenance revenue.
Provide professional services to integrate this skill into existing workflows, offering training, customization, and ongoing optimization. This model leverages expertise to solve specific client challenges, generating project-based and retainer revenue.
💬 Integration Tip
Ensure proper environment setup with the bootstrap script and handle GUI dependencies for actions like clicking, using calibration for multi-display setups to maintain accuracy.
Scored Apr 19, 2026
抖音数据查询与工具助手。覆盖视频详情、用户数据、搜索、热榜、创作者工具、星图达人、内容指数等模块。含部分交互触发和协议工具接口(已标注)。
小红书全场景数据查询助手。支持App和Web多版本API,覆盖笔记详情、用户数据、搜索、商品、评论、话题等全功能。
小红书(RED/XHS)自动化助手。提供完整的小红书操作能力:登录、发布图文/视频、搜索笔记、浏览详情、点赞收藏评论、查看博主主页、内容策划。 当用户提到小红书、红书、XHS、RED、发笔记、搜笔记、小红书运营等任何与小红书相关的操作时使用此 skill,即使用户没有明确说"小红书"但描述的场景明显是小红书(如"...
知乎数据查询助手。覆盖用户信息、搜索、专栏、问答、热榜、评论等全功能。
今日头条数据查询助手。覆盖文章、视频、用户、评论等全功能。
微博全场景数据查询助手。整合App/Web/V2多版本API,覆盖微博详情、用户数据、AI搜索、高级搜索、热搜榜单、评论、视频等全功能。