macos-desktop-controlAutomate macOS desktop by capturing screenshots and executing precise mouse movements, clicks, and keyboard inputs via cliclick.
Install via ClawdBot CLI:
clawdbot install emptyopen/macos-desktop-controlA high-fidelity automation bridge for macOS (Darwin) that enables agents to perceive the desktop state and execute precise mouse and keyboard interactions.
This skill leverages specialized wrappers located in the /scripts directory to interface with system-level binaries:
cliclick_wrapper.shA dedicated wrapper for the cliclick utility to handle synthetic input events.
scripts/cliclick_wrapper.sh/opt/homebrew/bin/cliclick with passed arguments.vision_wrapper.shThe visual perception engine for the skill.
scripts/vision_wrapper.shscreencapture utility in silent mode (-x)./tmp/claw_view.png.seeCaptures the current screen state for visual analysis.
clickSends precise commands to the mouse and keyboard.
click "c:x,y" (Click) or click "m:x,y" (Move).cliclick standard notation including w: (wait) and t: (type).
brew install cliclickGenerated Mar 1, 2026
Developers can use this skill to automate repetitive UI testing tasks, such as clicking buttons and verifying screen states. It helps catch visual regressions and functional bugs by simulating user interactions without manual effort.
This skill enables voice-controlled or switch-based navigation of macOS desktops for users with motor impairments. It can automate mouse movements and keyboard inputs based on commands, enhancing accessibility in daily computing tasks.
IT professionals can leverage this skill to remotely control a user's macOS desktop for diagnostics and repairs. It allows precise mouse clicks and screen captures to identify issues without physical access, speeding up resolution times.
Businesses can automate data entry processes by using this skill to interact with macOS applications like spreadsheets or CRM systems. It reduces manual errors and saves time by simulating keyboard typing and mouse clicks.
Content creators can automate screen captures and interactions for tutorial videos or presentations. This skill helps in scripting precise mouse movements and clicks to demonstrate software workflows efficiently.
Offer a cloud-based platform where developers subscribe to use this skill for automated UI testing of macOS applications. It reduces testing costs and improves software quality through continuous integration pipelines.
License this skill to large enterprises for internal automation of IT support, data processing, or accessibility tools. Provide custom integration support and maintenance services for long-term contracts.
Release a free version with basic mouse and keyboard control features, and offer premium upgrades for advanced capabilities like batch scripting or priority support. Target hobbyists and small businesses.
💬 Integration Tip
Ensure cliclick is installed via Homebrew and test the wrappers in a sandboxed environment to avoid system conflicts.
Capture and automate macOS UI with the Peekaboo CLI.
Manage Apple Reminders via the `remindctl` CLI on macOS (list, add, edit, complete, delete). Supports lists, date filters, and JSON/plain output.
Manage Apple Notes via the `memo` CLI on macOS (create, view, edit, delete, search, move, and export notes). Use when a user asks Clawdbot to add a note, list notes, search notes, or manage note folders.
Speak responses aloud on macOS using the built-in `say` command when user input indicates Voice Wake/voice recognition (for example, messages starting with "User talked via voice recognition on <device>").
Homebrew package manager for macOS. Search, install, manage, and troubleshoot packages and casks.
Control Apple TV, HomePod, and AirPlay devices via pyatv (scan, stream, playback, volume, navigation).