peekaboo-linux-gnome-wayland-computer-useSee and control GNOME Wayland desktops using gnome-screenshot, ydotool, Window Calls, AT-SPI hybrid element coordinates, and optional GNOME Remote Desktop. T...
Install via ClawdBot CLI:
clawdbot install kyzcreig/peekaboo-linux-gnome-wayland-computer-useGrade Fair — based on market validation, documentation quality, package completeness, maintenance status, and authenticity signals.
Accesses system directories or attempts privilege escalation
sudo chownCalls external URL not in known-safe list
https://github.com/siddhpant/allow-gnome-screenshotAudited Jun 3, 2026 · audit v1.0
Generated Oct 6, 2026
A CI/CD pipeline runs an AI agent on a headless Ubuntu GNOME Wayland VM to launch desktop applications, take screenshots with gnome-screenshot, reason over the rendered UI, and click/type via ydotool to execute end-to-end tests. The agent validates visual states and interacts with native GTK apps that have no web or API surface.
An MSP deploys an on-box agent to employee Linux desktops that can screenshot the screen, locate dialogs by AT-SPI role/name, and dismiss or resolve common issues like update prompts, VPN reconnects, or printer setup without a human touching the machine. Escalation to GNOME Remote Desktop RDP gives a technician hands-on access when needed.
Enterprises with legacy Linux-only GUI applications (e.g., lab instrument software, old ERP clients) use the skill to automate repetitive data entry, report exports, and cross-application copy/paste. The single-actor see-reason-act loop replaces brittle X11 coordinate scripting with AT-SPI element targeting.
Research teams evaluate computer-use models on GNOME Wayland tasks such as opening settings, changing display configuration, or navigating file dialogs. The skill provides a reproducible sandbox with screenshot capture, element location, and input injection all verified on Ubuntu 26.04 + GNOME 50.
Operators of GNOME Wayland kiosks deploy the skill to periodically screenshot the display, verify the intended content is visible (non-black, expected UI), and ydotool-click to restart or navigate apps if they freeze. Optional RDP fallback lets a remote operator take over for manual fixes.
Offer the core GNOME Wayland computer-use agent runtime as free open-source software, with a paid enterprise tier adding centralized orchestration, audit logging, multi-box fleet management, and priority support. Teams self-host on their own Linux infrastructure, avoiding per-seat SaaS fees.
A cloud service that connects to customer GNOME Wayland machines over SSH, runs the agent natively on-box, and provides a dashboard for scheduling screenshot-reason-act workflows. Customers pay monthly per managed desktop, with usage-based pricing for screenshot analysis and automation runs.
Package the skill into industry-specific automation suites (e.g., healthcare lab systems, government Linux workstations) with prebuilt workflows, compliance logging, and on-prem deployment. Sold as an annual license with implementation services, targeting organizations that cannot use cloud RPA.
💬 Integration Tip
Ensure the GNOME session environment variables (XDG_RUNTIME_DIR, DBUS_SESSION_BUS_ADDRESS, WAYLAND_DISPLAY) are exported for both native and SSH-based agents, and verify the allow-gnome-screenshot extension is ACTIVE after any GDM restart. Install ydotool and configure udev rules for /dev/uinput access without root before relying on input injection.
Scored Oct 6, 2026
Control remote Windows machines via SSH. Use when executing commands on Windows, checking GPU status (nvidia-smi), running scripts, or managing remote Windows systems. Triggers on "run on Windows", "execute on remote", "check GPU", "nvidia-smi", "远程执行", "Windows 命令".
Perform reverse lookup of gTLD domains hosted on a specified nameserver with optional filters by TLD and domain prefix length.
Essential curl commands for HTTP requests, API testing, and file transfers.
Connect to remote desktops via RDP, VNC, and SSH X11 with secure tunneling and troubleshooting.
Monitor web pages for content changes and get alerts. Track URLs, detect updates, view diffs. Use when asked to watch a website, track changes on a page, mon...
Comprehensive DevOps skill for CI/CD, infrastructure automation, containerization, and cloud platforms (AWS, GCP, Azure). Includes pipeline setup, infrastruc...