Control the desktop via X11 tools (xdotool, wmctrl, xdg-open) for URLs, apps, keys, typing, and clicks.

Desktop Automation

Executes desktop actions through X11 tooling.

• Path: workers/desktop-automation/
• API (port 8095): /open/url, /launch/app, /window/activate, /key, /type, /click, /intent/run

Examples

• Open our app: intent text “open our app” → opens http://localhost:3000
• Open specific URL: POST /open/url {"url":"https://example.com"}
• Focus window: POST /window/activate {"name_contains":"Firefox"}
• Type text: POST /type {"text":"hello"}

Environment

• DISPLAY (X11), DEFAULT_APP_URL, DRY_RUN

Wayland Note

Limited support on pure Wayland; use X11/XWayland for full control.