Screenshot

メディア

Macの画面・ウィンドウ・UI要素を操作

できること

  • Screen capture — Motion-aware screenshots, region selection, video ingest and frame extraction
  • App management — Launch, quit, relaunch, hide, show, or switch to any application
  • Window control — Focus, move, resize, close, minimize, maximize, tile windows
  • UI element targeting — Identify and interact with buttons, text fields, menus, and controls
  • Keyboard input — Type text, send hotkeys (cmd+c), special keys (enter, tab, escape, arrows)
  • Mouse and gestures — Click, double-click, right-click, drag, swipe, scroll (precise or natural)
  • Clipboard operations — Read and write text, images, and file paths
  • Menu interaction — Navigate and click menu bar items and context menus
  • Annotated UI maps — Generate visual maps with clickable element IDs
  • Space management — Create, switch, and organize macOS Spaces
  • Scriptable — Define multi-step workflows in .peekaboo.json

    • 試してみる質問

  • "Show me an annotated UI map of the current app with all clickable elements"
  • "Click the Save button in this window"
  • "Type 'Hello World' and press enter"
  • "Capture a screenshot of the top-left quadrant"
  • "Launch Slack and switch to the #general channel"
  • "Resize the Chrome window to 1200x800"
  • "Copy the selected text and show me what's in clipboard"
  • "Drag this file to the Desktop"
  • "Create a new Space and move this window there"

    • プロのコツ

  • macOS only — requires Screen Recording + Accessibility permissions
  • Use \