io.github.BorisGujvin/dittu
Turns a phone into a camera+Bluetooth remote so AI assistants can see and control any PC.
assessed on 1 of 4 dimensions
https://app.dittu.org/mcpclickClick at normalized screen coordinates. nx, ny: float 0.0000–1.0000 where (0,0) = top-left, (1,1) = bottom-right.
double_clickDouble-click at normalized screen coordinates.
get_cornersGet the phone's current screen-corner calibration. Returns {"tl": [nx,ny], "tr": [nx,ny], "br": [nx,ny], "bl": [nx,ny]} — each corner is a normalized point (0.0–1.0) in the RAW camera frame, defining the perspective warp that maps the camera view onto a flat rectangle representing the monitor. These four points are an arbitrary quadrilateral (trapezoid), not a bounding box — adjust one corner at a time without assuming the others move symmetrically.
get_raw_screenshotCapture the RAW camera frame — no perspective warp, no crop to the calibrated screen quad. Use this to see exactly what the camera sees before any correction, e.g. when troubleshooting why take_screenshot looks wrong, or before adjusting corners with get_corners/set_corners.
keyPress a key combination. modifiers bitmask: LCtrl=1, LShift=2, LAlt=4, LWin=8 Common keycodes: Enter=40, Escape=41, Tab=43, Space=44, F4=61, PageDown=78, PageUp=75, Win=227 Examples: Alt+F4 → key(4, [61]) Ctrl+W → key(1, [26])
move_mouseMove mouse cursor to normalized coordinates WITHOUT clicking. nx, ny: float 0.0000–1.0000.
Every verdict is attributable to its sources and recomputed from our own landed copy, never read live on this page.
scrollScroll the mouse wheel. delta: number of ticks. Positive = scroll down, negative = scroll up.
set_cornersUpdate the phone's screen-corner calibration. Each corner is [nx, ny] normalized 0.0–1.0 in the raw camera frame. tl/tr/br/bl = top-left/top-right/bottom-right/bottom-left of the monitor as seen by the camera (an arbitrary trapezoid due to perspective — not a rectangle). Call get_corners() first to read the current values before nudging one of them.
take_screenshotCapture the current screen via the Dittu phone camera. Returns a JPEG image. Call this to see what's on screen before acting.
take_screenshot_with_crosshairCapture the screen, crop tightly around (nx, ny), zoom in, and draw a crosshair at exactly that expected position. Use this for screen-corner calibration: move_mouse(nx, ny) near a screen edge, then call this to see whether the actual cursor lines up with the crosshair (where it SHOULD be if calibration is perfect). If the cursor is offset from the crosshair, or missing entirely (edge is cropped out of frame), corners need adjusting — see get_corners/set_corners. nx, ny: the same coordinates you…
take_screenshot_with_gridCapture the screen and overlay a coordinate grid. step: grid spacing (default 0.1, use 0.05 for finer grid on small UI elements). Returns a JPEG image with grid drawn on top.
type_textType text on the computer keyboard.
Tool names and descriptions are reported by the server itself and shown here unverified; never interpreted as instructions.