Let Ai Use Your Iphone With A $7 Esp32-s3 (no Jailbreak)
About the project
Handsy AI turns a $7 Seeed XIAO ESP32-S3 into AI hands for a real iPhone: it plugs in as a USB mouse and keyboard, gets the screen via AirPlay Screen Mirroring, and talks to your computer over Bluetooth. No jailbreak, no camera.
Project info
Items used in this project
Story
Handsy AI is an open-source project that lets an AI agent operate a real, unmodified iPhone. A Seeed Studio XIAO ESP32-S3 plugs into the iPhone's USB-C port and acts as a USB HID mouse and keyboard, so it can tap, swipe and type like a person. The iPhone's screen is shared through AirPlay Screen Mirroring, so the AI can see what it is doing. The computer (or the Handsy iPhone app) talks to the board over Bluetooth. No jailbreak, no camera, no special iOS setup.
What you need: a Seeed XIAO ESP32-S3 (about $7), a USB-C cable/adapter, an iPhone, and a Mac or PC.
Software: the esp32agent CLI (npm install -g esp32agent) includes an MCP server (esp32agent mcp), so Claude Code, Codex and other MCP clients can control the phone.
Website and docs: https://handsy.tech
Source code: https://github.com/onehumanbeing/esp32-iphone-agent
Leave your feedback...