Let Ai Use Your Iphone With A $7 Esp32-s3 (no Jailbreak)

About the project

Handsy AI turns a $7 Seeed XIAO ESP32-S3 into AI hands for a real iPhone: it plugs in as a USB mouse and keyboard, gets the screen via AirPlay Screen Mirroring, and talks to your computer over Bluetooth. No jailbreak, no camera.

Project info

Difficulty: Easy

Platforms: Espressif

Estimated time: 1 hour

License: MIT license (MIT)

Items used in this project

Hardware components

Seeed Studio Xiao Esp32s3 (pre-soldered) Seeed Studio Xiao Esp32s3 (pre-soldered) x 1

Story

Handsy AI is an open-source project that lets an AI agent operate a real, unmodified iPhone. A Seeed Studio XIAO ESP32-S3 plugs into the iPhone's USB-C port and acts as a USB HID mouse and keyboard, so it can tap, swipe and type like a person. The iPhone's screen is shared through AirPlay Screen Mirroring, so the AI can see what it is doing. The computer (or the Handsy iPhone app) talks to the board over Bluetooth. No jailbreak, no camera, no special iOS setup.

What you need: a Seeed XIAO ESP32-S3 (about $7), a USB-C cable/adapter, an iPhone, and a Mac or PC.

Software: the esp32agent CLI (npm install -g esp32agent) includes an MCP server (esp32agent mcp), so Claude Code, Codex and other MCP clients can control the phone.

Website and docs: https://handsy.tech

Source code: https://github.com/onehumanbeing/esp32-iphone-agent

Code

esp32-iphone-agent

Credits

Leave your feedback...