Esp32cam Pan And Tilt Using Facial Tracking
About the project
I wanted to post this project because its really easy and rewarding to make. I'll just tell you how to modify the Espressif example, by adding some lines of code in the right places. In the end you will be able to perform computer vision, facial tracking, and pan and tilt without computer support.
Estimated time: 4 hours
Items used in this project
I wanted to post this project because its really easy and rewarding to make. The ESP32Cam has an example project where it allows the user to detect faces, recognise faces, and stream the camera through a nice web page. You can find this library on your Arduino IDE under:
Its worth taking some time to get to know this example. You can adjust the video feed, detect faces, and train the program to recognise specific faces too. I think Espressif really pushed the boundaries of computer vision with this code. Most computer vision or machine learning programs require large operating systems, compilers, and libraries to process video as data. This is so stream-lined and embedded into a RISC-V instruction set, they must have pre-trained the tensors and used a quantisation/approximation. There aren't many edge products that can do computer vision so well on a tiny ESP32 processor.
I really went down a rabbit hole with this code, but I'll just tell you how to modify their program by adding some lines of code in the right places. In the end you will be able to perform computer vision, facial tracking, pan and tilt, and possible modify it for even self driving cars or robots. Lets start.