Introduction
This project demonstrates how to build an interactive hand-controlled LED system that uses computer vision and gesture recognition to control physical lights dynamically. By tracking hand gestures and finger positions through a webcam, the system bridges software logic with physical hardware to manipulate LEDs in real time without any manual button presses or switches.
Connections
The hardware setup integrates an Arduino microcontroller with external LED components:
- LED Anodes (+): Connect the positive of all the 5 leds to 8,9,10,11,12
- LED Cathodes (-): Connect together to the shared GND (Ground) rail on a breadboard.
- Communication: The Arduino is linked to a computer via a USB cable to establish a serial communication pipeline for receiving real-time gesture commands.
Working
The project operates through a combination of computer vision processing and embedded hardware control:
- Computer Vision & Hand Tracking: A webcam captures live video input, and a Python script (utilizing libraries like OpenCV and MediaPipe) detects hand landmarks and counts raised fingers or tracks hand positioning.
- Serial Data Transmission: Once the script identifies the user’s hand state or finger count, it translates this data into a lightweight command string and transmits it over the serial COM port to the Arduino.
- Microcontroller Logic: The Arduino constantly listens to the serial stream, decodes the incoming gesture parameters, and toggles the corresponding LED states on or off.
- Real-Time Response: As the user changes their hand gestures or finger count in front of the camera, the system instantly updates the physical lighting output to match.
Components
Jumper wires – https://link.amazon/B0bWtsAH1
Arduino Nano –https://link.amazon/B09hPoigI
Breadboard and jumber wire kit- https://link.amazon/B02Fuy5kY
Download Arduino and Python Code – Click Here
Download Python – https://www.python.org/downloads/release/python-3120/
Download VS Code – https://code.visualstudio.com/download?_exp_download=fb315fc982