Hand Tracking Demo
Reachy Mini

Hand Tracking

vision lite hands-tracking mediapipe

Control Reachy Mini’s head and antennas using natural hand movements, powered by real-time hand tracking with MediaPipe.
Reachy Mini follows the position of your hand with its head, while the orientation of your fingers controls the antennas.

⚠️ This application is available only on Reachy Mini Lite.

How it works

Simply place one or two hands in front of Reachy Mini’s camera.

With one hand, Reachy Mini tracks your hand position with its head, and finger orientation controls both antennas together.

With two hands, each hand controls one antenna independently

For best tracking results, keep your hands at least 50 cm away from the robot’s camera.

From the UI, you can:
  • Enable or disable tracking features
  • Select the preferred hand to track
  • Change antenna behavior modes
  • View the robot’s live camera feed in real time

How to install

  1. Make sure you already have the dashboard installed.
  2. Connect to your Reachy Mini using the dashboard.
  3. Navigate to the "Applications" tab in the dashboard.
  4. Find "Hand Tracking" in the list of available applications.
  5. Click "Install" and allow camera access when prompted.
Dashboard Demo