Fly Tello using hand gestures in Apple Vision Pro

[zlinoliver]

SkyGestures is an innovative app that uses hand gestures to control DJI Tello drones via the Vision Pro platform. Now open-sourced and available for free on the Vision Pro App Store.



Github Repository link: GitHub - zlinoliver/SkyGestures: Use Hand Gestures to control DJI Tello drones in Vision Pro
We welcome contributions from the community! Whether you're looking to implement a new feature, fix bugs, or improve documentation, we appreciate your help.

The app supports 12 intuitive hand gestures to seamlessly control the DJI Tello drone:

Action	Gesture
Takeoff
Land
Fly Upward
Fly Downward
Fly Forward
Fly Backward
Fly Leftward
Fly Rightward
Stop
Rotate Leftward
Rotate Rightward
Flip

To get started with SkyGestures:

1. Power on the DJI Tello drone by pressing the button on the right side.
2. Connect your Vision Pro device to Tello's Wi-Fi network (e.g., Tello-FD3293).
3. Open SkyGestures app and tap Start to Use Hand Gestures to activate gesture detection.
4. Press Connect to establish a connection with the drone.
5. Enjoy controlling your Tello drone using intuitive hand gestures!

You can watch this YouTube video for a detailed demonstration of the app:

Future Features Roadmap​

• Integration of live video feed from Tello drone. (Investigating) I may need help from the community to implement this feature!
• Virtual 3D Tello drone model for users without access to a physical drone. (planned)
• Configuration panel for customizing flight speed, monitoring battery levels, and more. (planned)
• Formation flight control for multiple Tello drones, allowing synchronized maneuvers and operations in a coordinated fleet.
• More features from your pull requests contributions!