SkyGestures is an innovative app that uses hand gestures to control DJI Tello drones via the Vision Pro platform. Now open-sourced and available for free on the Vision Pro App Store.
The app supports 12 intuitive hand gestures to seamlessly control the DJI Tello drone:
| Action | Gesture |
|---|---|
| Takeoff | π |
| Land | β |
| Fly Upward | π |
| Fly Downward | π€ |
| Fly Forward | π€ |
| Fly Backward | π€ |
| Fly Leftward | π |
| Fly Rightward | π |
| Stop | π«° |
| Rotate Leftward | π€ |
| Rotate Rightward | π€ |
| Flip | βοΈ |
- A DJI Tello drone device
- visionOS 1.0 or newer
- Xcode 15.2 or higher
- Swift 5.9 or above
To get started with SkyGestures:
- Power on the DJI Tello drone by pressing the button on the right side.
- Connect your Vision Pro device to Tello's Wi-Fi network (e.g., Tello-FD3293).
- Open SkyGestures app and tap Start to Use Hand Gestures to activate gesture detection.
- Press Connect to establish a connection with the drone.
- Enjoy controlling your Tello drone using intuitive hand gestures!
Watch this YouTube video for a detailed demonstration of the app:
- Integration of live video feed from Tello drone. (Investigating) I may need help from the community to implement this feature!
- Virtual 3D Tello drone model for users without access to a physical drone. (planned)
- Configuration panel for customizing flight speed, monitoring battery levels, and more. (planned)
- Formation flight control for multiple Tello drones, allowing synchronized maneuvers and operations in a coordinated fleet.
- More features from your pull requests contributions!
We welcome contributions from the community! Whether you're looking to implement a new feature, fix bugs, or improve documentation, we appreciate your help.
- Twitter: zlinoliver
- Wechat: OliverOuYang
- GitHub: zlinoliver
- Bilibili: 欧ε₯ζζη
We extend our sincere gratitude to the developers and contributors of the following open-source projects, which have played a pivotal role in the development of SkyGestures:
- HandVector - The hand tracking feature is built upon the robust foundation provided by HandVector. Their pioneering work in gesture recognition has significantly enhanced our application's functionality.
Our project stands on the shoulders of these remarkable community contributions, and we are profoundly thankful for their efforts.
SkyGestures is available under the MIT license. For more details, see the LICENSE file.