Hello Tello Pilot!
Join our DJI Tello community & remove this banner.
Sign up

YAPT - Yet Another Pose Tracking (AI based)

Hacky

Well-known member
Joined
Jul 19, 2021
Messages
376
Reaction score
140
Location
Germany
I know, there are already tons of "Tello face tracking" and even some pose tracking videos out there. I decided to go for my own aproach:

To view this content we will need your consent to set third party cookies.
For more detailed information, see our cookies page.

Compared to face detection, pose detection allows a better interaction with the drone and also works with backlight.

Implementation is based on DJITelloPy and OpenCV (Python version) with TensorFlow. It was quite difficult to find a pose tracking model, that also runs with satisfying frame rate even on slower hardware without GPU acceleration. I decided for a pretty simple approach. There are more accurate pose detection models out there but most of them are too slow without powerful GPU hardware.

At the moment, it only follows the nose using by turning on the yaw axis. For a smoother "nose tracking", PID control is applied. Next step will be to make it also horizontally follow the detected person...
 
Last edited:
Meanwhile, the software got many improvements:
  • Better pose and hand-detection / tracking
  • "Follow me" (horizontal and vertical)
  • Gesture control
  • Orbit mode
To view this content we will need your consent to set third party cookies.
For more detailed information, see our cookies page.
 

Members online

Forum statistics

Threads
5,790
Messages
40,373
Members
17,555
Latest member
allanmuriano