Person Tracking and Frontal Face Capture with UAV

Qifeng Shen,Linfeng Jiang,Huilin Xiong
DOI: https://doi.org/10.1109/icct.2018.8600068
2018-01-01
Abstract:In this paper, we present a method using an unmanned aerial vehicle (UAV) to track the specified walking person and automatically capture a frontal photo of the target. The proposed method is composed by three parts: person detection and recognition, face detection and feature points localization, and vision based UAV control. In the person tracking part, we employ the deep neural network YOLOv3 for person detection and Locality-constrained Linear Coding (LLC) method to match the specified target person. In terms of frontal face perception, we use Multi-task Cascaded Convolutional Neural Networks (MTCNN) for face detection. Based on the vision information obtained from the two modules, the UAV can fly around the target person and obtain the target's frontal face image. The outdoor experiments based on a Parrot Bebop2 drone verify the effectiveness and practicability of our method.
What problem does this paper attempt to address?