Real‐time visual tracking design for an unmanned aerial vehicle in cluttered environments
Juntao Liang,Peng Yi,Wei Li,Jiaxuan Zuo,Bo Zhu,Yong Wang
DOI: https://doi.org/10.1002/oca.3175
2024-07-13
Optimal Control Applications and Methods
Abstract:Unmanned aerial vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) are used in various fields. This paper presents a vision‐based system for UAVs tracking UGVs autonomously in cluttered scenarios, combining deep learning‐based visual tracking with local path planning. A lightweight MobileNetV2 tracker improves operation speed and robustness. Real‐world experiments show the system's success in cluttered environments, with a 61.7% success rate on the UAV123 dataset and 45 fps tracking speed on the NVIDIA Jetson TX2, advancing real‐time unmanned tracking technologies. Unmanned aerial vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) are widely used in various fields, and autonomous tracking of UGV by UAV can significantly improve the collaborative capability and operational range of unmanned systems. In order to realize autonomous UAV tracking in complex and cluttered scenarios, this paper presents a vision‐based tracking system for UAV tracking UGV, integrating a visual target tracking model based on deep learning with a local path planning methodology. The system includes a deep learning‐based tracker, a state machine, and an obstacle avoidance planning algorithm. In addition, to improve the robustness of UAV onboard tracking, we introduce a lightweight tracking algorithm based on MobileNetV2 network, which ensures the tracking performance while improving the operation speed. Through real‐world experiments, it is demonstrated that our system can realize autonomous target tracking in cluttered environments without prior information. The proposed tracker exhibits a success rate of 61.7% on the UAV123 dataset and achieves a tracking speed of 45 frames per second (fps) on the NVIDIA Jetson TX2, demonstrating significant advancements in real‐time, efficient unmanned tracking technologies.
automation & control systems,operations research & management science,mathematics, applied