Abstract:Unmanned aerial vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) are used in various fields. This paper presents a vision‐based system for UAVs tracking UGVs autonomously in cluttered scenarios, combining deep learning‐based visual tracking with local path planning. A lightweight MobileNetV2 tracker improves operation speed and robustness. Real‐world experiments show the system's success in cluttered environments, with a 61.7% success rate on the UAV123 dataset and 45 fps tracking speed on the NVIDIA Jetson TX2, advancing real‐time unmanned tracking technologies. Unmanned aerial vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) are widely used in various fields, and autonomous tracking of UGV by UAV can significantly improve the collaborative capability and operational range of unmanned systems. In order to realize autonomous UAV tracking in complex and cluttered scenarios, this paper presents a vision‐based tracking system for UAV tracking UGV, integrating a visual target tracking model based on deep learning with a local path planning methodology. The system includes a deep learning‐based tracker, a state machine, and an obstacle avoidance planning algorithm. In addition, to improve the robustness of UAV onboard tracking, we introduce a lightweight tracking algorithm based on MobileNetV2 network, which ensures the tracking performance while improving the operation speed. Through real‐world experiments, it is demonstrated that our system can realize autonomous target tracking in cluttered environments without prior information. The proposed tracker exhibits a success rate of 61.7% on the UAV123 dataset and achieves a tracking speed of 45 frames per second (fps) on the NVIDIA Jetson TX2, demonstrating significant advancements in real‐time, efficient unmanned tracking technologies.

Real-time tracking a ground moving target in complex indoor and outdoor environments with UAV

On trackability of a moving target by fixed-wing UAV using geometric approach

A Vision-based UAV Tracker Aiming at Aerial Targets

USV-Tracker: A Novel USV Tracking System for Surface Investigation with Limited Resources

A real-time visual tracking for unmanned aerial vehicles with dynamic window

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

A Vision-Based Ground Moving Target Tracking System for Quadrotor UAVs

Small Unmanned Aerial Vehicle Visual System for Ground Moving Target Positioning

Development of UAV-Based Target Tracking and Recognition Systems

A Novel Real-Time Moving Target Tracking and Path Planning System for a Quadrotor UAV in Unknown Unstructured Outdoor Scenes

Real‐time visual tracking design for an unmanned aerial vehicle in cluttered environments

Fast-Tracker: A Robust Aerial System for Tracking Agile Target in Cluttered Environments

An Autonomous Moving Target Tracking System for Rotor UAV

Implementation of Face Tracking System with a Multirotor UAV

Vision-Based Target Detection and Tracking System for a Quadcopter

Real-time Active Detection of Targets and Path Planning Using UAVs

Multitarget Real-Time Tracking Algorithm for UAV IoT

Dynamic Target Tracking and Ingressing of a Small UAV Using Monocular Sensor Based on the Geometric Constraints

A Robust and Efficient UAV Path Planning Approach for Tracking Agile Targets in Complex Environments

Target recognition and tracking system based on UAV platform

Design And Implementation Of A Target Detection And Localization System For Uav