Abstract:Unmanned aerial vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) are used in various fields. This paper presents a vision‐based system for UAVs tracking UGVs autonomously in cluttered scenarios, combining deep learning‐based visual tracking with local path planning. A lightweight MobileNetV2 tracker improves operation speed and robustness. Real‐world experiments show the system's success in cluttered environments, with a 61.7% success rate on the UAV123 dataset and 45 fps tracking speed on the NVIDIA Jetson TX2, advancing real‐time unmanned tracking technologies. Unmanned aerial vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) are widely used in various fields, and autonomous tracking of UGV by UAV can significantly improve the collaborative capability and operational range of unmanned systems. In order to realize autonomous UAV tracking in complex and cluttered scenarios, this paper presents a vision‐based tracking system for UAV tracking UGV, integrating a visual target tracking model based on deep learning with a local path planning methodology. The system includes a deep learning‐based tracker, a state machine, and an obstacle avoidance planning algorithm. In addition, to improve the robustness of UAV onboard tracking, we introduce a lightweight tracking algorithm based on MobileNetV2 network, which ensures the tracking performance while improving the operation speed. Through real‐world experiments, it is demonstrated that our system can realize autonomous target tracking in cluttered environments without prior information. The proposed tracker exhibits a success rate of 61.7% on the UAV123 dataset and achieves a tracking speed of 45 frames per second (fps) on the NVIDIA Jetson TX2, demonstrating significant advancements in real‐time, efficient unmanned tracking technologies.

Solving Tracking Challenges: Lightweight Algorithm for Single Pedestrian Tracking on Nano-UAVs

Small Target Recognition and Tracking Based on UAV Platform

Visual Object Tracking for A Nano-scale Quadrotor

Dynamic Target Tracking of Small UAVs in Unstructured Environment

Pedestrian Tracking from an Unmanned Aerial Vehicle

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Visual Object Tracking and Servoing Control of a Nano-Scale Quadrotor: System, Algorithms, and Experiments.

Dynamic Target Tracking and Localization for Small UAV in Unstructured Outdoor Environment

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Improving Autonomous Nano-Drones Performance via Automated End-to-End Optimization and Deployment of DNNs

LightOcean: A Lightweight and Efficient Network for Real-time UAV Tracking.

A Lightweight Gesture Recognition Method on Ultralow-Power Nano-UAVs

Accurate Specified-Pedestrian Tracking from Unmanned Aerial Vehicles

Visual Pedestrian Tracking from a UAV Platform

A Novel Real-Time Moving Target Tracking and Path Planning System for a Quadrotor UAV in Unknown Unstructured Outdoor Scenes

A Real-Time Siamese Tracker Deployed on UAVs

Real-time Pedestrian Tracking Based on YOLOv3 and Prototype Clustering

Real‐time visual tracking design for an unmanned aerial vehicle in cluttered environments

A Real-Time Tracking Algorithm for Multi-Target UAV Based on Deep Learning.

A UAV aided lightweight target information collection and detection approach

Dynamic Target Tracking and Ingressing of a Small UAV Using Monocular Sensor Based on the Geometric Constraints