Abstract:Unmanned aerial vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) are used in various fields. This paper presents a vision‐based system for UAVs tracking UGVs autonomously in cluttered scenarios, combining deep learning‐based visual tracking with local path planning. A lightweight MobileNetV2 tracker improves operation speed and robustness. Real‐world experiments show the system's success in cluttered environments, with a 61.7% success rate on the UAV123 dataset and 45 fps tracking speed on the NVIDIA Jetson TX2, advancing real‐time unmanned tracking technologies. Unmanned aerial vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) are widely used in various fields, and autonomous tracking of UGV by UAV can significantly improve the collaborative capability and operational range of unmanned systems. In order to realize autonomous UAV tracking in complex and cluttered scenarios, this paper presents a vision‐based tracking system for UAV tracking UGV, integrating a visual target tracking model based on deep learning with a local path planning methodology. The system includes a deep learning‐based tracker, a state machine, and an obstacle avoidance planning algorithm. In addition, to improve the robustness of UAV onboard tracking, we introduce a lightweight tracking algorithm based on MobileNetV2 network, which ensures the tracking performance while improving the operation speed. Through real‐world experiments, it is demonstrated that our system can realize autonomous target tracking in cluttered environments without prior information. The proposed tracker exhibits a success rate of 61.7% on the UAV123 dataset and achieves a tracking speed of 45 frames per second (fps) on the NVIDIA Jetson TX2, demonstrating significant advancements in real‐time, efficient unmanned tracking technologies.

Pedestrian Tracking from an Unmanned Aerial Vehicle

Accurate Specified-Pedestrian Tracking from Unmanned Aerial Vehicles

Real-time Accurate Pedestrian Circular Tracking with UAV

Visual Pedestrian Tracking from a UAV Platform

A Vision-based UAV Tracker Aiming at Aerial Targets

Design of A Prediction based Pedestrian Tracking System by UAV

Dynamic Target Tracking and Localization for Small UAV in Unstructured Outdoor Environment

Using YOLO-based Pedestrian Detection for Monitoring UAV

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

Pedestrian Detection And Tracking From Low-Resolution Unmanned Aerial Vehicle Thermal Imagery

Dynamic Target Tracking of Small UAVs in Unstructured Environment

Person Tracking and Frontal Face Capture with UAV

Implementation of Face Tracking System with a Multirotor UAV

Visual Servo Control Of Unmanned Aerial Vehicles: An Object Tracking-Based Approach

Solving Tracking Challenges: Lightweight Algorithm for Single Pedestrian Tracking on Nano-UAVs

Real-time tracking a ground moving target in complex indoor and outdoor environments with UAV

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

Unmanned Aerial Vehicle Video-Based Target Tracking Algorithm Using Sparse Representation.

Real‐time visual tracking design for an unmanned aerial vehicle in cluttered environments

Tracking Strategy of Unmanned Aerial Vehicle for Tracking Moving Target

A Novel Real-Time Moving Target Tracking and Path Planning System for a Quadrotor UAV in Unknown Unstructured Outdoor Scenes