Abstract:Past few years have witnessed the widespread adoption of unmanned aerial vehicles (UAVs) in target tracking for regional monitor and strike. Most existing target tracking approaches rely on the target motion frames obtained by the camera equipped, or on ideally assuming a pre-set target trajectory. However, in practice, the real trajectory of the target cannot be perfectly known to the UAVs in advance, and also the target may intelligently adjust its flying strategy according to the environment. Besides, the limited flight performance, as well as information capture and processing capability, of a single UAV can hardly fulfill high tracking success rate requirements. To address aforementioned issues, this paper proposes an end-to-end cooperative multi-agent reinforcement learning (MARL) scheme, where UAVs are enabled to make intelligent flight decisions for cooperative target tracking, on the basis of the past and current states of the target. In order to reduce power consumption and prolong the lifetime of the UAV tracking system, the propulsion power consumption model and energy saving strategy are introduced. Moreover, to further increase the detection coverage, spatial information entropy is introduced in the tracking algorithm. Simulation results show that our proposed algorithm outperfoms the deep reinforcement learning baselines in terms of the mean episode rewards, while also yields high performances with respect to tracking success rates, power saving efficiency and detection coverage.

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

Source Seeking Of Multi-Uav With Obstacle Avoidance

Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

Integrated Design of Cooperative Area Coverage and Target Tracking with Multi-UAV System

Multi-UAV Collaborative Target Search Method in Unknown Dynamic Environment

An Efficient Framework for Probabilistic Search with Multi-UAVs

Simultaneous Search and Tracking of Non-cooperative Mobile Targets Using Multiple UAVs in Uneven Environments

Optimal Formation Control and Visual Simulation for Multiple Unmanned Aerial Vehicles (Uavs)

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

A Multi-UAV System for Exploration and Target Finding in Cluttered and GPS-Denied Environments

Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

Searching and Tracking an Unknown Number of Targets: A Learning-Based Method Enhanced with Maps Merging

Swarm coordination of mini-UAVs for target search using imperfect sensors

Multi-UAV reconnaissance task allocation for heterogeneous targets using grouping ant colony optimization algorithm

Cooperative Sensing Enhanced UAV Path-Following and Obstacle Avoidance with Variable Formation

Distributed Cooperative Search Algorithm With Task Assignment and Receding Horizon Predictive Control for Multiple Unmanned Aerial Vehicles

A distributed framework for multiple UAV cooperative target search under dynamic environment

An Active Search Strategy with Multiple Unmanned Aerial Systems for Multiple Targets

A Vision-Based Target Detection, Tracking, and Positioning Algorithm for Unmanned Aerial Vehicle

Profit-Driven Adaptive Moving Targets Search With Uav Swarms