Abstract:In recent years, deep reinforcement learning (DRL) has proved its great potential in multi-agent cooperation. However, how to apply DRL to multi-target tracking (MTT) problem for unmanned aerial vehicle (UAV) swarms is challenging: 1) the scale of UAVs may be large, but the existing multi-agent reinforcement learning (MARL) methods that rely on global or joint information of all agents suffer from the dimensionality curse; 2) the dimension of each UAV's received information is variable, which is incompatible with the neural networks with fixed input dimensions; 3) the UAVs are homogeneous and interchangeable that each UAV's policy should be irrelevant to the permutation of its received information. To this end, we propose a DRL method for UAV swarms to solve the MTT problem. Firstly, a decentralized swarm-oriented Markov Decision Process (MDP) model is presented for UAV swarms, which involves each UAV's local communication and partial observation. Secondly, to achieve better scalability, a cartogram feature representation (FR) is proposed to integrate the variable-dimensional information set into a fixed-shape input variable, and the cartogram FR can also maintain the permutation irrelevance to the information. Then, the double deep Q-learning network with dueling architecture is adapted to the MTT problem, and the experience-sharing training mechanism is adopted to learn the shared cooperative policy for UAV swarms. Extensive experiments are provided and the results show that our method can successfully learn a cooperative tracking policy for UAV swarms and outperforms the baseline method in the tracking ratio and scalability.

Multi-UAV Collaborative Detection Based on Reinforcement Learning.

Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning

Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning

UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach

UAV Swarm Confrontation Using Hierarchical Multiagent Reinforcement Learning

Improving multi-target cooperative tracking guidance for UAV swarms using multi-agent reinforcement learning

Multi-UAV Collaborative Search and Strike based on Reinforcement Learning

MW-MADDPG: a meta-learning based decision-making method for collaborative UAV swarm

Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

Autonomous and cooperative control of UAV cluster with multi-agent reinforcement learning

Deep Reinforcement Learning-Driven Collaborative Rounding-Up for Multiple Unmanned Aerial Vehicles in Obstacle Environments

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Decentralized Reinforcement Learning for Multi-Target Search and Detection by a Team of Drones

Multi-Target Pursuit by a Decentralized Heterogeneous UAV Swarm using Deep Multi-Agent Reinforcement Learning

Autonomous UAV-based surveillance system for multi-target detection using reinforcement learning

Oracle-Guided Deep Reinforcement Learning for Large-Scale Multi-UAVs Flocking and Navigation.

Multi-target tracking for unmanned aerial vehicle swarms using deep reinforcement learning

[Development of specific immunotherapy technics in immediate hypersensitivity].

Deep Reinforcement Learning-based Collaborative Multi-UAV Coverage Path Planning