Abstract:Abstract Multi-agent multi-target search strategies can be utilized in complex scenarios such as post-disaster search and rescue by unmanned aerial vehicles. To solve the problem of fixed target and trajectory, the current multi-agent multi-target search strategies are mainly based on deep reinforcement learning (DRL). However, the training of agents by the DRL tend to be brittle due to their sensitivity to the training environment, which makes the strategies learned by the agents fall into local optima frequently, resulting in poor system robustness. Additionally, sparse rewards in DRL will lead to the problems such as difficulty in system convergence and low utilization efficiency of the sampled data. To address the problem that the robustness of the agents is weakened and the sparse rewards exist in the multi-objective search environment, we propose a MiniMax Multi-agent Deep Deterministic Policy Gradient based on the Parallel Hindsight Experience Replay (PHER-M3DDPG) algorithm, which adopts the framework of centralized training and decentralized execution in continuous action space. To enhance the system robustness, the PHER-M3DDPG algorithm employs a minimax learning architecture, which adaptively adjusts the learning strategy of agents by involving adversarial disturbances. In addition, to solve the sparse rewards problem, the PHER-M3DDPG algorithm adopts a parallel hindsight experience replay mechanism to increase the efficiency of data utilization by involving virtual learning targets and batch processing of the sampled data. Simulation results show that the PHER-M3DDPG algorithm outperforms the existing algorithms in terms of convergence speed and the task completion time in a multi-target search environment.

Multi-Agent Reinforcement Learning for Distributed Cooperative Targets Search

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach

Decentralized Reinforcement Learning for Multi-Target Search and Detection by a Team of Drones

Multi-UAV Collaborative Target Search Method in Unknown Dynamic Environment

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

Improving multi-target cooperative tracking guidance for UAV swarms using multi-agent reinforcement learning

Distributed Cooperative Search Algorithm With Task Assignment and Receding Horizon Predictive Control for Multiple Unmanned Aerial Vehicles

Distributed Multi-Target Search and Surveillance Mission Planning for Unmanned Aerial Vehicles in Uncertain Environments

Multi-Target Pursuit by a Decentralized Heterogeneous UAV Swarm using Deep Multi-Agent Reinforcement Learning

Multi-UAV Distributed Collaborative Coverage for Target Search Using Heuristic Strategy

Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

A Distributed Model Predictive Control-based Method for Multi-different-target Search in Unknown Environments

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

Multi-UAV Collaborative Search and Strike based on Reinforcement Learning

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Research on situational awareness technology of battlefield environment based on Multi-agent Cooperation

Collaborative Target Search with a Visual Drone Swarm: An Adaptive Curriculum Embedded Multistage Reinforcement Learning Approach

Simultaneous Search and Tracking of Non-cooperative Mobile Targets Using Multiple UAVs in Uneven Environments

Multi-USV Dynamic Navigation and Target Capture: A Guided Multi-Agent Reinforcement Learning Approach