Abstract:Abstract Multi-agent multi-target search strategies can be utilized in complex scenarios such as post-disaster search and rescue by unmanned aerial vehicles. To solve the problem of fixed target and trajectory, the current multi-agent multi-target search strategies are mainly based on deep reinforcement learning (DRL). However, the training of agents by the DRL tend to be brittle due to their sensitivity to the training environment, which makes the strategies learned by the agents fall into local optima frequently, resulting in poor system robustness. Additionally, sparse rewards in DRL will lead to the problems such as difficulty in system convergence and low utilization efficiency of the sampled data. To address the problem that the robustness of the agents is weakened and the sparse rewards exist in the multi-objective search environment, we propose a MiniMax Multi-agent Deep Deterministic Policy Gradient based on the Parallel Hindsight Experience Replay (PHER-M3DDPG) algorithm, which adopts the framework of centralized training and decentralized execution in continuous action space. To enhance the system robustness, the PHER-M3DDPG algorithm employs a minimax learning architecture, which adaptively adjusts the learning strategy of agents by involving adversarial disturbances. In addition, to solve the sparse rewards problem, the PHER-M3DDPG algorithm adopts a parallel hindsight experience replay mechanism to increase the efficiency of data utilization by involving virtual learning targets and batch processing of the sampled data. Simulation results show that the PHER-M3DDPG algorithm outperforms the existing algorithms in terms of convergence speed and the task completion time in a multi-target search environment.

Multi-domain Cooperative Action Planning Strategy Based on Reinforcement Learning

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning

Multiagent Motion Planning Based on Deep Reinforcement Learning in Complex Environments

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

Multi-agent Cooperative Combat Simulation in Naval Battlefield with Reinforcement Learning

Attention-Cooperated Reinforcement Learning for Multi-agent Path Planning

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Multi-UAV Cooperative Search in Multi-Layered Aerial Computing Networks: A Multi-Agent Deep Reinforcement Learning Approach

A Deep Reinforcement Learning-Based Method Applied for Solving Multi-Agent Defense and Attack Problems.

Path Planning Algorithm for Unmanned Surface Vessel Based on Multiobjective Reinforcement Learning

Learning Efficient Multi-Agent Cooperative Visual Exploration

A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning

Collaborative Search Planning of UAV Swarms Based on Deep Reinforcement Learning

A multiagent reinforcement learning approach based on different states

Autonomous and Adaptive Role Selection for Multi-robot Collaborative Area Search Based on Deep Reinforcement Learning

Coordinating Multi-Agent Deep Reinforcement Learning in Wargame

Reinforcement Learning-Based Cooperative Hunting for an Unmanned Surface Vehicle Swarm

Multi-agent Reinforcement Learning for Cooperative Observation Path Planning of Ocean Mobile Observation Network

A further exploration of deep Multi-Agent Reinforcement Learning with Hybrid Action Space

Cooperative Planning of Multi-Uav Logistics Delivery by Multi-Graph Reinforcement Learning