Abstract:Abstract Multi-agent multi-target search strategies can be utilized in complex scenarios such as post-disaster search and rescue by unmanned aerial vehicles. To solve the problem of fixed target and trajectory, the current multi-agent multi-target search strategies are mainly based on deep reinforcement learning (DRL). However, the training of agents by the DRL tend to be brittle due to their sensitivity to the training environment, which makes the strategies learned by the agents fall into local optima frequently, resulting in poor system robustness. Additionally, sparse rewards in DRL will lead to the problems such as difficulty in system convergence and low utilization efficiency of the sampled data. To address the problem that the robustness of the agents is weakened and the sparse rewards exist in the multi-objective search environment, we propose a MiniMax Multi-agent Deep Deterministic Policy Gradient based on the Parallel Hindsight Experience Replay (PHER-M3DDPG) algorithm, which adopts the framework of centralized training and decentralized execution in continuous action space. To enhance the system robustness, the PHER-M3DDPG algorithm employs a minimax learning architecture, which adaptively adjusts the learning strategy of agents by involving adversarial disturbances. In addition, to solve the sparse rewards problem, the PHER-M3DDPG algorithm adopts a parallel hindsight experience replay mechanism to increase the efficiency of data utilization by involving virtual learning targets and batch processing of the sampled data. Simulation results show that the PHER-M3DDPG algorithm outperforms the existing algorithms in terms of convergence speed and the task completion time in a multi-target search environment.

Improving multi-UAV cooperative path-finding through multiagent experience learning

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

UAV Cooperative Search Based on Multi-agent Generative Adversarial Imitation Learning

Multi-UAV Path Planning and Following Based on Multi-Agent Reinforcement Learning

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Multi-UAV roundup strategy method based on deep reinforcement learning CEL-MADDPG algorithm

Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

Three-dimensional Collaborative Path Planning for Multiple UCAVs Based on Improved Artificial Ecosystem Optimizer and Reinforcement Learning

Autonomous and cooperative control of UAV cluster with multi-agent reinforcement learning

Multi-Agent Reinforcement Learning-Based UAV Pathfinding for Obstacle Avoidance in Stochastic Environment

Graph Convolutional Multi-Agent Reinforcement Learning For Uav Coverage Control

Dense Multi-Agent Reinforcement Learning Aided Multi-UAV Information Coverage for Vehicular Networks

Cooperatively Pursuing a Target Unmanned Aerial Vehicle by Multiple Unmanned Aerial Vehicles Based on Multiagent Reinforcement Learning

Research on the Multiagent Joint Proximal Policy Optimization Algorithm Controlling Cooperative Fixed-Wing UAV Obstacle Avoidance

Multi-Uav Automatic Dynamic Obstacle Avoidance With Experience-Shared A2c

An evolutionary multi-agent reinforcement learning algorithm for multi-UAV air combat

Multi-UAV Collaborative Search and Strike based on Reinforcement Learning

A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning

Multi-robot Cooperative Navigation Method based on Multi-agent Reinforcement Learning in Sparse Reward Tasks

Multi-UAV Cooperative Search in Multi-Layered Aerial Computing Networks: A Multi-Agent Deep Reinforcement Learning Approach