Abstract:Abstract Multi-agent multi-target search strategies can be utilized in complex scenarios such as post-disaster search and rescue by unmanned aerial vehicles. To solve the problem of fixed target and trajectory, the current multi-agent multi-target search strategies are mainly based on deep reinforcement learning (DRL). However, the training of agents by the DRL tend to be brittle due to their sensitivity to the training environment, which makes the strategies learned by the agents fall into local optima frequently, resulting in poor system robustness. Additionally, sparse rewards in DRL will lead to the problems such as difficulty in system convergence and low utilization efficiency of the sampled data. To address the problem that the robustness of the agents is weakened and the sparse rewards exist in the multi-objective search environment, we propose a MiniMax Multi-agent Deep Deterministic Policy Gradient based on the Parallel Hindsight Experience Replay (PHER-M3DDPG) algorithm, which adopts the framework of centralized training and decentralized execution in continuous action space. To enhance the system robustness, the PHER-M3DDPG algorithm employs a minimax learning architecture, which adaptively adjusts the learning strategy of agents by involving adversarial disturbances. In addition, to solve the sparse rewards problem, the PHER-M3DDPG algorithm adopts a parallel hindsight experience replay mechanism to increase the efficiency of data utilization by involving virtual learning targets and batch processing of the sampled data. Simulation results show that the PHER-M3DDPG algorithm outperforms the existing algorithms in terms of convergence speed and the task completion time in a multi-target search environment.

Cooperative Strategy Learning in Multi-Agent Environment with Continuous State Space

Adaptive algorithm for multi-agent learning optimal cooperative pursuit strategy based on Markov game

Towards a cooperative soccer team in RoboCup

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Learning Intra-group Cooperation in Multi-agent Systems.

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

Fast reinforcement learning approach to cooperative behavior acquisition in multi-agent system

A multiagent reinforcement learning approach based on different states

SCC-rFMQ Learning in Cooperative Markov Games with Continuous Actions

Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning

Cooperative Behavior Acquisition Based Modular Q Learning in Multi-Agent System

Cooperation of robot team based on reinforcement learning

A Deep Reinforcement Learning-Based Method Applied for Solving Multi-Agent Defense and Attack Problems.

A new multi-agent reinforcement learning approach

Learning RoboCup-Keepaway with Kernels

Deep Reinforcement Learning in Parameterized Action Space

MARLadona -- Towards Cooperative Team Play Using Multi-Agent Reinforcement Learning

Multiagent Reinforcement Learning for Strategic Decision Making and Control in Robotic Soccer Through Self-Play

SCC-rFMQ: a Multiagent Reinforcement Learning Method in Cooperative Markov Games with Continuous Actions

Self-attention-based multi-agent continuous control method in cooperative environments

Study and application of reinforcement learning based on DAI in cooperative strategy of robot soccer