Abstract:Abstract Multi-agent multi-target search strategies can be utilized in complex scenarios such as post-disaster search and rescue by unmanned aerial vehicles. To solve the problem of fixed target and trajectory, the current multi-agent multi-target search strategies are mainly based on deep reinforcement learning (DRL). However, the training of agents by the DRL tend to be brittle due to their sensitivity to the training environment, which makes the strategies learned by the agents fall into local optima frequently, resulting in poor system robustness. Additionally, sparse rewards in DRL will lead to the problems such as difficulty in system convergence and low utilization efficiency of the sampled data. To address the problem that the robustness of the agents is weakened and the sparse rewards exist in the multi-objective search environment, we propose a MiniMax Multi-agent Deep Deterministic Policy Gradient based on the Parallel Hindsight Experience Replay (PHER-M3DDPG) algorithm, which adopts the framework of centralized training and decentralized execution in continuous action space. To enhance the system robustness, the PHER-M3DDPG algorithm employs a minimax learning architecture, which adaptively adjusts the learning strategy of agents by involving adversarial disturbances. In addition, to solve the sparse rewards problem, the PHER-M3DDPG algorithm adopts a parallel hindsight experience replay mechanism to increase the efficiency of data utilization by involving virtual learning targets and batch processing of the sampled data. Simulation results show that the PHER-M3DDPG algorithm outperforms the existing algorithms in terms of convergence speed and the task completion time in a multi-target search environment.

Enabling Inter-Agent Transfer for Multi-Agent Learning System by Incorporating Role Reversal

The Multi-Agent System Based on Reinforcement Learning

Learning to Transfer Role Assignment Across Team Sizes

Parallel Knowledge Transfer in Multi-Agent Reinforcement Learning

Multi-Agent Policy Transfer Via Task Relationship Modeling.

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

Enabling Multi-Agent Transfer Reinforcement Learning via Scenario Independent Representation

Improved Reinforcement Learning in Cooperative Multi-agent Environments Using Knowledge Transfer

Value Function Transfer for Deep Multi-Agent Reinforcement Learning Based on N-Step Returns.

A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems

A Platform-Agnostic Deep Reinforcement Learning Framework for Effective Sim2Real Transfer towards Autonomous Driving

Selective Policy Transfer in Multi-Agent Systems with Sparse Interactions

Stabilizing Multi-Agent Deep Reinforcement Learning by Implicitly Estimating Other Agents’ Behaviors

Role Play: Learning Adaptive Role-Specific Strategies in Multi-Agent Interactions

Intention Propagation for Multi-agent Reinforcement Learning

Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning

Enabling Multi-Robot Collaboration from Single-Human Guidance

Off-Agent Trust Region Policy Optimization

UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformers

Multi-agent cooperation through learning-aware policy gradients

Multi-Agent Transfer Learning via Temporal Contrastive Learning