Abstract:Abstract Multi-agent multi-target search strategies can be utilized in complex scenarios such as post-disaster search and rescue by unmanned aerial vehicles. To solve the problem of fixed target and trajectory, the current multi-agent multi-target search strategies are mainly based on deep reinforcement learning (DRL). However, the training of agents by the DRL tend to be brittle due to their sensitivity to the training environment, which makes the strategies learned by the agents fall into local optima frequently, resulting in poor system robustness. Additionally, sparse rewards in DRL will lead to the problems such as difficulty in system convergence and low utilization efficiency of the sampled data. To address the problem that the robustness of the agents is weakened and the sparse rewards exist in the multi-objective search environment, we propose a MiniMax Multi-agent Deep Deterministic Policy Gradient based on the Parallel Hindsight Experience Replay (PHER-M3DDPG) algorithm, which adopts the framework of centralized training and decentralized execution in continuous action space. To enhance the system robustness, the PHER-M3DDPG algorithm employs a minimax learning architecture, which adaptively adjusts the learning strategy of agents by involving adversarial disturbances. In addition, to solve the sparse rewards problem, the PHER-M3DDPG algorithm adopts a parallel hindsight experience replay mechanism to increase the efficiency of data utilization by involving virtual learning targets and batch processing of the sampled data. Simulation results show that the PHER-M3DDPG algorithm outperforms the existing algorithms in terms of convergence speed and the task completion time in a multi-target search environment.

Multi-agent Collaborative Target Search Based on Curiosity Intrinsic Motivation

Multi-Agent Collaborative Target Search Based on the Multi-Agent Deep Deterministic Policy Gradient with Emotional Intrinsic Motivation

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

CMBE: Curiosity-driven Model-Based Exploration for Multi-Agent Reinforcement Learning in Sparse Reward Settings

CIExplore: Curiosity and Influence-based Exploration in Multi-Agent Cooperative Scenarios with Sparse Rewards

Multi-robot Cooperative Navigation Method based on Multi-agent Reinforcement Learning in Sparse Reward Tasks

Curiosity-driven Exploration in Sparse-reward Multi-agent Reinforcement Learning

Curiosity Driven Collaborative Reconnaissance of Multiple Unmanned Aerial Vehicles

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

Dueling Network Architecture for Multi-Agent Deep Deterministic Policy Gradient

Attention-based Curiosity-driven Exploration in Deep Reinforcement Learning

Episodic Multi-agent Reinforcement Learning with Curiosity-driven Exploration

A Dynamically Adaptive Approach to Reducing Strategic Interference for Multi-agent Systems

Research on Target Detection Method Based on Attention Mechanism and Reinforcement Learning

Multi-Agent Reinforcement Learning Via Directed Exploration Method

Neighborhood Curiosity-Based Exploration in Multi-Agent Reinforcement Learning

A unified strategy for implementing curiosity and empowerment driven reinforcement learning

Multi-agent Reinforcement Learning Algorithm Based on Local Information

Dynamic Memory-Based Curiosity: A Bootstrap Approach for Exploration in Reinforcement Learning

Enhancing Curiosity-driven Reinforcement Learning Through Historical State Information for Long-term Exploration

A Fuzzy Curiosity-Driven Mechanism for Multi-Agent Reinforcement Learning.