Abstract:Abstract Multi-agent multi-target search strategies can be utilized in complex scenarios such as post-disaster search and rescue by unmanned aerial vehicles. To solve the problem of fixed target and trajectory, the current multi-agent multi-target search strategies are mainly based on deep reinforcement learning (DRL). However, the training of agents by the DRL tend to be brittle due to their sensitivity to the training environment, which makes the strategies learned by the agents fall into local optima frequently, resulting in poor system robustness. Additionally, sparse rewards in DRL will lead to the problems such as difficulty in system convergence and low utilization efficiency of the sampled data. To address the problem that the robustness of the agents is weakened and the sparse rewards exist in the multi-objective search environment, we propose a MiniMax Multi-agent Deep Deterministic Policy Gradient based on the Parallel Hindsight Experience Replay (PHER-M3DDPG) algorithm, which adopts the framework of centralized training and decentralized execution in continuous action space. To enhance the system robustness, the PHER-M3DDPG algorithm employs a minimax learning architecture, which adaptively adjusts the learning strategy of agents by involving adversarial disturbances. In addition, to solve the sparse rewards problem, the PHER-M3DDPG algorithm adopts a parallel hindsight experience replay mechanism to increase the efficiency of data utilization by involving virtual learning targets and batch processing of the sampled data. Simulation results show that the PHER-M3DDPG algorithm outperforms the existing algorithms in terms of convergence speed and the task completion time in a multi-target search environment.

Real‐time receding horizon pursuit and evasion games of missile guidance based on neural network

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

Resilient Pursuit Evasion Guidance with Feedback Game Strategy

Closed-loop Deep Neural Network Optimal Control Algorithm and Error Analysis for Powered Landing under Uncertainties

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Nonlinear Optimal Guidance for Intercepting Stationary Targets with Impact-Time Constraints

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

Integrated missile guidance and control using optimization-based predictive control

A Model Predictive Stackelberg Solution to Orbital Pursuit-Evasion Game

Cooperative Path Following Control in Autonomous Vehicles Graphical Games: A Data-Based Off-Policy Learning Approach

Nonlinear Optimal Guidance for Cooperatively Imposing Relative Intercept Angles

Real‐time game‐theoretic model predictive control for differential game of target defense

Optimal avoidance strategy based on nonlinear approximate analytic solution of non-cooperative differential game

Cooperative guidance of multiple missiles: a hybrid co-evolutionary approach

Intelligent Pursuit–Evasion Game Based on Deep Reinforcement Learning for Hypersonic Vehicles

A hierarchical reinforcement learning method for missile evasion and guidance

Event-based optimal guidance laws design for missile-target interception systems using fuzzy dynamic programming approach

Parametrization Approach for Real-Time Generation of Minimum-Effort Trajectories via Neural Network

Autonomous Decision Making for UAV Cooperative Pursuit-Evasion Game with Reinforcement Learning

PRD-MADDPG: an Efficient Learning-Based Algorithm for Orbital Pursuit-Evasion Game with Impulsive Maneuvers

Cooperative interception guidance for multiple vehicles: A receding horizon optimization approach