Abstract:Measurement and Control, Ahead of Print. Multi-UAVs play an important role in the battlefield. Although many methods are proposed to solve the Multi-UAV task allocation, there still existing the problems of complex time constraints and uncertain solution space. The reason is that multi-UAVs usually face changing environmental factors. Aiming at solving such problem, this paper proposes a multi-UAV task assignment method based on Deep Q-based evolutionary reinforcement learning algorithms (MPSO-SA-DQN). Specifically, this method builds a multi-agent training framework based on the deep evolutionary reinforcement learning mechanism and SA-DQN. Its aim is to improve the global exploration and optimization capabilities of multi-agents. At the same time, the multi-dimensional particle swarm optimization algorithm is introduced to optimize the state space. Based on task priority mapping, the MPSO-SA-DQN algorithm framework is proposed. As a result, multi-agents can optimize the execution state in real time in the environment interaction. Besides, it also has the ability to reach optimal state and maximum reward. According to the characteristics of multi-UAV global task assignment, this paper designs a priority state space autoencoder strategy and global task feature. A multi-UAVs tasks allocation and iterative optimization method based on MPSO-SA-DQN algorithm is proposed, so as to continuously optimize the task allocation scheme. The simulation results show that the multi-UAV task allocation method based on MPSO-SA-DQN can effectively solve the problem of uncertainty in the optimal solution space of task allocation. At the same time, the algorithm achieves faster convergence result, and a good prospect of promotion in the field of UAV swarm cooperative task planning.

Data-Driven Cooperative Multi-Task Assignment in Heterogeneous Multi-Agent Pursuit-Evade Game

Task Assignment with Minimum Cost for Multi-UAV System via Reinforcement Learning<sup>*</sup>

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Pursuit-Evasion Games for Multi-agent Based on Reinforcement Learning with Obstacles

Cooperatively Pursuing a Target Unmanned Aerial Vehicle by Multiple Unmanned Aerial Vehicles Based on Multiagent Reinforcement Learning

Dynamic Task Assignment of Multiple Heterogeneous Unmanned Aerial Vehicles Based on Consensus with Uncertainties

Task Allocation and Trajectory Planning for Collaborative Adversarial Multi-UAVsystems

Learning-based Airborne Sensor Task Assignment in Unknown Dynamic Environments

Cooperative Task Assignment for Heterogeneous Multi-UAVs Based on Improved Genetic Algorithm

Pursuer Assignment and Control Strategies in Multi-agent Pursuit-Evasion Under Uncertainties

Cooperative task assignment algorithm of manned/unmanned aerial vehicle in uncertain environment

Multi-Agent Cooperative-Competitive Environment with Reinforcement Learning

Autonomous Decision Making for UAV Cooperative Pursuit-Evasion Game with Reinforcement Learning

A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning

Distributed Task Allocation with Minimum Makespan for Heterogeneous Multiplayer Pursuit-Evasion Games

Task Assignment in Multi-Agent Games Via Reinforcement Learning and Expert Knowledge

Multi-UAVs task allocation method based on MPSO-SA-DQN

Pursuit and evasion game between UVAs based on multi-agent reinforcement learning

Collaborative Pursuit-Evasion Strategy of UAV/UGV Heterogeneous System in Complex Three-Dimensional Polygonal Environment

Multi-Target Pursuit by a Decentralized Heterogeneous UAV Swarm using Deep Multi-Agent Reinforcement Learning

Cooperative Pursuit with Multiple Pursuers based on Deep Minimax Q-learning