Abstract:Intelligence agents and multi-agent systems play important roles in scenes like the control system of grouped drones, and multi-agent navigation and obstacle avoidance which is the foundational function of advanced application has great importance. In multi-agent navigation and obstacle avoidance tasks, the decision-making interactions and dynamic changes of agents are difficult for traditional route planning algorithms or reinforcement learning algorithms with the increased complexity of the environment. The classical multi-agent reinforcement learning algorithm, Multi-agent deep deterministic policy gradient(MADDPG), solved precedent algorithms' problems of having unstationary training process and unable to deal with environment randomness. However, MADDPG ignored the temporal message hidden beneath agents' interaction with the environment. Besides, due to its CTDE technique which let each agent's critic network to calculate over all agents' action and the whole environment information, it lacks ability to scale to larger amount of agents. To deal with MADDPG's ignorance of the temporal information of the data, this article proposes a new algorithm called MADDPG-LSTMactor, which combines MADDPG with Long short term memory (LSTM). By using agent's observations of continuous timesteps as the input of its policy network, it allows the LSTM layer to process the hidden temporal message. Experimental result demonstrated that this algorithm had better performance in scenarios where the amount of agents is small. Besides, to solve MADDPG's drawback of not being efficient in scenarios where agents are too many, this article puts forward a light-weight MADDPG (MADDPG-L) algorithm, which simplifies the input of critic network. The result of experiments showed that this algorithm had better performance than MADDPG when the amount of agents was large.

Switching-aware multi-agent deep reinforcement learning for target interception

MARNet: Backdoor Attacks Against Cooperative Multi-Agent Reinforcement Learning

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

Reinforcement Learning-Based MAS Interception in Antagonistic Environments

Learning to Switch Among Agents in a Team via 2-Layer Markov Decision Processes

The Design and Realization of Multi-agent Obstacle Avoidance based on Reinforcement Learning

Eavesdropping Game Based on Multi-Agent Deep Reinforcement Learning

Improving anti-jamming decision-making strategies for cognitive radar via multi-agent deep reinforcement learning

A Proactive Eavesdropping Game in MIMO Systems Based on Multiagent Deep Reinforcement Learning

Safe Multi-Agent Reinforcement Learning for Wireless Applications Against Adversarial Communications

Adversarial Decision-Making for Moving Target Defense: A Multi-Agent Markov Game and Reinforcement Learning Approach

A Deep Reinforcement Learning-Based Method Applied for Solving Multi-Agent Defense and Attack Problems.

Multi-Agent Reinforcement Learning for Wireless Networks Against Adversarial Communications

Multi-UAV Cooperative Maneuver Decision-Making for Pursuit-Evasion Using Improved MADRL

Decoys Deployment for Missile Interception: A Multi-Agent Reinforcement Learning Approach

General multi-agent reinforcement learning integrating adaptive manoeuvre strategy for real-time multi-aircraft conflict resolution

Multi-robot Target Encirclement Control with Collision Avoidance via Deep Reinforcement Learning

Game of Drones: Intelligent Online Decision Making of Multi-UAV Confrontation

UAV Multi-Dynamic Target Interception: A Hybrid Intelligent Method Using Deep Reinforcement Learning and Fuzzy Logic

Autonomous Air Traffic Controller: A Deep Multi-Agent Reinforcement Learning Approach

Intercept Strategy for Maneuvering Target Based on Deep Reinforcement Learning