Abstract:Intelligence agents and multi-agent systems play important roles in scenes like the control system of grouped drones, and multi-agent navigation and obstacle avoidance which is the foundational function of advanced application has great importance. In multi-agent navigation and obstacle avoidance tasks, the decision-making interactions and dynamic changes of agents are difficult for traditional route planning algorithms or reinforcement learning algorithms with the increased complexity of the environment. The classical multi-agent reinforcement learning algorithm, Multi-agent deep deterministic policy gradient(MADDPG), solved precedent algorithms' problems of having unstationary training process and unable to deal with environment randomness. However, MADDPG ignored the temporal message hidden beneath agents' interaction with the environment. Besides, due to its CTDE technique which let each agent's critic network to calculate over all agents' action and the whole environment information, it lacks ability to scale to larger amount of agents. To deal with MADDPG's ignorance of the temporal information of the data, this article proposes a new algorithm called MADDPG-LSTMactor, which combines MADDPG with Long short term memory (LSTM). By using agent's observations of continuous timesteps as the input of its policy network, it allows the LSTM layer to process the hidden temporal message. Experimental result demonstrated that this algorithm had better performance in scenarios where the amount of agents is small. Besides, to solve MADDPG's drawback of not being efficient in scenarios where agents are too many, this article puts forward a light-weight MADDPG (MADDPG-L) algorithm, which simplifies the input of critic network. The result of experiments showed that this algorithm had better performance than MADDPG when the amount of agents was large.

Multiagent Motion Planning Based on Deep Reinforcement Learning in Complex Environments

ME‐MADDPG: An efficient learning‐based motion planning method for multiple agents in complex environments

Multi-UAV Path Planning Based on Potential Field Dense Reward in Unknown Environments with Static and Dynamic Obstacles

Multi-agent Motion Planning for Dense and Dynamic Environments via Deep Reinforcement Learning

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

An Improved Method towards Multi-UAV Autonomous Navigation Using Deep Reinforcement Learning

Multi-Agent Path Planning based on MPC and DDPG

Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning

Research on Game-Playing Agents Based on Deep Reinforcement Learning.

Multi-Agent Path Planning Method Based on Improved Deep Q-Network in Dynamic Environments

Multi-agent collaborative path planning algorithm with reinforcement learning and combined prioritized experience replay in Internet of Things

Research on Multi-Agent Task Allocation and Path Planning Based on Pri-MADDPG

Game-theoretic multi-agent motion planning in a mixed environment

Model-free Motion Planning of Autonomous Agents for Complex Tasks in Partially Observable Environments

Multi-Agent Path Planning Using Deep Reinforcement Learning

Scalable and Safe Multi-Agent Motion Planning with Nonlinear Dynamics and Bounded Disturbances

The Design and Realization of Multi-agent Obstacle Avoidance based on Reinforcement Learning

Model-free reinforcement learning for motion planning of autonomous agents with complex tasks in partially observable environments

Multi-Robot Coverage Path Planning Based on Deep Reinforcement Learning.

Mapless Path Planning of Multi-robot Systems in Complex Environments Via Deep Reinforcement Learning

Decentralized Motion Planning for Multi-Robot Navigation using Deep Reinforcement Learning