Abstract:Intelligence agents and multi-agent systems play important roles in scenes like the control system of grouped drones, and multi-agent navigation and obstacle avoidance which is the foundational function of advanced application has great importance. In multi-agent navigation and obstacle avoidance tasks, the decision-making interactions and dynamic changes of agents are difficult for traditional route planning algorithms or reinforcement learning algorithms with the increased complexity of the environment. The classical multi-agent reinforcement learning algorithm, Multi-agent deep deterministic policy gradient(MADDPG), solved precedent algorithms' problems of having unstationary training process and unable to deal with environment randomness. However, MADDPG ignored the temporal message hidden beneath agents' interaction with the environment. Besides, due to its CTDE technique which let each agent's critic network to calculate over all agents' action and the whole environment information, it lacks ability to scale to larger amount of agents. To deal with MADDPG's ignorance of the temporal information of the data, this article proposes a new algorithm called MADDPG-LSTMactor, which combines MADDPG with Long short term memory (LSTM). By using agent's observations of continuous timesteps as the input of its policy network, it allows the LSTM layer to process the hidden temporal message. Experimental result demonstrated that this algorithm had better performance in scenarios where the amount of agents is small. Besides, to solve MADDPG's drawback of not being efficient in scenarios where agents are too many, this article puts forward a light-weight MADDPG (MADDPG-L) algorithm, which simplifies the input of critic network. The result of experiments showed that this algorithm had better performance than MADDPG when the amount of agents was large.

Research on Collision-free Control and Simulation of Single-Agent Based on An Improved DDPG Algorithm

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Pursuit-Evasion Games for Multi-agent Based on Reinforcement Learning with Obstacles

An Improved Approach Towards Multi-Agent Pursuit–Evasion Game Decision-Making Using Deep Reinforcement Learning

Toward Obstacle Avoidance for Mobile Robots Using Deep Reinforcement Learning Algorithm

Improved Deep Deterministic Policy Gradient for Dynamic Obstacle Avoidance of Mobile Robot

The Design and Realization of Multi-agent Obstacle Avoidance based on Reinforcement Learning

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Multi-Agent Path Planning based on MPC and DDPG

A Dynamically Adaptive Approach to Reducing Strategic Interference for Multi-agent Systems

Research on Game-Playing Agents Based on Deep Reinforcement Learning.

Path Planning Algorithm in Complex Environment Based on DDPG and MPC

SLP-Improved DDPG Path-Planning Algorithm for Mobile Robot in Large-Scale Dynamic Environment

Bidirectional Obstacle Avoidance Enhancement‐Deep Deterministic Policy Gradient: A Novel Algorithm for Mobile‐Robot Path Planning in Unknown Dynamic Environments

Design and Field Test of Collision Avoidance Method with Prediction for USVs: A Deep Deterministic Policy Gradient Approach

AUV Collision Avoidance Planning Method Based on Deep Deterministic Policy Gradient

Obstacle Avoidance Algorithm for Mobile Robot Based on Deep Reinforcement Learning in Dynamic Environments.

Accelerated Sim-to-Real Deep Reinforcement Learning: Learning Collision Avoidance from Human Player

Obstacle Avoidance in Multi-Agent Formation Process Based on Deep Reinforcement Learning

Path-Tracking Control Strategy of Unmanned Vehicle Based on DDPG Algorithm

Modeling Interactions of Autonomous/Manual Vehicles and Pedestrians with a Multi-Agent Deep Deterministic Policy Gradient