Abstract:Intelligence agents and multi-agent systems play important roles in scenes like the control system of grouped drones, and multi-agent navigation and obstacle avoidance which is the foundational function of advanced application has great importance. In multi-agent navigation and obstacle avoidance tasks, the decision-making interactions and dynamic changes of agents are difficult for traditional route planning algorithms or reinforcement learning algorithms with the increased complexity of the environment. The classical multi-agent reinforcement learning algorithm, Multi-agent deep deterministic policy gradient(MADDPG), solved precedent algorithms' problems of having unstationary training process and unable to deal with environment randomness. However, MADDPG ignored the temporal message hidden beneath agents' interaction with the environment. Besides, due to its CTDE technique which let each agent's critic network to calculate over all agents' action and the whole environment information, it lacks ability to scale to larger amount of agents. To deal with MADDPG's ignorance of the temporal information of the data, this article proposes a new algorithm called MADDPG-LSTMactor, which combines MADDPG with Long short term memory (LSTM). By using agent's observations of continuous timesteps as the input of its policy network, it allows the LSTM layer to process the hidden temporal message. Experimental result demonstrated that this algorithm had better performance in scenarios where the amount of agents is small. Besides, to solve MADDPG's drawback of not being efficient in scenarios where agents are too many, this article puts forward a light-weight MADDPG (MADDPG-L) algorithm, which simplifies the input of critic network. The result of experiments showed that this algorithm had better performance than MADDPG when the amount of agents was large.

A Multi-Agent Reinforcement Learning Algorithm Based on Stackelberg Game

Learning Intra-group Cooperation in Multi-agent Systems.

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

A Two-Layered Multi-Agent Reinforcement Learning Model and Algorithm

Stackelberg Meta-Learning Based Control for Guided Cooperative LQG Systems

Balancing Performance and Cost for Two-Hop Cooperative Communications: Stackelberg Game and Distributed Multi-Agent Reinforcement Learning

Stackelberg Game-Theoretic Learning for Collaborative Assembly Task Planning

Multi-agent Q-Learning of Channel Selection in Multi-user Cognitive Radio Systems: A Two by Two Case

The Design and Realization of Multi-agent Obstacle Avoidance based on Reinforcement Learning

LMRL: a Multi-Agent Reinforcement Learning Model and Algorithm

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Bi-Level Actor-Critic for Multi-Agent Coordination.

Hierarchical Reinforcement Learning for Multi-agent MOBA Game

Inducing Stackelberg Equilibrium through Spatio-Temporal Sequential Decision-Making in Multi-Agent Reinforcement Learning

Evolutionary reinforcement learning algorithm for large-scale multi-agent cooperation and confrontation applications

A Collaborative Multi-Agent Reinforcement Learning Anti-Jamming Algorithm in Wireless Networks

Deep reinforcement learning algorithm based on multi-agent parallelism and its application in game environment

Robust Reinforcement Learning as a Stackelberg Game via Adaptively-Regularized Adversarial Training

Oracles & Followers: Stackelberg Equilibria in Deep Multi-Agent Reinforcement Learning