Abstract:Humans do not learn everything from the scratch but can connect and associate the upcoming information with the exchanged experience and known knowledge. Such an idea can be extended to cooperated multi-reinforcement learning and has achieved its success on homogeneous agents by means of parameter sharing. However, it is difficult to straightforwardly apply parameter sharing when dealing with heterogeneous agents thanks to their individual forms of input/output and their diverse functions and targets. Neuroscience has provided evidence that our brain creates several levels of experience and knowledge-sharing mechanisms that not only exchange similar experiences but also allow for sharing of abstract concepts to handle unfamiliar situations that others have already encountered. Inspired by such a brain's functions, we propose a semi-independent training policy method that can well tackle the conflict between parameter sharing and specialized training for heterogeneous agents. It employs a shared common representation for both observation and action, enabling the integration of various input and output sources. Additionally, a shared latent space is utilized to maintain a balanced relationship between the upstream policy and downstream functions, benefiting each individual agent's target. From the experiments, it can approve that our proposed method outperforms the current mainstream algorithms, especially when handling heterogeneous agents. Empirically, our proposed method can also be improved as a more general and fundamental heterogeneous agents' reinforcement learning structure for curriculum learning and representation transfer. All our code is open and released on https://gitlab.com/reinforcement/ntype.

Trustable Policy Collaboration Scheme for Multi-Agent Stigmergic Reinforcement Learning.

Stigmergic Independent Reinforcement Learning for Multi-Agent Collaboration

Individual Reward Assisted Multi-Agent Reinforcement Learning.

Communication-Efficient Soft Actor-Critic Policy Collaboration via Regulated Segment Mixture

Off-Agent Trust Region Policy Optimization

Trust Region Policy Optimisation in Multi-Agent Reinforcement Learning

Mutual-Information Regularized Multi-Agent Policy Iteration.

Autonomous Intersection Management with Heterogeneous Vehicles: A Multi-Agent Reinforcement Learning Approach

A Semi-Independent Policies Training Method with Shared Representation for Heterogeneous Multi-Agents Reinforcement Learning.

Trust-based Consensus in Multi-Agent Reinforcement Learning Systems

A Game-Theoretic Approach to Multi-agent Trust Region Optimization.

Mix Q-learning for Lane Changing: A Collaborative Decision-Making Method in Multi-Agent Deep Reinforcement Learning

Robust Multi-Agent Reinforcement Learning by Mutual Information Regularization

Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learning

Stabilizing Multi-Agent Deep Reinforcement Learning by Implicitly Estimating Other Agents’ Behaviors

Attention Enhanced Reinforcement Learning for Multi agent Cooperation

Mixed Reinforcement Learning with Additive Stochastic Uncertainty

Inducing Cooperation via Team Regret Minimization based Multi-Agent Deep Reinforcement Learning

Heterogeneous-Agent Reinforcement Learning

Prioritized League Reinforcement Learning for Large-Scale Heterogeneous Multiagent Systems

Multi-Agent Reinforcement Learning-Based Decision Making for Twin-Vehicles Cooperative Driving in Stochastic Dynamic Highway Environments