Abstract:Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the challenges of exploration and dimensionality explosion. Hierarchical reinforcement learning (HRL) offers a structured approach to decompose complex tasks into simpler sub-tasks, which is promising for multi-agent settings. This paper advances the field by introducing a hierarchical architecture that autonomously generates effective subgoals without explicit constraints, enhancing both flexibility and stability in training. We propose a dynamic goal generation strategy that adapts based on environmental changes. This method significantly improves the adaptability and sample efficiency of the learning process. Furthermore, we address the critical issue of credit assignment in multi-agent systems by synergizing our hierarchical architecture with a modified QMIX network, thus improving overall strategy coordination and efficiency. Comparative experiments with mainstream reinforcement learning algorithms demonstrate the superior convergence speed and performance of our approach in both single-agent and multi-agent environments, confirming its effectiveness and flexibility in complex scenarios. Our code is open-sourced at: \url{<a class="link-external link-https" href="https://github.com/SICC-Group/GMAH" rel="external noopener nofollow">this https URL</a>}.

Hierarchical Learning for Emergence of Social Norms in Networked Multiagent Systems.

Hierarchical Heuristic Learning towards Effcient Norm Emergence

Learning Intra-group Cooperation in Multi-agent Systems.

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Adaptive Network Intervention for Complex Systems: A Hierarchical Graph Reinforcement Learning Approach

A Hierarchical Framework with Spatio-Temporal Consistency Learning for Emergence Detection in Complex Adaptive Systems

A learning agent that acquires social norms from public sanctions in decentralized multi-agent settings

Prosocial Norm Emergence in Multiagent Systems

Emergent Dominance Hierarchies in Reinforcement Learning Agents

Feudal Multi-Agent Hierarchies for Cooperative Reinforcement Learning

Emergent Social Learning via Multi-agent Reinforcement Learning

Hierarchical Reinforcement Learning with Opponent Modeling for Distributed Multi-agent Cooperation

Deep Hierarchical Communication Graph in Multi-Agent Reinforcement Learning.

Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning

Subgoal-based Hierarchical Reinforcement Learning for Multi-Agent Collaboration

Norm Enforcement with a Soft Touch: Faster Emergence, Happier Agents

Learning to Share in Multi-Agent Reinforcement Learning

Networked Multi-Agent Reinforcement Learning with Emergent Communication

Soft-HGRNs: Soft Hierarchical Graph Recurrent Networks for Multi-Agent Partially Observable Environments

Noe: Norms Emergence and Robustness Based on Emotions in Multiagent Systems