Abstract:Multi-Agent Reinforcement Learning (MARL) is widely used to solve various real-world prob-lems. In MARL, the environment contains multiple agents. A good grasp of the environment can guide agents to learn cooperative strategies. In Centralized Training Decentralized Execution (CTDE), a centralized critic is used to guide cooperative strategies learning. However, having mul-tiple agents in the environment leads to the curse of dimensionality and influence of other agents' strategies, resulting in difficulties for centralized critics to learn good cooperative strategies. We propose a graph-based approach to overcome the above problems. It uses a graph neural network, which uses partial observations of agents as input, and information between agents is aggregated by graph methods to extract information about the whole environment. In this way, agents can improve their understanding of the overall state of the environment and other agents in the environ-ment while avoiding dimensional explosion. Then we combine a dual critic dynamic decomposition method with soft actor-critic to train policy. The former uses individual and global rewards for learning, avoiding the influence of other agents' strategies, and the latter help to learn an optional policy better. We call this approach Multi-Agent Graph-based soft Actor-Critic (MAGAC). We compare our proposed method with several classical MARL algorithms under the Multi-agent Par-ticle Environment (MPE). The experimental results show that our method can achieve a faster learning speed while learning better policy.

Scalable Multi-Agent Reinforcement Learning for Residential Load Scheduling under Data Governance

Cooperative Multi-Agent Actor-Critic for Privacy-Preserving Load Scheduling in a Residential Microgrid

Multiagent Reinforcement Learning for Strictly Constrained Tasks Based on Reward Recorder

Multi-Agent Reinforcement Learning for Network Load Balancing in Data Center

Multi-Agent Reinforcement Learning for Wireless User Scheduling: Performance, Scalablility, and Generalization

A Graph-Based Soft Actor Critic Approach in Multi-Agent Reinforcement Learning

Multi-Agent Reinforcement Learning Approach for Residential Microgrid Energy Scheduling

Privacy-Preserving Load Scheduling in Residential Microgrids Using Multi-Agent Reinforcement Learning

Scalable Multi-agent Reinforcement Learning for Factory-wide Dynamic Scheduling

A Scalable Network-Aware Multi-Agent Reinforcement Learning Framework for Decentralized Inverter-based Voltage Control

Large-scale Machine Learning Cluster Scheduling via Multi-agent Graph Reinforcement Learning

On Efficient Multi-Agent Reinforcement Learning for Large Scale Supply Demand Matching

Scalable Multi-Agent Reinforcement Learning for Networked Systems with Average Reward

A Meta-Learning Approach for Multi-Objective Reinforcement Learning in Sustainable Home Environments

Scalability Bottlenecks in Multi-Agent Reinforcement Learning Systems

Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A Multi-Agent Reinforcement Learning Approach

Demand-Side Scheduling Based on Multi-Agent Deep Actor-Critic Learning for Smart Grids

Distributed Cooperative Multi-Agent Reinforcement Learning with Directed Coordination Graph

Decentralized Multi-agent Reinforcement Learning with Multi-time Scale of Decision Epochs

MARL-iDR: Multi-Agent Reinforcement Learning for Incentive-based Residential Demand Response

Multi-Agent Reinforcement Learning in Stochastic Networked Systems.