Abstract:With the ongoing integration of distributed energy resources, modern distribution systems are getting sufficient generation capacity to perform active restoration after outages without transmission system support. The model-based approaches are widely used in resolving service restoration problems, relying on accurate system models. Deep reinforcement learning is believed as an alternative solution for problem solving, although it has not been sufficiently explored. In this paper, the service restoration process is described as a partially observable Markov decision process, and a multi-agent graph reinforcement learning approach based on attention is proposed to train multiple agents to co-achieve the restoration goal to reinforce the system resilience in coping with extreme events. To consider the connections and correlations between nodes during the service restoration, the state of the active distribution network is defined by graph data that contains features of both topology and nodes. The perceived ability of the agents is empowered by graph convolutional networks during the feature extraction, supplying agents with more comprehensive data to learn more reasonable restoration strategies. In addition, the centralized training with attention is developed for multi-agent systems, focusing on the relations between the agents to strengthen teamwork capability. The performance of the proposed method is verified by a set of comparative studies on the IEEE-118 system with dispatchable generators, rooftop photovoltaics, and energy storage systems simultaneously.

Multi-agent Deep Reinforcement Learning for Distributed Load Restoration

A Multi-Agent Reinforcement Learning Method for Distribution System Restoration Considering Dynamic Network Reconfiguration

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Multi-Agent Reinforcement Learning-based Distributed Economic Dispatch Considering Network attacks and Uncertain Costs

A Consensus-based Decentralized Algorithm for Service Restoration in Active Distribution Networks

Multi-Agent Reinforcement Learning for Distribution System Critical Load Restoration

Deep Reinforcement Learning for Distribution System Restoration Using Distributed Energy Resources and Tie-Switches

A multiagent system based optimal load restoration strategy in distribution systems

Novel Multiagent Based Load Restoration Algorithm for Microgrids

Attention-Based Multi-Agent Graph Reinforcement Learning for Service Restoration

Robustness Assessment and Enhancement of Deep Reinforcement Learning-Enabled Load Restoration for Distribution Systems.

AC/DC hybrid distribution network reconfiguration with microgrid formation using multi-agent soft actor-critic

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

A Novel Load Transfer Method for Distribution Systems Based on Reinforcement Learning

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

A Fully Decentralized Multi-Agent System for Intelligent Restoration of Power Distribution Network Incorporating Distributed Generations [Application Notes]

A Multi-Agent Approach to Fault Restoration in High Voltage Distribution Networks

A Multi-Agent-Based Rolling Optimization Method for Restoration Scheduling of Electrical Distribution Systems with Distributed Generation

Multi-agent-based Rolling Optimization Method for Restoration Scheduling of Distribution Systems with Distributed Generation

Real-time outage management in active distribution networks using reinforcement learning over graphs