Abstract:Extreme events are greatly impacting the normal operations of microgrids, which can lead to severe outages and affect the continuous supply of energy to customers, incurring substantial restoration costs. Repair crews (RCs) are regarded as crucial resources to provide system resilience owing to their mobility and flexibility characteristics in handling both transportation and energy systems. Nevertheless, effectively coordinating the dispatch of RCs towards system resilience is a complex decision-making problem, especially in the context of a multi-energy microgrid (MEMG) with enormous dynamics and uncertainties. To this end, this paper formulates the dispatch problem of RCs in a coupled transportation and power-gas network as a decentralized partially observable Markov decision process (Dec-POMDP). To solve this Dec-POMDP, a hierarchical multi-agent reinforcement learning (MARL) algorithm is proposed by featuring a two-level framework, where the high-level action is used for switching decision-making between transportation and power-gas networks, and the lower-level action constructed via the multi-agent proximal policy optimization (MAPPO) algorithm is used to compute the routing and repairing decisions of RCs in the transportation and power-gas networks, respectively. The proposed algorithm also introduces an abstracted critic network by integrating the load restoration status, which captures the system dynamics and stabilizes the training performance with privacy protection. Extensive case studies are evaluated on a coupled 6-bus power and 6-bus gas network integrated with a 9-node 12-edge transportation network. The proposed algorithm outperforms the conventional MARL algorithms in terms of policy quality, learning stability, and computational performance. Furthermore, the dispatch strategies of RCs are analyzed and their corresponding benefits for load restoration are also evaluated. Finally, the scalability of the proposed method is also investigated for a larger 33-bus power and 15-bus gas network integrated with an 18-node 27-edge transportation network.

Distributed Online Dispatch for Microgrids Using Hierarchical Reinforcement Learning Embedded with Operation Knowledge

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Multi-Agent Reinforcement Learning-based Distributed Economic Dispatch Considering Network attacks and Uncertain Costs

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Dynamic Energy Dispatch Based on Deep Reinforcement Learning in IoT-Driven Smart Isolated Microgrids

Submucosal Dermoid Cyst of The Rectum in an Adult Female (a case report)

Optimal Scheduling in IoT-Driven Smart Isolated Microgrids Based on Deep Reinforcement Learning

Offline economic dispatch for multi-area power system via hierarchical reinforcement learning

Microgrid Energy Management Using Improved Reinforcement Learning with Quadratic Programming

Consensus Based Distributed Reinforcement Learning For Nonconvex Economic Power Dispatch In Microgrids

Multi-Objective Interval Optimization Dispatch of Microgrid Via Deep Reinforcement Learning

Hierarchical multi-agent reinforcement learning for repair crews dispatch control towards multi-energy microgrid resilience

Hierarchical deep reinforcement learning for self-adaptive economic dispatch

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

Physical Informed-Inspired Deep Reinforcement Learning Based Bi-Level Programming for Microgrid Scheduling

A Deep Reinforcement Learning Method for Economic Power Dispatch of Microgrid in OPAL-RT Environment

A Distributed Learning-Based Economic Dispatch Approach of Microgrids Considering Operational Mode Switch

Distributed Deep Reinforcement Learning for Renewable Energy Accommodation Assessment With Communication Uncertainty in Internet of Energy

Distributed Multiagent Reinforcement Learning With Action Networks for Dynamic Economic Dispatch

Dueling Double Q-learning Based Real-time Energy Dispatch in Grid-connected Microgrids

Double Deep Q-learning Based Real-Time Optimization Strategy for Microgrids