Abstract:Extreme events are greatly impacting the normal operations of microgrids, which can lead to severe outages and affect the continuous supply of energy to customers, incurring substantial restoration costs. Repair crews (RCs) are regarded as crucial resources to provide system resilience owing to their mobility and flexibility characteristics in handling both transportation and energy systems. Nevertheless, effectively coordinating the dispatch of RCs towards system resilience is a complex decision-making problem, especially in the context of a multi-energy microgrid (MEMG) with enormous dynamics and uncertainties. To this end, this paper formulates the dispatch problem of RCs in a coupled transportation and power-gas network as a decentralized partially observable Markov decision process (Dec-POMDP). To solve this Dec-POMDP, a hierarchical multi-agent reinforcement learning (MARL) algorithm is proposed by featuring a two-level framework, where the high-level action is used for switching decision-making between transportation and power-gas networks, and the lower-level action constructed via the multi-agent proximal policy optimization (MAPPO) algorithm is used to compute the routing and repairing decisions of RCs in the transportation and power-gas networks, respectively. The proposed algorithm also introduces an abstracted critic network by integrating the load restoration status, which captures the system dynamics and stabilizes the training performance with privacy protection. Extensive case studies are evaluated on a coupled 6-bus power and 6-bus gas network integrated with a 9-node 12-edge transportation network. The proposed algorithm outperforms the conventional MARL algorithms in terms of policy quality, learning stability, and computational performance. Furthermore, the dispatch strategies of RCs are analyzed and their corresponding benefits for load restoration are also evaluated. Finally, the scalability of the proposed method is also investigated for a larger 33-bus power and 15-bus gas network integrated with an 18-node 27-edge transportation network.

Towards Microgrid Resilience Enhancement Via Mobile Power Sources and Repair Crews: A Multi-Agent Reinforcement Learning Approach

Hybrid Multi-Agent Reinforcement Learning for Electric Vehicle Resilience Control Towards a Low-Carbon Transition

Hierarchical multi-agent reinforcement learning for repair crews dispatch control towards multi-energy microgrid resilience

Multi-Agent Reinforcement Learning-based Distributed Economic Dispatch Considering Network attacks and Uncertain Costs

Multi-service Provision for Electric Vehicles in Power-Transportation Networks Towards a Low-Carbon Transition: A Hierarchical and Hybrid Multi-Agent Reinforcement Learning Approach

Multi-agent Deep Reinforcement Learning for Resilience-Driven Routing and Scheduling of Mobile Energy Storage Systems

Secure Energy Management of Multi-Energy Microgrid: A Physical-Informed Safe Reinforcement Learning Approach

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Microgrid Optimization Strategy for Charging and Swapping Power Stations with New Energy Based on Multi-Agent Reinforcement Learning

Optimizing the Post-Disaster Control of Islanded Microgrid: A Multi-Agent Deep Reinforcement Learning Approach.

AC/DC hybrid distribution network reconfiguration with microgrid formation using multi-agent soft actor-critic

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

Coordinating Multi-Energy Microgrids for Integrated Energy System Resilience: A Multi-Task Learning Approach

Resilience-Oriented Coordination of Networked Microgrids: a Shapley Q-Value Learning Approach

Distributed Energy Trading and Scheduling Among Microgrids via Multiagent Reinforcement Learning

Resilience-driven optimal sizing and pre-positioning of mobile energy storage systems in decentralized networked microgrids

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Resilient Disaster Recovery Logistics of Distribution Systems: Co-Optimize Service Restoration With Repair Crew and Mobile Power Source Dispatch

A Two-Stage Hybrid Stochastic–Robust Coordination of Combined Energy Management and Self-Healing in Smart Distribution Networks Incorporating Multiple Microgrids

A Resilience Enhancement Strategy for Networked Microgrids Incorporating Electricity and Transport and Utilizing a Stochastic Hierarchical Control Approach

Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market