Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Hierarchical Nested Predictive Control for Energy Management of Multi-Microgrids System.

Formation Scheme and Decentralized Control of Microgrids Consisting of Mobile Emergency Power Sources During Natural Disasters

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

A hierarchical energy management strategy for grid-connected microgrid

Distributed Optimal Scheduling of Multi-Microgrid System with Hydrogen Based on Model Predictive Control

Distributed predictive control for energy management of multi-microgrids systems

Multi‐time Hierarchical Stochastic Predictive Control for Energy Management of an Island Microgrid with Plug‐in Electric Vehicles

A Self-Adaptive Control Strategy To Suppress Fluctuation Of Distributed Photovoltaic Energy In Microgrids With Combined Heat And Power System

Multi-Microgrids for Enhancing Power System Resilience in Response to the Increasingly Frequent Natural Hazards

Hierarchical Control of an Adaptive Droop Regulated Microgrid with Dynamical Load Power Sharing

A hierarchical distributed predictive control approach for microgrids energy management

Economic Dispatch of Stand-alone Photovoltaic-Battery-Hydro-Diesel Hybrid Microgrid Based on Distributed Control

An Improved Hierarchical and Decentralized Control Strategy for Emergency Power Supply During Disaster

Distributed Model Predictive Control Strategy Based on Block‐wised Alternating Direction Multiplier Method for Microgird Clusters

Decentralised Coordinated Energy Management for Hybrid AC/DC Microgrid by Using Fuzzy Control Strategy

Hierarchical Control and Economic Optimization of Microgrids Considering the Randomness of Power Generation and Load Demand

A Novel Hierarchical Cooperative Control Strategy of Hybrid SMES/Battery Energy Storage System in Photovoltaic Grid-connected Microgrid

Energy management for multi-microgrid system based on model predictive control

A Coordinated Control of Hybrid Ac/dc Microgrids with PV-wind-battery under Variable Generation and Load Conditions

Hierarchical distributed scenario-based model predictive control of interconnected microgrids

Model Predictive Control for Distributed Microgrid System with Unbalanced Loads