Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Probabilistic Mapping of Stability and Reliability in Microgrids – A Bayesian Interpretation

Probabilistic Risk Evaluation of Microgrids Considering Stability and Reliability

Quantitative Mapping of Modeling Methods for Stability Validation in Microgrids

Stochastic Dynamic Analysis for Power Systems under Uncertain Variability

System-Level Mapping of Modeling Methods for Stability Characterization in Microgrids

Stability Constraints on Reliability-Oriented Control of AC Microgrids – Theoretical Margin and Solutions

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Reliability Analysis of a Microgrid Using Dynamic Bayesian Belief Networks

Large-disturbance Stability for Power-Converter-dominated Microgrid: A Review

Impedance-based Stability Analysis of AD-DC Hybrid System Considering Grid Impedance

Aggregated Emulation of Multiple Converters with Heterogeneous Dynamics in Low-Voltage Microgrids – A Clustering Approach

Reliability Evaluation on a Joint Machine Learning and Optimization Framework

Stability of DC Distribution Systems: Analytical and Experimental Results

System-Level Stability of the CIGRE Low Voltage Benchmark System: Definitions and Extrapolations

Reliability Evaluation of Distribution System Considering Its Interactions with Microgrids

Probabilistic Static Voltage Stability Calculation Based on Quasi-Monte Carlo and Kernel Density Estimation

System-level stability analysis of DC microgrid with distributed control strategy

Decentralized Impedance-Based Stability Analysis for Series-Type DC Microgrids

Estimating the Stability of an AC-DC Hybrid Micro Grid with Multilayer Power Flow While Using Interconnected Converter

Small-Signal Modeling and Stability Analysis of Hybrid AC/DC Microgrids.

Stability Enhancement Based on Virtual Impedance for DC Microgrids with Constant Power Loads