Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Authentic Microgrid State Estimation

Three-Stage Distributed State Estimation for AC-DC Hybrid Distribution Network under Mixed Measurement Environment

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

An overview of distributed microgrid state estimation and control for smart grids

Secure State Estimation and Control for Cyber Security of AC Microgrids

A Comprehensive Framework for Robust AC/DC Grid State Estimation Against Measurement and Control Input Errors

A Novel Sliding Mode Estimation for Microgrid Control with Communication Time Delays

Distributed Estimation And Secondary Control Of Autonomous Microgrid

Decentralized Robust State Estimation of Active Distribution Grids Incorporating Microgrids Based on PMU Measurements

A Decentralized Resilient Control Scheme for DC Microgrids Against Faults on Sensor and Actuator

Microgrid State Estimation and IoT: Modelling Concepts and Design Algorithm

Quantum microgrid state estimation

Secure Distributed State Estimation for Microgrids With Eavesdroppers Based on Variable Decomposition

Event-triggered Distributed Dynamic State Estimation with Imperfect Measurements over a Finite Horizon

Neuro-Dynamic State Estimation for Networked Microgrids

Study on small signal stability of microgrids: A review and a new approach

State Estimation for Future Energy Grids

Secure Distributed Dynamic State Estimation in Wide-Area Smart Grids

Set-Estimation based Networked Model Predictive Control for Energy Management of Faulty Microgrids

Dynamic state estimation for islanded microgrids with multiple fading measurements

An Adaptive-Then-Combine Dynamic State Estimation Considering Renewable Generations in Smart Grids