Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Secondary control activation analysed and predicted with explainable AI

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Regulatory Changes in Power Systems Explored with Explainable Artificial Intelligence

Revealing drivers and risks for power grid frequency stability with explainable AI

Identifying drivers and mitigators for congestion and redispatch in the German electric power system with explainable AI

Artificial Intelligence-Based Methods for Renewable Power System Operation

Explainable AI in Deep Reinforcement Learning Models for Power System Emergency Control

Coordinated Predictive Secondary Control for DC Microgrids Based on High-Order Fully Actuated System Approaches

Reinforcement Learning Based Power Grid Day-Ahead Planning and AI-Assisted Control

An Explainable Framework for Machine learning-Based Reactive Power Optimization of Distribution Network

Why Reinforcement Learning in Energy Systems Needs Explanations

Distill2Explain: Differentiable decision trees for explainable reinforcement learning in energy application controllers

Explainable Reinforcement Learning-based Home Energy Management Systems using Differentiable Decision Trees

Decentralized Smart Grid Stability Modeling with Machine Learning

Understanding electricity prices beyond the merit order principle using explainable AI

Make Safe Decisions in Power System: Safe Reinforcement Learning Based Pre-decision Making for Voltage Stability Emergency Control

Self-Triggered Model Predictive Control of AC Microgrids with Physical and Communication State Constraints

Assessment-prediction-regulation coordinated secondary control strategy for microgrid considering large time-delay

Real-world validation of safe reinforcement learning, model predictive control and decision tree-based home energy management systems

Autonomous Voltage Control for Grid Operation Using Deep Reinforcement Learning

Physics-inspired machine learning for power grid frequency modelling