Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Power Grid Cascading Failure Mitigation by Reinforcement Learning

Mitigating Multi-Stage Cascading Failure by Reinforcement Learning

Mitigating Cascading Failure in Power Grids with Deep Reinforcement Learning-Based Remedial Actions

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Reinforcement Learning Based Optimization of Line Switching off During Cascading Failures in Power Grids

A DRL-Based Load Shedding Strategy Considering Communication Delay for Mitigating Power Grid Cascading Failure

RL for Mitigating Cascading Failures: Targeted Exploration via Sensitivity Factors

Risk Assessment of Power System Cascading Outages Based on Deep Reinforcement Learning

A deep reinforcement learning-based resilience enhancement framework for distribution networks under extreme weather events

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Reinforcement Learning for Resilient Power Grids

Optimal defense strategy for AC/DC hybrid power grid cascading failures based on game theory and deep reinforcement learning

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

Sequential Node/Link Recovery Strategy of Power Grids Based on Q-Learning Approach

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Deep Reinforcement Learning Based Robust Control Strategy for Power Sharing and Voltage Regulation in DC Grid-Forming Energy Storage System

Deep Reinforcement Learning for Smart Grid Protection Against Coordinated Multistage Transmission Line Attacks

Safe Reinforcement Learning for Emergency LoadShedding of Power Systems

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

Deep Reinforcement Learning Framework for Resilience Enhancement of Distribution Systems under Extreme Weather Events

Identifying Vulnerable Set of Cascading Failure in Power Grid Using Deep Learning Framework.