Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Reinforcement Learning Optimizes Power Dispatch in Decentralized Power Grid

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

Reinforcement Learning and Stochastic Optimization with Deep Learning-Based Forecasting on Power Grid Scheduling

A deep reinforcement learning algorithm for the order optimization allocation of total power in the interconnected power grids

Fully Decentralized Reinforcement Learning-based Control of Photovoltaics in Distribution Grids for Joint Provision of Real and Reactive Power

Reinforcement Learning Based Power Grid Day-Ahead Planning and AI-Assisted Control

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Distributed deep reinforcement learning for integrated generation‐control and power‐dispatch of interconnected power grid with various renewable units

Reinforcement Learning in Adaptive Control of Power System Generation

PowerNet: Multi-agent Deep Reinforcement Learning for Scalable Powergrid Control

A Graph-based Deep Reinforcement Learning Framework for Autonomous Power Dispatch on Power Systems with Changing Topologies

Deep Reinforcement Learning for Load Frequency Control in Isolated Microgrids: A Knowledge Aggregation Approach with Emphasis on Power Symmetry and Balance

Proximal policy optimization through a deep reinforcement learning framework for remedial action schemes of VSC-HVDC

Reinforcement Learning for Resilient Power Grids

Reinforcement Learning for Battery Energy Storage Dispatch augmented with Model-based Optimizer

Real-time Autonomous Line Flow Control Using Proximal Policy Optimization

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

Reactive power optimization via deep transfer reinforcement learning for efficient adaptation to multiple scenarios

Active power correction strategies based on deep reinforcement learning-part I: A simulation-driven solution for robustness