Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Fully Decentralized Reinforcement Learning-based Control of Photovoltaics in Distribution Grids for Joint Provision of Real and Reactive Power

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Multi-Agent Deep Reinforcement Learning for Realistic Distribution System Voltage Control Using PV Inverters

Decentralized Voltage Control of Large-Scale Distribution System with PVs Based on MADRL

Data-Driven Multi-Agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

Research on Optimal Control Strategy of Distributed Photovoltaic Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Coordinated Voltage Control in Smart Distribution Network

Two-Stage Deep Reinforcement Learning for Distribution System Voltage Regulation and Peak Demand Management

A Date-Driven Voltage Control Strategy for Distribution Network Using Deep Reinforcement Learning

Data-Driven Distribution System Coordinated PV Inverter Control Using Deep Reinforcement Learning

Fair Reinforcement Learning Algorithm for PV Active Control in LV Distribution Networks

Visibility-enhanced Model-Free Deep Reinforcement Learning Algorithm for Voltage Control in Realistic Distribution Systems Using Smart Inverters

Coordination of PV Smart Inverters Using Deep Reinforcement Learning for Grid Voltage Regulation

Optimal Real-Time Voltage/Var Control for Distribution Network: Droop-control Based Multi-Agent Deep Reinforcement Learning

A Deep Reinforcement Learning Voltage Control Method for Distribution Network

Reinforcement Learning for Joint Design and Control of Battery-PV Systems

Autonomous Voltage Control for Grid Operation Using Deep Reinforcement Learning

A Multi-Agent Deep Reinforcement Learning Based Voltage Regulation Using Coordinated PV Inverters

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Multi Agent Safe Graph Reinforcement Learning for PV Inverter s Based Real-Time De centralized Volt/Var Control in Zoned Distribution Networks