Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

An Innovative Deep Reinforcement Learning Controller for DC/DC DAB Converters Based on Deep Deterministic Policy Gradient

Deep Reinforcement Learning-Aided Efficiency Optimized Dual Active Bridge Converter for the Distributed Generation System

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

An Intelligent Control Strategy for buck DC-DC Converter via Deep Reinforcement Learning

Deep Reinforcement Learning Based Input Voltage Sharing Method for Input-Series Output-Parallel Dual Active Bridge Converter in DC Microgrids

Dynamic Control of Three-Phase Dual-Active-Bridge DC-DC Converters Based on Sliding-Mode-Learning Adaline

A TD3 Algorithm Based Reinforcement Learning Controller for DC-DC Switching Converters

Hybrid Energy Storage Control Method For DC Microgrid Based On Deep Deterministic Policy Gradient

Deep Deterministic Policy Gradient Algorithm Based Reinforcement Learning Controller for Single-Inductor Multiple-Output DC–DC Converter

TD3 Algorithm Based Reinforcement Learning Control for Multiple-Input Multiple-Output DC-DC Converters

A Deep Deterministic Policy Gradient Algorithm Based Controller with Adjustable Learning Rate for DC-AC Inverters

Deep Reinforcement Learning-Based Proportional–integral Control for Dual-Active-bridge Converter

Deep Reinforcement Learning Based Control Strategy for Voltage Regulation of DC-DC Buck Converter Feeding CPLs in DC Microgrid

Deep Reinforcement Learning Based Approach for Active Power Security Correction Control of Power System

Twin-Delayed Deep Deterministic Policy Gradient Algorithm to Control a Boost Converter in a DC Microgrid

A DDPG Algorithm Based Reinforcement Learning Controller for Three-Phase DC-AC Inverters

A Novel Deep Deterministic Policy Gradient Assisted Learning-Based Control Algorithm for Three-Phase DC/AC Inverter With an RL Load

Learning-Based Model Predictive Control of DC-DC Buck Converters in DC Microgrids: A Multi-Agent Deep Reinforcement Learning Approach

A Novel Deep Reinforcement Learning-Based Current Control Method for Direct Matrix Converters

Dual-Terminal Voltage Feedforward Based Direct Power Control Scheme and Stability Analysis of Dual Active Bridge Converter in DC Microgrid Systems

A Reinforcement Learning-based Online-training AI Controller for DC-DC Switching Converters