Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Reinforcement Learning$\unicode{x2013}$Based Transient Response Shaping for Microgrids

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Bridging Transient and Steady-State Performance in Voltage Control: A Reinforcement Learning Approach with Safe Gradient Flow

Deep Reinforcement Learning for Optimizing Inverter Control: Fixed and Adaptive Gain Tuning Strategies for Power System Stability

Reinforcement learning robust nonlinear control of a microgrid with hybrid energy storage systems

Resilient Control of Networked Microgrids using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Reinforcement Learning Based Integrated Control to Improve the Efficiency of DC Microgrids

Predictive Control of Voltage Source Inverter: an Online Reinforcement Learning Solution

Resilient Reinforcement Learning for Voltage Control in an Islanded DC Microgrid Integrating Data-Driven Piezoelectric

Inverter PQ Control with Trajectory Tracking Capability for Microgrids Based on Physics-informed Reinforcement Learning

Reinforcement learning-based event-triggered secondary control of DC microgrids

Lifelong Control of Off-grid Microgrid with Model Based Reinforcement Learning

Deep Reinforcement Learning Based Control of a Grid Connected Inverter With LCL-Filter for Renewable Solar Applications

Learning a local trading strategy: deep reinforcement learning for grid-scale renewable energy integration

Enactment of Deep Reinforcement Learning Control for Power Management and Enhancement of Voltage Regulation in a DC Micro-Grid System

Distributed Deep Reinforcement Learning-based Approach for Fast Preventive Control Considering Transient Stability Constraints

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Reinventing power quality enhancement: deep reinforcement learning control for PV-UPQC in microgrids

Reinforcement learning for an enhanced energy flexibility controller incorporating predictive safety filter and adaptive policy updates

Reinforcement Learning Based Power Grid Day-Ahead Planning and AI-Assisted Control

Efficient Learning of Voltage Control Strategies via Model-based Deep Reinforcement Learning