Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Optimal Coordination of Distributed Energy Resources Using Deep Deterministic Policy Gradient

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Approximate Dynamic Programming with Enhanced Off-policy Learning for Coordinating Distributed Energy Resources

An optimal solutions-guided deep reinforcement learning approach for online energy storage control

Optimal Planning of Hybrid Energy Storage Systems using Curtailed Renewable Energy through Deep Reinforcement Learning

Deep Reinforcement Learning for Community Battery Scheduling under Uncertainties of Load, PV Generation, and Energy Prices

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

An Intelligent Energy Management Strategy for Hybrid Vehicle with Irrational Actions Using Twin Delayed Deep Deterministic Policy Gradient

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

A Constraint Enforcement Deep Reinforcement Learning Framework for Optimal Energy Storage Systems Dispatch

Reinforcement Learning for Battery Energy Storage Dispatch augmented with Model-based Optimizer

Online Operational Decision-making for Integrated Electric-Gas Systems with Safe Reinforcement Learning

Optimal Energy System Scheduling Using A Constraint-Aware Reinforcement Learning Algorithm

Towards Pareto-optimal energy management in integrated energy systems: A multi-agent and multi-objective deep reinforcement learning approach

Optimal dispatch of integrated energy system based on deep reinforcement learning

Safe Imitation Learning-based Optimal Energy Storage Systems Dispatch in Distribution Networks

Deep Reinforcement Learning Based Optimal Energy Management of Multi-energy Microgrids with Uncertainties

Double Deep Q-learning Based Real-Time Optimization Strategy for Microgrids

Multi-agent deep reinforcement learning-based optimal energy management for grid-connected multiple energy carrier microgrids