Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Resilient Distribution Networks by Microgrid Formation Using Deep Reinforcement Learning

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

A deep reinforcement learning-based resilience enhancement framework for distribution networks under extreme weather events

Reinforcement Learning for Resilient Power Grids

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Double Deep Q-learning Based Real-Time Optimization Strategy for Microgrids

Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework

Deep Reinforcement Learning Based Approach for Optimal Power Flow of Distribution Networks Embedded with Renewable Energy and Storage Devices

Intelligent Multi-Microgrid Energy Management Based on Deep Neural Network and Model-Free Reinforcement Learning

Optimal Scheduling in IoT-Driven Smart Isolated Microgrids Based on Deep Reinforcement Learning

DNOperNet: A Generic Network Architecture for Scalable and Safe Deep Reinforcement Learning in Distribution Network Operation

Optimizing the Post-Disaster Control of Islanded Microgrid: A Multi-Agent Deep Reinforcement Learning Approach.

Robustness Assessment and Enhancement of Deep Reinforcement Learning-Enabled Load Restoration for Distribution Systems.

Intelligent demand response resource trading using deep reinforcement learning

Coordinated Energy and Reserve Sharing of Isolated Microgrid Cluster using Deep Reinforcement Learning

Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market

A Data-driven Method for Fast AC Optimal Power Flow Solutions via Deep Reinforcement Learning

AC/DC hybrid distribution network reconfiguration with microgrid formation using multi-agent soft actor-critic

Data-Efficient Deep Reinforcement Learning-Based Optimal Generation Control in DC Microgrids

A Safe DRL Method for Fast Solution of Real-Time Optimal Power Flow