Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

Automatic Generation Control of Ubiquitous Power Internet of Things Integrated Energy System Based on Deep Reinforcement Learning

Automatic Generation Control Strategy for Integrated Energy System Based on Ubiquitous Power Internet of Things

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Multi-agent Deep Reinforcement Learning Strategy for Distributed Energy

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

A novel multi-agent DDQN-AD method-based distributed strategy for automatic generation control of integrated energy systems

Energy Management of Intelligent Building Based on Deep Reinforced Learning

Distributed deep reinforcement learning for integrated generation‐control and power‐dispatch of interconnected power grid with various renewable units

Distributed Deep Reinforcement Learning for Renewable Energy Accommodation Assessment With Communication Uncertainty in Internet of Energy

Power Control in Energy Harvesting Multiple Access System with Reinforcement Learning.

Hybrid Modeling with Data Enhanced Driven Learning Algorithm for Smart Generation Control in Multi-Area Integrated Energy Systems with High Proportion Renewable Energy

Long-term Deep Reinforcement Learning for Real-Time Economic Generation Control of Cloud Energy Storage Systems with Varying Structures

Probability-Based Energy Reinforced Management of Electric Vehicle Aggregation in the Electrical Grid Frequency Regulation.

A Novel Automatic Generation Control Method Based on the Large-Scale Electric Vehicles and Wind Power Integration into the Grid

Reinforcement Learning Optimized Intelligent Electricity Dispatching System

Deep Forest Reinforcement Learning for Preventive Strategy Considering Automatic Generation Control in Large-Scale Interconnected Power Systems

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Optimal Energy Management Strategies for Energy Internet Via Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based Multi-Objective Integrated Automatic Generation Control for Multiple Continuous Power Disturbances

Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning