Abstract:Aiming at a cleaner future power system, many regimes in the world have proposed their ambitious decarbonizing plan, with increasing penetration of renewable energy sources (RES) playing an alternative role to conventional energy. As a result, power system tends to have less backup capacity and operate near their designed limit, thus exacerbating system vulnerability against extreme events. Under this reality, resilient control for the multi-energy micro-grid is facing the following challenges, which are: 1) the effect from the stochastic uncertainties of RES; 2) the need for a model-free and fast-reacting control scheme under extreme events; and 3) efficient exploration and robust performance with limited extreme events data. To deal with the aforementioned challenges, this paper proposes a novel Bayesian Deep Reinforcement Learning-based resilient control approach for multi-energy micro-grid. In particular, the proposed approach replaces the deterministic network in traditional Reinforcement Learning with a Bayesian probabilistic network in order to obtain an approximation of the value function distribution, which effectively solves the Q-value overestimation issue. Compared with the naive Deep Deterministic Policy Gradient (DDPG) method and optimization method, the effectiveness and importance of employing the Bayesian Reinforcement Learning approach are investigated and illustrated across different operating scenarios. Case studies have shown that by using the Monte Carlo posterior mean of the Bayesian value function distribution instead of a deterministic estimation, the proposed Bayesian Deep Deterministic Policy Gradient (BDDPG) method achieves a near-optimum policy in a more stable process, which verifies the robustness and the practicability of the proposed approach.

An Adaptive Control Framework for Dynamically Reconfigurable Battery Systems Based on Deep Reinforcement Learning

An Efficient and Flexible Learning Framework for Dynamic Power and Thermal Co-Management

An Optimization Framework for Dynamically Reconfigurable Battery Systems

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

A Novel Optimization Framework of Dynamic Reconfigurable Battery Networks for Capacity Balancing

Real-Time Battery Thermal Management for Electric Vehicles Based on Deep Reinforcement Learning

Battery Health-Aware and Deep Reinforcement Learning-Based Energy Management for Naturalistic Data-Driven Driving Scenarios

Dynamic Reconfigurable Multi-Cell Battery: A Novel Approach to Improve Battery Performance

A DOD-SOH balancing control method for dynamic reconfigurable battery systems based on DQN algorithm

Battery Optimal Sizing Under a Synergistic Framework With DQN-Based Power Managements for the Fuel Cell Hybrid Powertrain

Toward Dynamic Programming-Based Management in Reconfigurable Battery Packs

AI-assisted reconfiguration of battery packs for cell balancing to extend driving runtime

A Novel Digital Energy Computation Method for Dynamic Reconfigurable Battery Networks

Deep reinforcement learning-based energy management of hybrid battery systems in electric vehicles

Reinforcement Learning-based Fast Charging Control Strategy for Li-ion Batteries

Cloud-based Health-Conscious Energy Management of Hybrid Battery Systems in Electric Vehicles with Deep Reinforcement Learning

A deep reinforcement learning approach to energy management control with connected information for hybrid electric vehicles

Mobile battery energy storage system control with knowledge‐assisted deep reinforcement learning

Transfer Deep Reinforcement Learning-enabled Energy Management Strategy for Hybrid Tracked Vehicle

Adaptive safe reinforcement learning‐enabled optimization of battery fast‐charging protocols

Safe Deep Reinforcement Learning-Based Constrained Optimal Control Scheme for HEV Energy Management