Abstract:Lithium-ion battery energy storage systems are made from sets of battery packs that are connected in series and parallel combinations depending on the application’s needs for power. To achieve optimal control, advanced battery management systems (ABMSs) with health-conscious optimal control are required for highly dynamic applications where safe operation, extended battery life, and maximum performance are critical requirements. The majority of earlier research assumed that the battery cells in these energy storage systems were identical and would vary uniformly over time in terms of cell characteristics. However, in real-world situations, the battery cells might behave differently for a number of reasons. Overcharging and over-discharging are caused by an electrical imbalance that results from the cells’ differences in properties and capacity. Therefore in this study, a stratified real-time control scheme was developed for the dual purposes of minimizing the capacity fade and the energy losses of a battery pack. Each of the cells in the pack is represented by a degradation-conscious physics-based reduced-order equivalent circuit model. In view of the inconsistencies between cells, the proposed control scheme uses a state estimator such that the parametric values of the circuit elements in the cell model are determined and updated in a decentralized manner. The minimization of the capacity fade and energy losses is then formulated as a multiobjective optimization problem, from which the resulting optimal control strategy is realized through the switching actions of a modular multilevel series-parallel converter which interconnects the battery pack to an external AC system. A centralized controller ensures optimal switching sequence of the converter leading to the maximum utilization of the capacity of the battery pack. Both simulation and experimental results are used to verify the proposed methodologies which aim at minimizing the battery degradation by reconfiguring the battery cells dynamically in accordance with the state of health (SOH) of the pack.

Reinforcement Learning-Based Optimal Battery Control Under Cycle-Based Degradation Cost

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Deep Reinforcement Learning-Based Energy Storage Arbitrage With Accurate Lithium-Ion Battery Degradation Model

Load Forecasting-Based Learning System for Energy Management With Battery Degradation Estimation: A Deep Reinforcement Learning Approach

Optimal Battery Control Under Cycle Aging Mechanisms in Pay for Performance Settings

Optimal Cycling of a Heterogenous Battery Bank via Reinforcement Learning

Operational Optimization for Off-Grid Renewable Building Energy System Using Deep Reinforcement Learning

A Convex Cycle-based Degradation Model for Battery Energy Storage Planning and Operation

Reinforcement Learning for Battery Energy Storage Dispatch augmented with Model-based Optimizer

Optimal Regulation Response of Batteries Under Cycle Aging Mechanisms

Data-driven Economic Control of Battery Energy Storage System Considering Battery Degradation

Reinforcement Learning in Optimizing the Electric Vehicle Battery System Coupling with Driving Behaviors

Optimizing EV Battery Management: Advanced Hybrid Reinforcement Learning Models for Efficient Charging and Discharging

Deep reinforcement learning‐based optimal data‐driven control of battery energy storage for power system frequency support

Optimal Coordination of Distributed Energy Resources Using Deep Deterministic Policy Gradient

Prioritized experience replay based deep distributional reinforcement learning for battery operation in microgrids

Real-Time Battery Thermal Management for Electric Vehicles Based on Deep Reinforcement Learning

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Degradation-Conscious Multiobjective Optimal Control of Reconfigurable Li-Ion Battery Energy Storage Systems

Reinforcement Learning-Based Energy Management for Fuel Cell Electrical Vehicles Considering Fuel Cell Degradation