Abstract:<p>In this paper, we propose an energy management strategy based on deep reinforcement learning for a hybrid battery system in electric vehicles consisting of a high-energy and a high-power battery pack. The energy management strategy of the hybrid battery system was developed based on the electrical and thermal characterization of the battery cells, aiming at minimizing the energy loss and increasing both the electrical and thermal safety level of the whole system. Primarily, we designed a novel reward term to explore the optimal operating range of the high-power pack without imposing a rigid constraint of state of charge. Furthermore, various load profiles were randomly combined to train the deep Q-learning model, which avoided the overfitting problem. The training and validation results showed both the effectiveness and reliability of the proposed strategy in loss reduction and safety enhancement. The proposed energy management strategy has demonstrated its superiority over the reinforcement learning-based methods in both computation time and energy loss reduction of the hybrid battery system, highlighting the use of such an approach in future energy management systems.</p>

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to optimize the energy management strategy of the hybrid battery system through deep reinforcement learning (DRL) in electric vehicles. Specifically, the research aims to design an energy management strategy based on deep Q - learning (DQL) to reduce energy loss and improve the electrical and thermal safety of the entire system. The strategy proposed in the paper focuses particularly on the power distribution between high - energy battery packs (HE) and high - power battery packs (HP). By designing a new reward function, it explores the optimal working range of the HP battery pack while avoiding rigid constraints on the state of charge (SoC). In addition, in order to prevent the over - fitting problem, the paper uses a random combination of different load configurations to train the DQL model. The main contributions of the paper are as follows: 1. Developed an energy management strategy based on DQL, aiming to reduce energy loss and enhance electrical and thermal safety. 2. Designed a novel reward function for automatically determining the optimal working range of the HP battery pack. 3. Established and parameterized a coupled electro - thermal battery model for simulating the electrical and thermal dynamic characteristics of HE and HP battery cells. 4. Designed a new training scenario to limit the over - fitting problem by randomly combining different driving conditions within each training cycle. 5. Verified the proposed DQL - based energy management strategy using new driving conditions and conducted a comparative study with the Q - learning (QL) - based strategy, highlighting the superiority of the proposed method in terms of calculation and performance.

Deep reinforcement learning-based energy management of hybrid battery systems in electric vehicles

Cloud-based Health-Conscious Energy Management of Hybrid Battery Systems in Electric Vehicles with Deep Reinforcement Learning

Deep Reinforcement Learning-Based Energy Management for Hybrid Electric Vehicles

Research on Energy Management Strategy of Electric Vehicle Hybrid System Based on Reinforcement Learning

Battery Health-Aware and Deep Reinforcement Learning-Based Energy Management for Naturalistic Data-Driven Driving Scenarios

A deep reinforcement learning approach to energy management control with connected information for hybrid electric vehicles

Battery life constrained real-time energy management strategy for hybrid electric vehicles based on reinforcement learning

Incentive learning-based energy management for hybrid energy storage system in electric vehicles

Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle

Battery health-aware and naturalistic data-driven energy management for hybrid electric bus based on TD3 deep reinforcement learning algorithm

Rule-interposing Deep Reinforcement Learning Based Energy Management Strategy for Power-Split Hybrid Electric Vehicle

Energy Management of Hybrid Electric Vehicles Based on Model Predictive Control and Deep Reinforcement Learning

Data-driven reinforcement-learning-based hierarchical energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles

Imitation reinforcement learning energy management for electric vehicles with hybrid energy storage system

Real-Time Battery Thermal Management for Electric Vehicles Based on Deep Reinforcement Learning

Reinforcement Learning-Based Energy Management for Hybrid Electric Vehicle Enhanced by Velocity Prediction

Deep Reinforcement Learning Based Energy Management of Hybrid Electric Vehicles with Expert Knowledge

Reinforcement Learning-Based Energy Management for Hybrid Power Systems: State-of-the-Art Survey, Review, and Perspectives

Deep Reinforcement Learning-Based Energy Management Strategy for Hybrid Electric Vehicles

Deep Reinforcement Learning Based Energy Management for a Hybrid Electric Vehicle

Multi-Vehicle Interaction-Aware Energy Management for Connected Hybrid Electric Vehicles Via Deep Reinforcement Learning