Abstract:Energy management strategy (EMS) is a way to reduce the energy consumption of hybrid power systems. This article proposes a unique deep reinforcement learning- (DRL-) based EMS for plug-in hybrid electric heavy-duty trucks (PHETs), combining driving cycle pattern recognition (DPR) and deep transfer learning (DTL). The proposed EMS can cope well with the complex usage scenarios of PHETs and the difficulty of generating EMS. While ensuring the minimum overall driving cost, the strategy can improve the convergence speed of the DRL method and the generalizability under segmented usage scenarios. Firstly, representative driving cycles that reflect different usage scenarios are constructed based on a naturalistic data-driven method. Secondly, a plug-in hybrid electric heavy-duty truck (PHET) driving pattern recognizer based on a learning vector quantization neural network (LVQ) is built. Thirdly, the deep deterministic policy gradient (DDPG) algorithm is innovatively combined with the DTL algorithm. The pretrained neural network in the corresponding usage scenarios is transferred to the natural driving cycles based on DTL. Moreover, the proposed EMS gives an emphasized consciousness on the battery degradation cost. Finally, the strategy is tested under natural driving cycles in different usage scenarios and proven through comparison with the current state-of-the-art techniques, deep reinforcement learning-based strategy, and dynamic programming (DP). The results show that the proposed strategy outperforms existing cutting-edge deep reinforcement learning techniques in terms of convergence speed, battery life extension, fuel consumption, and overall driving cost reduction. The proposed control strategy can improve the convergence speed by nearly 50%, while effectively extending the battery life and reducing the overall driving cost compared to the existing state-of-the-art strategies. The battery degradation rate is reduced by 48.46%, 57.95%, and 36.99%, and the driving cost is reduced by 17.76%, 8.51%, and 7.12%, respectively, under each usage scenario.

Transformer-Based Traffic-Aware Predictive Energy Management of a Fuel Cell Electric Vehicle

Enhancing fuel cell electric vehicle efficiency with TIP-EMS: A trainable integrated predictive energy management approach

Short-Term Speed Forecasting of Large-Scale Urban Road Network Based on Transformer

A Predictive Energy Management Strategy for Multi-Energy Source Vehicles Based on Full-Factor Trip Information

An energy management strategy for plug-in hybrid electric vehicles based on deep learning and improved model predictive control

Model predictive control-based energy management strategy with vehicle speed prediction for hybrid electric vehicles

Energy Management Strategy for Fuel Cell Vehicles Based on Online Driving Condition Recognition Using Dual-Model Predictive Control

Real-Time Energy Management Strategy Based on Driver-Action-Impact MPC for Series Hybrid Electric Vehicles

Twin delayed deep deterministic policy gradient based energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles considering predicted terrain information

Hierarchical predictive energy management of fuel cell buses with launch control integrating traffic information

Energy management of plug-in hybrid electric vehicles based on speed prediction fused driving intention and LIDAR

DeepFEC: Energy Consumption Prediction under Real-World Driving Conditions for Smart Cities

Real-time predictive energy management of plug-in hybrid electric vehicles for coordination of fuel economy and battery degradation

Research on car-following control and energy management strategy of hybrid electric vehicles in connected scene

Predictive Energy Management for Fuel Cell Hybrid Vehicles Considering Efficiency and Safety

Spatial–temporal data-driven full driving cycle prediction for optimal energy management of battery/supercapacitor electric vehicles

Adaptive Energy Management Strategy Based on Intelligent Prediction of Driving Cycle for Plug−In Hybrid Electric Vehicle

Transfer Deep Reinforcement Learning-Based Energy Management Strategy for Plug-In Hybrid Electric Heavy-Duty Trucks under Segmented Usage Scenarios

Health-conscious deep reinforcement learning energy management for fuel cell buses integrating environmental and look-ahead road information

A reinforcement learning-based energy management strategy for fuel cell hybrid vehicle considering real-time velocity prediction

A Predictive Energy Management Strategy for Heavy Hybrid Electric Vehicles Based on Adaptive Network-Based Fuzzy Inference System-Optimized Time Horizon