Abstract:Energy management strategy (EMS) is a way to reduce the energy consumption of hybrid power systems. This article proposes a unique deep reinforcement learning- (DRL-) based EMS for plug-in hybrid electric heavy-duty trucks (PHETs), combining driving cycle pattern recognition (DPR) and deep transfer learning (DTL). The proposed EMS can cope well with the complex usage scenarios of PHETs and the difficulty of generating EMS. While ensuring the minimum overall driving cost, the strategy can improve the convergence speed of the DRL method and the generalizability under segmented usage scenarios. Firstly, representative driving cycles that reflect different usage scenarios are constructed based on a naturalistic data-driven method. Secondly, a plug-in hybrid electric heavy-duty truck (PHET) driving pattern recognizer based on a learning vector quantization neural network (LVQ) is built. Thirdly, the deep deterministic policy gradient (DDPG) algorithm is innovatively combined with the DTL algorithm. The pretrained neural network in the corresponding usage scenarios is transferred to the natural driving cycles based on DTL. Moreover, the proposed EMS gives an emphasized consciousness on the battery degradation cost. Finally, the strategy is tested under natural driving cycles in different usage scenarios and proven through comparison with the current state-of-the-art techniques, deep reinforcement learning-based strategy, and dynamic programming (DP). The results show that the proposed strategy outperforms existing cutting-edge deep reinforcement learning techniques in terms of convergence speed, battery life extension, fuel consumption, and overall driving cost reduction. The proposed control strategy can improve the convergence speed by nearly 50%, while effectively extending the battery life and reducing the overall driving cost compared to the existing state-of-the-art strategies. The battery degradation rate is reduced by 48.46%, 57.95%, and 36.99%, and the driving cost is reduced by 17.76%, 8.51%, and 7.12%, respectively, under each usage scenario.

Time Series Prediction Integrated RNN-DRL for Energy-Emission Management in HEVs

Data-driven transferred energy management strategy for hybrid electric vehicles via deep reinforcement learning

Energy Management Strategy Based on Deep Reinforcement Learning and Speed Prediction for Power-Split Hybrid Electric Vehicle with Multidimensional Continuous Control

An Intelligent Energy Management Strategy for Hybrid Vehicle with Irrational Actions Using Twin Delayed Deep Deterministic Policy Gradient

Deep Reinforcement Learning-Based Energy Management for a Series Hybrid Electric Vehicle Enabled by History Cumulative Trip Information

Deep Reinforcement Learning based Energy Management for Heavy Duty HEV considering Discrete-Continuous Hybrid Action Space

Battery life constrained real-time energy management strategy for hybrid electric vehicles based on reinforcement learning

A Comparative Study of Deep Reinforcement Learning-based Transferable Energy Management Strategies for Hybrid Electric Vehicles

A novel energy management strategy of hybrid electric vehicle via an improved TD3 deep reinforcement learning

Transfer Deep Reinforcement Learning-Based Energy Management Strategy for Plug-In Hybrid Electric Heavy-Duty Trucks under Segmented Usage Scenarios

Deep Reinforcement Learning Based PHEV Energy Management with Co-Recognition for Traffic Condition and Driving Style

Intelligent Learning Algorithm and Intelligent Transportation-Based Energy Management Strategies for Hybrid Electric Vehicles: A Review

Real-Time Energy Management for Hev Combining Naturalistic Driving Data and Deep Reinforcement Learning with High Generalization

Heuristic Energy Management Strategy of Hybrid Electric Vehicle Based on Deep Reinforcement Learning With Accelerated Gradient Optimization

An Apprenticeship-Reinforcement Learning Scheme Based on Expert Demonstrations for Energy Management Strategy of Hybrid Electric Vehicles

Transfer Deep Reinforcement Learning-enabled Energy Management Strategy for Hybrid Tracked Vehicle

Real-Time Battery Thermal Management for Electric Vehicles Based on Deep Reinforcement Learning

An adaptive hierarchical energy management strategy for hybrid electric vehicles combining heuristic domain knowledge and data-driven deep reinforcement learning

Human-like Energy Management Based on Deep Reinforcement Learning and Historical Driving Experiences

Supplementary Learning Control for Energy Management Strategy of Hybrid Electric Vehicles at Scale

The application of machine learning-based energy management strategy in a multi-mode plug-in hybrid electric vehicle, part II: Deep deterministic policy gradient algorithm design for electric mode