Abstract:Energy management strategy (EMS) is a way to reduce the energy consumption of hybrid power systems. This article proposes a unique deep reinforcement learning- (DRL-) based EMS for plug-in hybrid electric heavy-duty trucks (PHETs), combining driving cycle pattern recognition (DPR) and deep transfer learning (DTL). The proposed EMS can cope well with the complex usage scenarios of PHETs and the difficulty of generating EMS. While ensuring the minimum overall driving cost, the strategy can improve the convergence speed of the DRL method and the generalizability under segmented usage scenarios. Firstly, representative driving cycles that reflect different usage scenarios are constructed based on a naturalistic data-driven method. Secondly, a plug-in hybrid electric heavy-duty truck (PHET) driving pattern recognizer based on a learning vector quantization neural network (LVQ) is built. Thirdly, the deep deterministic policy gradient (DDPG) algorithm is innovatively combined with the DTL algorithm. The pretrained neural network in the corresponding usage scenarios is transferred to the natural driving cycles based on DTL. Moreover, the proposed EMS gives an emphasized consciousness on the battery degradation cost. Finally, the strategy is tested under natural driving cycles in different usage scenarios and proven through comparison with the current state-of-the-art techniques, deep reinforcement learning-based strategy, and dynamic programming (DP). The results show that the proposed strategy outperforms existing cutting-edge deep reinforcement learning techniques in terms of convergence speed, battery life extension, fuel consumption, and overall driving cost reduction. The proposed control strategy can improve the convergence speed by nearly 50%, while effectively extending the battery life and reducing the overall driving cost compared to the existing state-of-the-art strategies. The battery degradation rate is reduced by 48.46%, 57.95%, and 36.99%, and the driving cost is reduced by 17.76%, 8.51%, and 7.12%, respectively, under each usage scenario.

Deep Reinforcement Learning-Based Energy Management Strategy for Hybrid Electric Vehicles

Energy Management Strategy for a Series Hybrid Electric Vehicle Using Improved Deep Q-network Learning Algorithm with Prioritized Replay

A Double‐Deep Q‐Network‐Based Energy Management Strategy for Hybrid Electric Vehicles under Variable Driving Cycles

Parameterized deep Q-network based energy management with balanced energy economy and battery life for hybrid electric vehicles

Multi-objective Control and Energy Management Strategy Based on Deep Q-network for Parallel Hybrid Electric Vehicles

Energy Management of Hybrid Electric Vehicles Based on Model Predictive Control and Deep Reinforcement Learning

Energy Management Based on D4QN Reinforcement Learning for a Series-Parallel Multi-Speed Hybrid Electric Vehicle

Double Deep Reinforcement Learning-Based Energy Management for a Parallel Hybrid Electric Vehicle with Engine Start–Stop Strategy

Distributed Deep Reinforcement Learning-Based Energy and Emission Management Strategy for Hybrid Electric Vehicles.

Deep Reinforcement Learning Based Adaptive Energy Management for Plug-in Hybrid Electric Vehicle with Double Deep Q-network

A Comparative Study of Deep Reinforcement Learning Based Energy Management Strategy for Hybrid Electric Vehicle

Deep Reinforcement Learning-Based Energy Management for Hybrid Electric Vehicles

Transfer Deep Reinforcement Learning-Based Energy Management Strategy for Plug-In Hybrid Electric Heavy-Duty Trucks under Segmented Usage Scenarios

Reinforcement Learning-Based Energy Management Control Strategy of Hybrid Electric Vehicles

Rule-interposing Deep Reinforcement Learning Based Energy Management Strategy for Power-Split Hybrid Electric Vehicle

Energy Management for a Hybrid Electric Vehicle Based on Blended Reinforcement Learning with Backward Focusing and Prioritized Sweeping

Energy Management Strategy for Hybrid Electric Vehicles Based on Double Q-learning

Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle

Energy management strategy based on an improved TD3 reinforcement algorithm with novel experience replay

Data-driven transferred energy management strategy for hybrid electric vehicles via deep reinforcement learning

Research on energy management strategy of heavy-duty fuel cell hybrid vehicles based on dueling-double-deep Q-network