Abstract:Energy management strategy (EMS) is a way to reduce the energy consumption of hybrid power systems. This article proposes a unique deep reinforcement learning- (DRL-) based EMS for plug-in hybrid electric heavy-duty trucks (PHETs), combining driving cycle pattern recognition (DPR) and deep transfer learning (DTL). The proposed EMS can cope well with the complex usage scenarios of PHETs and the difficulty of generating EMS. While ensuring the minimum overall driving cost, the strategy can improve the convergence speed of the DRL method and the generalizability under segmented usage scenarios. Firstly, representative driving cycles that reflect different usage scenarios are constructed based on a naturalistic data-driven method. Secondly, a plug-in hybrid electric heavy-duty truck (PHET) driving pattern recognizer based on a learning vector quantization neural network (LVQ) is built. Thirdly, the deep deterministic policy gradient (DDPG) algorithm is innovatively combined with the DTL algorithm. The pretrained neural network in the corresponding usage scenarios is transferred to the natural driving cycles based on DTL. Moreover, the proposed EMS gives an emphasized consciousness on the battery degradation cost. Finally, the strategy is tested under natural driving cycles in different usage scenarios and proven through comparison with the current state-of-the-art techniques, deep reinforcement learning-based strategy, and dynamic programming (DP). The results show that the proposed strategy outperforms existing cutting-edge deep reinforcement learning techniques in terms of convergence speed, battery life extension, fuel consumption, and overall driving cost reduction. The proposed control strategy can improve the convergence speed by nearly 50%, while effectively extending the battery life and reducing the overall driving cost compared to the existing state-of-the-art strategies. The battery degradation rate is reduced by 48.46%, 57.95%, and 36.99%, and the driving cost is reduced by 17.76%, 8.51%, and 7.12%, respectively, under each usage scenario.

Hierarchical energy management of plug-in hybrid electric trucks based on state-of-charge optimization

Bi-level Energy Management of Plug-in Hybrid Electric Vehicles for Fuel Economy and Battery Lifetime with Intelligent State-of-charge Reference

Hierarchical speed planning and energy management for autonomous plug-in hybrid electric vehicle in vehicle-following environment

Co-Optimization of Speed Planning and Energy Management for Plug-In Hybrid Electric Trucks Passing Through Traffic Light Intersections

Transfer Deep Reinforcement Learning-Based Energy Management Strategy for Plug-In Hybrid Electric Heavy-Duty Trucks under Segmented Usage Scenarios

Adaptive Hierarchical Energy Management Design for a Plug-In Hybrid Electric Vehicle.

Hierarchical Model-Predictive-Control-Based Energy Management Strategy for Fuel Cell Hybrid Commercial Vehicles Incorporating Traffic Information

Data-driven Hierarchical Control for Online Energy Management of Plug-in Hybrid Electric City Bus

Hierarchical Rewarding Deep Deterministic Policy Gradient Strategy for Energy Management of Hybrid Electric Vehicles

Adaptive Fuzzy Logic Energy Management Strategy Based on Reasonable SOC Reference Curve for Online Control of Plug-in Hybrid Electric City Bus.

Multi-Objective Optimization Strategy for Fuel Cell Hybrid Electric Trucks Based on Driving Patern Recognition

Time-Efficient Stochastic Model Predictive Energy Management for a Plug-In Hybrid Electric Bus with an Adaptive Reference State-of-Charge Advisory

Adaptive energy management of a plug-in hybrid electric vehicle based on driving pattern recognition and dynamic programming

An energy management strategy for plug-in hybrid electric vehicles based on deep learning and improved model predictive control

State-of-charge-constraint-based Energy Management Strategy of Plug-in Hybrid Electric Vehicle with Bus Route

Continuous Reinforcement Learning-Based Energy Management Strategy for Hybrid Electric-Tracked Vehicles

An Energy Management Strategy Based on DDPG with Improved Exploration for Battery/Supercapacitor Hybrid Electric Vehicle

Adaptive Energy Management Strategy Based on Intelligent Prediction of Driving Cycle for Plug−In Hybrid Electric Vehicle

Cost-optimal energy management strategy for plug-in hybrid electric vehicles with variable horizon speed prediction and adaptive state-of-charge reference

The optimized real-time energy management strategy for fuel-cell hybrid trucks through dynamic programming

A Predictive Energy Management Strategy for Heavy Hybrid Electric Vehicles Based on Adaptive Network-Based Fuzzy Inference System-Optimized Time Horizon