Abstract:Energy management strategy (EMS) is a way to reduce the energy consumption of hybrid power systems. This article proposes a unique deep reinforcement learning- (DRL-) based EMS for plug-in hybrid electric heavy-duty trucks (PHETs), combining driving cycle pattern recognition (DPR) and deep transfer learning (DTL). The proposed EMS can cope well with the complex usage scenarios of PHETs and the difficulty of generating EMS. While ensuring the minimum overall driving cost, the strategy can improve the convergence speed of the DRL method and the generalizability under segmented usage scenarios. Firstly, representative driving cycles that reflect different usage scenarios are constructed based on a naturalistic data-driven method. Secondly, a plug-in hybrid electric heavy-duty truck (PHET) driving pattern recognizer based on a learning vector quantization neural network (LVQ) is built. Thirdly, the deep deterministic policy gradient (DDPG) algorithm is innovatively combined with the DTL algorithm. The pretrained neural network in the corresponding usage scenarios is transferred to the natural driving cycles based on DTL. Moreover, the proposed EMS gives an emphasized consciousness on the battery degradation cost. Finally, the strategy is tested under natural driving cycles in different usage scenarios and proven through comparison with the current state-of-the-art techniques, deep reinforcement learning-based strategy, and dynamic programming (DP). The results show that the proposed strategy outperforms existing cutting-edge deep reinforcement learning techniques in terms of convergence speed, battery life extension, fuel consumption, and overall driving cost reduction. The proposed control strategy can improve the convergence speed by nearly 50%, while effectively extending the battery life and reducing the overall driving cost compared to the existing state-of-the-art strategies. The battery degradation rate is reduced by 48.46%, 57.95%, and 36.99%, and the driving cost is reduced by 17.76%, 8.51%, and 7.12%, respectively, under each usage scenario.

A Novel Minimal-Cost Power Allocation Strategy for Fuel Cell Hybrid Buses Based on Deep Reinforcement Learning Algorithms

Health-conscious deep reinforcement learning energy management for fuel cell buses integrating environmental and look-ahead road information

A novel health-aware deep reinforcement learning energy management for fuel cell bus incorporating offline high-quality experience

Total travel costs minimization strategy of a dual-stack fuel cell logistics truck enhanced with artificial potential field and deep reinforcement learning

Research on energy management strategy of fuel cell hybrid power via an improved TD3 deep reinforcement learning

A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses

Health-aware energy management strategy for fuel cell hybrid bus considering air-conditioning control based on TD3 algorithm

Energy Management with Adaptive Moving Average Filter and Deep Deterministic Policy Gradient Reinforcement Learning for Fuel Cell Hybrid Electric Vehicles

Optimal online energy management strategy of a fuel cell hybrid bus via reinforcement learning

Multi-objective energy management strategy for a dual-stack fuel cell heavy-duty truck via deep reinforcement learning

Longevity-conscious energy management strategy of fuel cell hybrid electric Vehicle Based on deep reinforcement learning

Energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles using deep reinforcement learning with action trimming

Transfer Deep Reinforcement Learning-Based Energy Management Strategy for Plug-In Hybrid Electric Heavy-Duty Trucks under Segmented Usage Scenarios

Learning-based model predictive energy management for fuel cell hybrid electric bus with health-aware control

Twin delayed deep deterministic policy gradient based energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles considering predicted terrain information

Data-driven reinforcement-learning-based hierarchical energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles

A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle

An Intelligent Energy Management Strategy for Hybrid Vehicle with Irrational Actions Using Twin Delayed Deep Deterministic Policy Gradient

A novel energy management strategy of hybrid electric vehicle via an improved TD3 deep reinforcement learning

Research on energy management strategy of heavy-duty fuel cell hybrid vehicles based on dueling-double-deep Q-network

A reinforcement learning-based energy management strategy for fuel cell hybrid vehicle considering real-time velocity prediction