Abstract:Energy management strategy (EMS) is a way to reduce the energy consumption of hybrid power systems. This article proposes a unique deep reinforcement learning- (DRL-) based EMS for plug-in hybrid electric heavy-duty trucks (PHETs), combining driving cycle pattern recognition (DPR) and deep transfer learning (DTL). The proposed EMS can cope well with the complex usage scenarios of PHETs and the difficulty of generating EMS. While ensuring the minimum overall driving cost, the strategy can improve the convergence speed of the DRL method and the generalizability under segmented usage scenarios. Firstly, representative driving cycles that reflect different usage scenarios are constructed based on a naturalistic data-driven method. Secondly, a plug-in hybrid electric heavy-duty truck (PHET) driving pattern recognizer based on a learning vector quantization neural network (LVQ) is built. Thirdly, the deep deterministic policy gradient (DDPG) algorithm is innovatively combined with the DTL algorithm. The pretrained neural network in the corresponding usage scenarios is transferred to the natural driving cycles based on DTL. Moreover, the proposed EMS gives an emphasized consciousness on the battery degradation cost. Finally, the strategy is tested under natural driving cycles in different usage scenarios and proven through comparison with the current state-of-the-art techniques, deep reinforcement learning-based strategy, and dynamic programming (DP). The results show that the proposed strategy outperforms existing cutting-edge deep reinforcement learning techniques in terms of convergence speed, battery life extension, fuel consumption, and overall driving cost reduction. The proposed control strategy can improve the convergence speed by nearly 50%, while effectively extending the battery life and reducing the overall driving cost compared to the existing state-of-the-art strategies. The battery degradation rate is reduced by 48.46%, 57.95%, and 36.99%, and the driving cost is reduced by 17.76%, 8.51%, and 7.12%, respectively, under each usage scenario.

Entire Route Eco-Driving Method for Electric Bus Based on Rule-Based Reinforcement Learning

Energy Management Strategy for Plug-in Hybrid Electric Bus with Evolutionary-Reinforcement Learning Method

A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses

Eco-driving for Electric Connected Vehicles at Signalized Intersections: A Parameterized Reinforcement Learning approach

Overcoming driving challenges in complex urban traffic: A multi-objective eco-driving strategy via safety model based reinforcement learning

Eco-driving at signalized intersections: a parameterized reinforcement learning approach

Safe Deep Reinforcement Learning-Based Constrained Optimal Control Scheme for HEV Energy Management

A Hybrid Dynamic Programming-Rule Based Algorithm for Real-Time Energy Optimization of Plug-in Hybrid Electric Bus

Energy-saving speed profile planning for a connected and automated electric bus considering motor characteristic

Data-Driven Battery-Lifetime-Aware Scheduling for Electric Bus Fleets

Energy-optimal routing for electric vehicles using deep reinforcement learning with transformer

Transfer Deep Reinforcement Learning-Based Energy Management Strategy for Plug-In Hybrid Electric Heavy-Duty Trucks under Segmented Usage Scenarios

Driving Pattern Recognition and Energy Management for Extended Range Electric Bus

Intelligent Route Planning Recommendation for Electric Bus Transport

A novel health-aware deep reinforcement learning energy management for fuel cell bus incorporating offline high-quality experience

Design Method of a Power Management Strategy for Variable Battery Capacities Range-Extended Electric Vehicles to Improve Energy Efficiency and Cost-Effectiveness

The effects investigation of data-driven fitting cycle and deep deterministic policy gradient algorithm on energy management strategy of dual-motor electric bus

Real-Time Battery Thermal Management for Electric Vehicles Based on Deep Reinforcement Learning

Hybrid Reinforcement Learning-Based Eco-Driving Strategy for Connected and Automated Vehicles at Signalized Intersections

A hybrid on-line approach for predicting the energy consumption of electric buses based on vehicle dynamics and system identification

Safety and Economic Evaluations of Electric Public Buses Based on Driving Behavior