Abstract:This study aims to answer the key question for hybrid electric vehicles (HEVs) on how to manage the power flow in HEVs with recent intelligent and electrified upgrades in automotive industries. The new energy management strategy (EMS) needs to fuse both the physic and cyber systems, reflecting the dynamic vehicle system in the physical layer, as well as taking full advantage of the outside information in the cyber layer. Given that, this article proposes the cyber-physical system (CPS)-based EMS using deep reinforcement learning (DRL) in two different types of vehicles [hybrid electric bus (HEB) and Prius]. Under the proposed framework, exploratory training is carried out for the EMS which is mediated by DRL algorithms, expert prior knowledge and multistate of traffic information. Then, the prior valid knowledge trained by HEB is applied to Prius based on deep transfer learning, accelerating the new EMS convergence and ensuring the same initial parameters of the two vehicles' deep neural networks. Moreover, the cyber information is decoupled from the vehicle itself, for the first time being visualized for comparative analysis. The results show a significant improvement by considering traffic states (TS) and using dynamic programming (DP) as a benchmark with 6.94% fuel economy improvement for deep deterministic policy gradients (DDPG) test results and 8.12% for deep Q-learning (DQL), respectively. The decoupling analysis distinguished the effect of various TS for the HEB and Prius due to their different characteristics in vehicle service, driving style, and vehicle structures, which further verifies the effectiveness of the proposed EMS.

Intelligent Learning Algorithm and Intelligent Transportation-Based Energy Management Strategies for Hybrid Electric Vehicles: A Review

Deep Reinforcement Learning-Based Energy Management for Hybrid Electric Vehicles

Recent Progress in Energy Management of Connected Hybrid Electric Vehicles Using Reinforcement Learning

Deep Reinforcement Learning Based Energy Management Strategies for Electrified Vehicles: Recent Advances and Perspectives

A Comparative Study of Deep Reinforcement Learning Based Energy Management Strategy for Hybrid Electric Vehicle

An Improved Energy Management Strategy for Hybrid Electric Vehicles Integrating Multistates of Vehicle-Traffic Information

Efficient Energy Management Strategy for Hybrid Electric Vehicles/plug-in Hybrid Electric Vehicles: Review and Recent Advances under Intelligent Transportation System

A novel energy management strategy of hybrid electric vehicle via an improved TD3 deep reinforcement learning

Human-like Energy Management Based on Deep Reinforcement Learning and Historical Driving Experiences

Energy management for hybrid electric vehicles based on imitation reinforcement learning

A review of reinforcement learning based energy management systems for electrified powertrains: Progress, challenge, and potential solution

Deep Reinforcement Learning for Intelligent Energy Management Systems of Hybrid-Electric Powertrains: Recent Advances, Open Issues, and Prospects

Energy Management Strategy Based on Deep Reinforcement Learning and Speed Prediction for Power-Split Hybrid Electric Vehicle with Multidimensional Continuous Control

Research on Deep Reinforcement Learning-based Intelligent Car-following Control and Energy Management Strategy for Hybrid Electric Vehicles

An adaptive hierarchical energy management strategy for hybrid electric vehicles combining heuristic domain knowledge and data-driven deep reinforcement learning

A Comprehensive Review on Classification, Energy Management Strategy, and Control Algorithm for Hybrid Electric Vehicles

Battery life constrained real-time energy management strategy for hybrid electric vehicles based on reinforcement learning

Distributed Deep Reinforcement Learning-Based Energy and Emission Management Strategy for Hybrid Electric Vehicles.

Data-driven transferred energy management strategy for hybrid electric vehicles via deep reinforcement learning

Energy Management Strategy Based on Deep Reinforcement Learning and Speed Prediction for Power‐split Hybrid Electric Vehicle with Multi‐dimensional Continuous Control

Energy Management for a Hybrid Electric Vehicle Based on Blended Reinforcement Learning with Backward Focusing and Prioritized Sweeping