Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle

Chunyang Qi,Yiwen Zhu,Chuanxue Song,Guangfu Yan,Feng Xiao,Da wang,Xu Zhang,Jingwei Cao,Shixin Song
DOI: https://doi.org/10.1016/j.energy.2021.121703
IF: 9
2022-01-01
Energy
Abstract:As the core technology of hybrid electric vehicles (HEVs), energy management strategy directly affects the fuel consumption of vehicles. This research proposes a novel reinforcement learning (RL)-based algorithm for energy management strategy of HEVs. Hierarchical structure is used in deep Q-learning algorithm (DQL-H) to get the optimal solution of energy management. Through this new RL method, we not only solve the problem of sparse reward in training process, but also achieve the optimal power distribution. In addition, as a kind of hierarchical algorithm, DQL-H can change the way of exploration of the vehicle environment and make it more effective. The experimental results show that the proposed DQL-H method realizes better training efficiency and lower fuel consumption, compared to other RL-based ones.
energy & fuels,thermodynamics
What problem does this paper attempt to address?