Implementation of Real-Time Energy Management Strategy Based on Reinforcement Learning for Hybrid Electric Vehicles and Simulation Validation

Zehui Kong,Yuan Zou,Teng Liu
DOI: https://doi.org/10.1371/journal.pone.0180491
IF: 3.7
2017-01-01
PLoS ONE
Abstract:To further improve the fuel economy of series hybrid electric tracked vehicles, a reinforcement learning (RL)-based real-time energy management strategy is developed in this paper. In order to utilize the statistical characteristics of online driving schedule effectively, a recursive algorithm for the transition probability matrix (TPM) of power-request is derived. The reinforcement learning (RL) is applied to calculate and update the control policy at regular time, adapting to the varying driving conditions. A facing-forward powertrain model is built in detail, including the engine-generator model, battery model and vehicle dynamical model. The robustness and adaptability of real-time energy management strategy are validated through the comparison with the stationary control strategy based on initial transition probability matrix (TPM) generated from a long naturalistic driving cycle in the simulation. Results indicate that proposed method has better fuel economy than stationary one and is more effective in real-time control.
What problem does this paper attempt to address?