Abstract:As for fuel cell hybrid electric vehicle equipped with battery (BAT) and ultracapacitor (UC), its dynamic topology structure is complex and different characteristics of three power sources induce challenges in energy management for fuel economy, power sources lifespan, and dynamic performance of the vehicle. In this paper, an energy management strategy (EMS) based on a hierarchical power splitting structure and deep reinforcement learning (DRL) is proposed. In the higher layer strategy of the proposed EMS, the UC is employed to supply peak power and recover braking energy through the adaptive filter based on fuzzy control. Then, the integrated DRL and equivalent consumption minimization strategy framework is proposed to optimize the power allocation of fuel cell (FC) and BAT in the lower layer, to ensure the highly efficient operation of FC and reduce hydrogen consumption. And the action trimming based on heuristic technique is proposed to further restrain the adverse effect of sudden peak power on FC lifespan. The simulation results show the proposed EMS can make the output of FC smoother, improve its working efficiency to alleviate the stress of BAT, and increase by 14.8% compared with the Q-learning strategy in fuel economy under WLTP driving cycle. Meanwhile, the obtained results under UDDSHDV show fuel economy of the proposed EMS can reach dynamic programming (DP) benchmark level of 89.7<span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0" height="0.343ex" style="vertical-align: -0.171ex;" viewBox="0 -73.8 0 147.5" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"></g></svg></span>.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"></defs></svg>

Rule and Q-learning Based Hybrid Energy Management for Electric Vehicle

Enhanced Q-learning for real-time hybrid electric vehicle energy management with deterministic rule

Battery life constrained real-time energy management strategy for hybrid electric vehicles based on reinforcement learning

Reinforcement learning-based real-time power management for hybrid energy storage system in the plug-in hybrid electric vehicle

Meta Rule-Based Energy Management Strategy for Battery/supercapacitor Hybrid Electric Vehicles

An Adaptive Fuzzy Logic-Based Energy Management Strategy on Battery/Ultracapacitor Hybrid Electric Vehicles

Deep reinforcement learning-based energy management of hybrid battery systems in electric vehicles

Data-driven reinforcement-learning-based hierarchical energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles

A reinforcement learning-based energy management strategy for fuel cell hybrid vehicle considering real-time velocity prediction

A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle

Energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles using deep reinforcement learning with action trimming

Energy management for hybrid electric vehicles based on imitation reinforcement learning

Energy consumption and battery aging minimization using a Q-learning strategy for a battery/ultracapacitor electric vehicle

Parameterized deep Q-network based energy management with balanced energy economy and battery life for hybrid electric vehicles

Neural Network and Reinforcement Learning Based Energy Management Strategy for Battery/Supercapacitor HEV

Adaptive real-time energy management strategy using heuristic search for off-road hybrid electric vehicles

Q-Learning-based Fuzzy Energy Management for Fuel Cell/supercapacitor HEV.

Optimal online energy management strategy of a fuel cell hybrid bus via reinforcement learning

An efficient intelligent energy management strategy based on deep reinforcement learning for hybrid electric flying car

A Hierarchical Energy Control Strategy for Hybrid Electric Vehicle with Fuel Cell/Battery/Ultracapacitor Combining Fuzzy Controller and Status Regulator

An Energy Management Strategy Based on DDPG with Improved Exploration for Battery/Supercapacitor Hybrid Electric Vehicle