Abstract:As for fuel cell hybrid electric vehicle equipped with battery (BAT) and ultracapacitor (UC), its dynamic topology structure is complex and different characteristics of three power sources induce challenges in energy management for fuel economy, power sources lifespan, and dynamic performance of the vehicle. In this paper, an energy management strategy (EMS) based on a hierarchical power splitting structure and deep reinforcement learning (DRL) is proposed. In the higher layer strategy of the proposed EMS, the UC is employed to supply peak power and recover braking energy through the adaptive filter based on fuzzy control. Then, the integrated DRL and equivalent consumption minimization strategy framework is proposed to optimize the power allocation of fuel cell (FC) and BAT in the lower layer, to ensure the highly efficient operation of FC and reduce hydrogen consumption. And the action trimming based on heuristic technique is proposed to further restrain the adverse effect of sudden peak power on FC lifespan. The simulation results show the proposed EMS can make the output of FC smoother, improve its working efficiency to alleviate the stress of BAT, and increase by 14.8% compared with the Q-learning strategy in fuel economy under WLTP driving cycle. Meanwhile, the obtained results under UDDSHDV show fuel economy of the proposed EMS can reach dynamic programming (DP) benchmark level of 89.7<span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0" height="0.343ex" style="vertical-align: -0.171ex;" viewBox="0 -73.8 0 147.5" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"></g></svg></span>.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"></defs></svg>

Energy Management with Adaptive Moving Average Filter and Deep Deterministic Policy Gradient Reinforcement Learning for Fuel Cell Hybrid Electric Vehicles

Ga Based Fc/Sc Fuzzy Energy Management System Considering H-2 Consumption And Loading Variation

Battery-degradation-involved energy management strategy based on deep reinforcement learning for fuel cell/battery/ultracapacitor hybrid electric vehicle

High-Frequency Limitation Deep Reinforcement Learning Based Energy Management Strategy for Dual Fuel Cell Electric Aircraft

A Hierarchical Energy Control Strategy for Hybrid Electric Vehicle with Fuel Cell/Battery/Ultracapacitor Combining Fuzzy Controller and Status Regulator

A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle

Data-driven reinforcement-learning-based hierarchical energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles

Integrated velocity optimization and energy management for FCHEV: An eco-driving approach based on deep reinforcement learning

Optimal energy management strategy based on neural network algorithm for fuel cell hybrid vehicle considering fuel cell lifetime and fuel consumption

Energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles using deep reinforcement learning with action trimming

Research on energy management strategy of fuel cell hybrid power via an improved TD3 deep reinforcement learning

A Novel Minimal-Cost Power Allocation Strategy for Fuel Cell Hybrid Buses Based on Deep Reinforcement Learning Algorithms

Energy management strategy based on convex optimization for fuel cell/battery/ultracapacitor hybrid vehicle

Improving fuel economy and performance of a fuel-cell hybrid electric vehicle (fuel-cell, battery, and ultra-capacitor) using optimized energy management strategy

Safety and Longevity-Enhanced Energy Management of Fuel Cell Hybrid Electric Vehicle with Machine Learning Approach

Twin Delayed Deep Deterministic Policy Gradient-Based Deep Reinforcement Learning for Energy Management of Fuel Cell Vehicle Integrating Durability Information of Powertrain

Twin delayed deep deterministic policy gradient based energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles considering predicted terrain information

Health-conscious deep reinforcement learning energy management for fuel cell buses integrating environmental and look-ahead road information

Reliable Energy Optimization Strategy for Fuel Cell Hybrid Electric Vehicles Considering Fuel Cell and Battery Health

Total travel costs minimization strategy of a dual-stack fuel cell logistics truck enhanced with artificial potential field and deep reinforcement learning

Energy management strategy of fuel cell vehicles with hybrid energy sources: A novel framework via deep reinforcement learning and transfer learning