Abstract:Because of the high-power demand of fuel cell hybrid vehicles, a multi-stack fuel cell system (MFCS) composed of multiple low-power fuel cell stacks (FCSs) instead of a high-power one has become a satisfactory solution. This is due to the modularity of MFCS, which is more reliable and durable. However, the hybrid power system (MHPSS) of an MFCS hybrid electric vehicle possesses not only MFCS, but also batteries to improve the dynamic performance of MHPSS. Due to the difference in characteristics of MFCS and battery, the energy management strategy (EMS) of MHPSS is the key of ensuring its safe and efficient operation. However, most of the existing MHPSS EMSs are complicated in design and complex to compute online. Besides, they also do not consider the robustness of EMS, that is, EMS has the ability to guarantee the safe operation of MHPSS when the MFCS fails. To solve the above problems, this paper proposes an EMS based on independent Q-learning (IQL) which is an algorithm of multi-agent reinforcement learning to maintain battery state of charge (SOC) and minimize hydrogen consumption. The proposed EMS is not only simple in design, but also can guarantee the normal operation of the MHPSS when the MFCS fails, and can be transplanted to execute online on a microcontroller unit or a field programmable gate array. The various parts of the MHPSS model are first built, then the IQL strategy (IQLS) is trained offline in the established model environment, and finally, the IQLS is ported to the hardware-in-the-loop platform for validation. In order to verify the effectiveness of the proposed EMS, the solution of dimensionality-reduced DP is also used to calculate the fuel economy. Through the experimental verification under different initial SOC and driving cycles, it can be seen that the IQLS proposed in this paper can achieve the goal of maintaining battery SOC and minimizing hydrogen consumption, and also has good generalization ability and safe operation ability under fault conditions.

Research on energy management strategy of heavy-duty fuel cell hybrid vehicles based on dueling-double-deep Q-network

Research on energy management strategy of fuel cell hybrid power via an improved TD3 deep reinforcement learning

Longevity-conscious energy management strategy of fuel cell hybrid electric Vehicle Based on deep reinforcement learning

A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle

Reinforcement learning-based energy management strategies of fuel cell hybrid vehicles with multi-objective control

A Double‐Deep Q‐Network‐Based Energy Management Strategy for Hybrid Electric Vehicles under Variable Driving Cycles

Total travel costs minimization strategy of a dual-stack fuel cell logistics truck enhanced with artificial potential field and deep reinforcement learning

Reinforcement Learning-Based Energy Management for Fuel Cell Electrical Vehicles Considering Fuel Cell Degradation

Multi-objective energy management strategy for a dual-stack fuel cell heavy-duty truck via deep reinforcement learning

Energy Management with Adaptive Moving Average Filter and Deep Deterministic Policy Gradient Reinforcement Learning for Fuel Cell Hybrid Electric Vehicles

A Novel Minimal-Cost Power Allocation Strategy for Fuel Cell Hybrid Buses Based on Deep Reinforcement Learning Algorithms

Health-conscious deep reinforcement learning energy management for fuel cell buses integrating environmental and look-ahead road information

Energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles using deep reinforcement learning with action trimming

A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses

Online energy management strategy for ammonia-hydrogen hybrid electric vehicles harnessing deep reinforcement learning

Deep reinforcement learning based energy management strategy for range extend fuel cell hybrid electric vehicle

Optimal online energy management strategy of a fuel cell hybrid bus via reinforcement learning

A Reinforcement Learning Energy Management Strategy for Fuel Cell Hybrid Electric Vehicles Considering Driving Condition Classification

Parameterized deep Q-network based energy management with balanced energy economy and battery life for hybrid electric vehicles

A novel health-aware deep reinforcement learning energy management for fuel cell bus incorporating offline high-quality experience

Online energy management strategy considering fuel cell fault for multi-stack fuel cell hybrid vehicle based on multi-agent reinforcement learning