Abstract:Because of the high-power demand of fuel cell hybrid vehicles, a multi-stack fuel cell system (MFCS) composed of multiple low-power fuel cell stacks (FCSs) instead of a high-power one has become a satisfactory solution. This is due to the modularity of MFCS, which is more reliable and durable. However, the hybrid power system (MHPSS) of an MFCS hybrid electric vehicle possesses not only MFCS, but also batteries to improve the dynamic performance of MHPSS. Due to the difference in characteristics of MFCS and battery, the energy management strategy (EMS) of MHPSS is the key of ensuring its safe and efficient operation. However, most of the existing MHPSS EMSs are complicated in design and complex to compute online. Besides, they also do not consider the robustness of EMS, that is, EMS has the ability to guarantee the safe operation of MHPSS when the MFCS fails. To solve the above problems, this paper proposes an EMS based on independent Q-learning (IQL) which is an algorithm of multi-agent reinforcement learning to maintain battery state of charge (SOC) and minimize hydrogen consumption. The proposed EMS is not only simple in design, but also can guarantee the normal operation of the MHPSS when the MFCS fails, and can be transplanted to execute online on a microcontroller unit or a field programmable gate array. The various parts of the MHPSS model are first built, then the IQL strategy (IQLS) is trained offline in the established model environment, and finally, the IQLS is ported to the hardware-in-the-loop platform for validation. In order to verify the effectiveness of the proposed EMS, the solution of dimensionality-reduced DP is also used to calculate the fuel economy. Through the experimental verification under different initial SOC and driving cycles, it can be seen that the IQLS proposed in this paper can achieve the goal of maintaining battery SOC and minimizing hydrogen consumption, and also has good generalization ability and safe operation ability under fault conditions.

Decentralized Convex Optimization-Based Energy Management Strategy for Modular Heavy-Duty Fuel Cell Vehicles

Optimization-based energy management strategy for a fuel cell/battery hybrid power system

Energy management strategy based on convex optimization for fuel cell/battery/ultracapacitor hybrid vehicle

Multi-Objective Optimization-Based Health-Conscious Predictive Energy Management Strategy for Fuel Cell Hybrid Electric Vehicles

Online energy management system for a fuel cell/battery hybrid system with multiple fuel cell stacks

Efficient Multidimensional Dynamic Programming-Based Energy Management Strategy for Global Composite Operating Cost Minimization for Fuel Cell Trams

An Online Energy Management Strategy For Multi-Fuel Cell Stacks Systems Using Remaining Useful Life Prognostic

A Modified MPC-Based Optimal Strategy of Power Management for Fuel Cell Hybrid Vehicles

An energy management scheme for improving the fuel economy of a fuel cell/battery/supercapacitor-based hybrid electric vehicle using the coyote optimization algorithm (COA)

A Novel Dual-Model MPC-based Energy Management Strategy for Fuel Cell Electric Vehicle

Multi-objective energy management strategy for a dual-stack fuel cell heavy-duty truck via deep reinforcement learning

Reliable Energy Optimization Strategy for Fuel Cell Hybrid Electric Vehicles Considering Fuel Cell and Battery Health

Real-time optimization strategy by using sequence quadratic programming with multivariate nonlinear regression for a fuel cell electric vehicle

Multi-Objective Optimization For Energy Management Of Fuel Cell Hybrid Electric Vehicles

Online Health-Conscious Energy Management Strategy for a Hybrid Multi-Stack Fuel Cell Vehicle Based on Game Theory

Online energy management strategy considering fuel cell fault for multi-stack fuel cell hybrid vehicle based on multi-agent reinforcement learning

Energy Management with Adaptive Moving Average Filter and Deep Deterministic Policy Gradient Reinforcement Learning for Fuel Cell Hybrid Electric Vehicles

A Hierarchical Optimizing Energy Management Strategy for Alleviating Degradation in Fuel Cell Hybrid System

An Online Efficiency Optimized Energy Management Strategy for Fuel Cell Hybrid Electric Vehicles

Completely Decentralized Energy Management System for Fuel Cell-Battery-Ultracapacitor Hybrid Energy Storage System

A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle