Abstract:Temperature can significantly affect the water equilibrium, electrochemical kinetics and mass transmission in a proton exchange membrane fuel cell (PEMFC) stack, meanwhile it also impacts the lifespan and safety of a lithium-ion battery (LIB). Yet, energy management strategy (EMS) is rarely to synchronously study the durability performances of the LIB and PEMFC stack with their thermal effects in fuel cell vehicles (FCVs) under real-world driving scenarios. Thus, this study proposes a deep reinforcement learning (DRL)-based EMS to minimize tran-sient costs of the LIB and PEMFC stack, which include their state-of-health (SOH) descents and overtemperature penalties. Meanwhile, the transient costs are incorporated into the overall cost, which comprises the hydrogen consumption rate of the PEMFC stack, and penalty of maintaining the LIB state-of-charge (SOC). Moreover, the soft actor-critic (SAC) is applied to the DRL-based EMS due to its advantage of stability across different random environments and no meticulous hyperparameter calibration. Specifically, the proposed EMS intelligently allo-cates the direct current (DC) bus power of FCVs in real time to maximize a multi-objective reward in accordance with FCV states, in which the reward is the negative overall cost. Then, long-term real-world driving scenarios in Chongqing city, China, are used for off-line training and real-time control to advance the adaptability of the proposed EMS. The results show that in comparison with the deep Q-network (DQN)-based EMS considering the powertrain temperature and durability, and the SAC-based EMS neglecting the powertrain temperature and durability, the proposed strategy can actualize overall SOH increments of the powertrain up to 14.01 % and 3.45 %, respectively, and restrict the maximum temperatures of the PEMFC stack and LIB. In addition, the general-ization of the proposed EMS is verified, in which the trained model of the proposed EMS is tested in other FCV and driving cycles, and it can acquire similar effectiveness. Thus, the proposed strategy can enforce the lifespan durability and thermal stability of the powertrain system.

Research on energy management strategy of fuel cell hybrid power via an improved TD3 deep reinforcement learning

Battery-degradation-involved energy management strategy based on deep reinforcement learning for fuel cell/battery/ultracapacitor hybrid electric vehicle

Longevity-conscious energy management strategy of fuel cell hybrid electric Vehicle Based on deep reinforcement learning

Health-conscious deep reinforcement learning energy management for fuel cell buses integrating environmental and look-ahead road information

Twin Delayed Deep Deterministic Policy Gradient-Based Deep Reinforcement Learning for Energy Management of Fuel Cell Vehicle Integrating Durability Information of Powertrain

A novel energy management strategy of hybrid electric vehicle via an improved TD3 deep reinforcement learning

A Novel Minimal-Cost Power Allocation Strategy for Fuel Cell Hybrid Buses Based on Deep Reinforcement Learning Algorithms

High-Frequency Limitation Deep Reinforcement Learning Based Energy Management Strategy for Dual Fuel Cell Electric Aircraft

Reinforcement learning-based energy management strategies of fuel cell hybrid vehicles with multi-objective control

A novel health-aware deep reinforcement learning energy management for fuel cell bus incorporating offline high-quality experience

Energy management strategy of fuel cell vehicles with hybrid energy sources: A novel framework via deep reinforcement learning and transfer learning

Research on energy management strategy of heavy-duty fuel cell hybrid vehicles based on dueling-double-deep Q-network

Energy management strategy based on an improved TD3 reinforcement algorithm with novel experience replay

A Novel Data-Driven Energy Management Strategy for Fuel Cell Hybrid Electric Bus Based on Improved Twin Delayed Deep Deterministic Policy Gradient Algorithm

A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle

Energy Management Strategy for Fuel Cell Vehicles Via Soft Actor-Critic-based Deep Reinforcement Learning Considering Powertrain Thermal and Durability Characteristics

Reinforcement Learning-Based Energy Management for Fuel Cell Electrical Vehicles Considering Fuel Cell Degradation

A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses

Lifespan-consciousness and Minimum-Consumption Coupled Energy Management Strategy for Fuel Cell Hybrid Vehicles Via Deep Reinforcement Learning

Energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles using deep reinforcement learning with action trimming

Data-driven reinforcement-learning-based hierarchical energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles