Abstract:Deep reinforcement learning (DRL)-based energy management strategy (EMS) is attractive for fuel cell vehicle (FCV). Nevertheless, the fuel economy and lifespan durability of proton exchange membrane fuel cell (PEMFC) stack and lithium-ion battery (LIB) may not be synchronously optimized since transient degradation variations of PEMFC stack and LIB are not generally regarded for DRL-based EMSs. Furthermore, the inappropriate action space and the overestimated value function of DRL can lead to suboptimal EMS for on-line control. To this end, the objective of this research endeavors to formulate a twin delayed deep deterministic policy gradient (TD3)based EMS integrating durability information of PEMFC stack and LIB, which can interact with the vehicle operating states to continuously control the hybrid powertrain and limit the overestimation of DRL value function for ensuring maximum multi-objective reward at each moment. Unlike traditional DRL-based EMSs, the multi-objective reward function for this study is enlarged to incorporate the hydrogen consumption, state of charge (SOC)-sustaining penalty and transient lifespan degradation information of PEMFC stack and LIB in offline training and on-line control. The results demonstrate that the proposed EMS can drastically lessen the training time and computational burden. Meanwhile, in contrast with deep Q-network (DQN)-based and deep deterministic policy gradient (DDPG)-based EMSs in the various real-world urban and standard driving cycles, the proposed EMS can achieve hydrogen abatement at least 9.76% and 1.07%, and slow down total powertrain degradation at least 9.11% and 2.62%, respectively.

Deep reinforcement learning based energy management strategy for range extend fuel cell hybrid electric vehicle

High-Frequency Limitation Deep Reinforcement Learning Based Energy Management Strategy for Dual Fuel Cell Electric Aircraft

Longevity-conscious energy management strategy of fuel cell hybrid electric Vehicle Based on deep reinforcement learning

A reinforcement learning-based energy management strategy for fuel cell hybrid vehicle considering real-time velocity prediction

Safety and Longevity-Enhanced Energy Management of Fuel Cell Hybrid Electric Vehicle with Machine Learning Approach

Energy management strategy of fuel cell vehicles with hybrid energy sources: A novel framework via deep reinforcement learning and transfer learning

Data-driven reinforcement-learning-based hierarchical energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles

A Reinforcement Learning Energy Management Strategy for Fuel Cell Hybrid Electric Vehicles Considering Driving Condition Classification

Research on a Multi-Objective Hierarchical Prediction Energy Management Strategy for Range Extended Fuel Cell Vehicles

Longevity-aware Energy Management for Fuel Cell Hybrid Electric Bus Based on a Novel Proximal Policy Optimization Deep Reinforcement Learning Framework

Ecological Driving Strategy for Fuel Cell Hybrid Electric Vehicle Based on Continuous Deep Reinforcement Learning

Research on energy management strategy of fuel cell hybrid power via an improved TD3 deep reinforcement learning

Customized Energy Management for Fuel Cell Electric Vehicle Based on Deep Reinforcement Learning-Model Predictive Control Self-Regulation Framework

Reinforcement Learning-Based Energy Management for Fuel Cell Electrical Vehicles Considering Fuel Cell Degradation

Knowledge-guided Deep Reinforcement Learning for Multi-objective Energy Management of Fuel Cell Electric Vehicles

Lifespan-consciousness and Minimum-Consumption Coupled Energy Management Strategy for Fuel Cell Hybrid Vehicles Via Deep Reinforcement Learning

Battery-degradation-involved energy management strategy based on deep reinforcement learning for fuel cell/battery/ultracapacitor hybrid electric vehicle

A Novel Minimal-Cost Power Allocation Strategy for Fuel Cell Hybrid Buses Based on Deep Reinforcement Learning Algorithms

Deep Reinforcement Learning with Deep-Q-Network Based Energy Management for Fuel Cell Hybrid Electric Truck

Twin Delayed Deep Deterministic Policy Gradient-Based Deep Reinforcement Learning for Energy Management of Fuel Cell Vehicle Integrating Durability Information of Powertrain

A Novel Data-Driven Energy Management Strategy for Fuel Cell Hybrid Electric Bus Based on Improved Twin Delayed Deep Deterministic Policy Gradient Algorithm