Abstract:In this article, plug‐in hybrid electric vehicles are focused on and an energy management strategy with clutch engagement control based on continuous‐discrete reinforcement learning (RL) is proposed. The hybrid system is modeled from the perspective of mixed‐integer programming, with state‐of‐charge randomization introduced during the training process. In the comparative analysis, the optimal control performance of RL is shown. Energy management strategy (EMS) is a key technology for plug‐in hybrid electric vehicles (PHEVs). The energy management of certain series–parallel PHEVs involves the control of continuous variables, such as engine torque, and discrete variables, such as clutch engagement/disengagement. Herein, a control‐oriented model is established for a series–parallel plug‐in hybrid system with clutch engagement control from the perspective of mixed‐integer programming. Subsequently, an EMS based on continuous‐discrete reinforcement learning (CDRL), which enables simultaneous output of continuous and discrete variables, is designed. During training, state‐of‐charge (SOC) randomization is introduced to ensure that the hybrid system exhibits optimal energy‐saving performance in both high and low SOC. Finally, the effectiveness of the proposed CDRL strategy is verified by comparing EMS based on charge‐depleting charge‐sustaining (CD‐CS) with rule‐based clutch engagement control and dynamic programming (DP). In the simulation results, it is shown that, under a high SOC, the CDRL strategy proposed in this article can improve energy efficiency by 8.3% compared to CD‐CS, and the energy consumption is just 6.6% higher than the global optimum based on DP, while under a low SOC, the numbers are 4.1% and 3.9%, respectively.

Energy Management for Hybrid Electric Vehicles Using Safe Hybrid-Action Reinforcement Learning

Deep Reinforcement Learning based Energy Management for Heavy Duty HEV considering Discrete-Continuous Hybrid Action Space

Supplementary Learning Control for Energy Management Strategy of Hybrid Electric Vehicles at Scale

High robustness energy management strategy of hybrid electric vehicle based on improved soft actor-critic deep reinforcement learning

Battery life constrained real-time energy management strategy for hybrid electric vehicles based on reinforcement learning

Human-like Energy Management Based on Deep Reinforcement Learning and Historical Driving Experiences

An Energy Management Strategy of Power-Split Hybrid Electric Vehicles Using Reinforcement Learning

Energy management for hybrid electric vehicles based on imitation reinforcement learning

Plug-in Hybrid Electric Vehicle Energy Management with Clutch Engagement Control via Continuous-Discrete Reinforcement Learning

Energy Management of a Plug-in Hybrid Electric Vehicle Using Bayesian Optimization and Soft Actor-Critic Algorithm

A Novel Energy Management Strategy in Electric Vehicle Based on H∞ Self-Gain Scheduled for Linear Parameter Varying Systems

Safe Deep Reinforcement Learning-Based Constrained Optimal Control Scheme for HEV Energy Management

Self-supervised reinforcement learning-based energy management for a hybrid electric vehicle

Adaptive real-time energy management strategy using heuristic search for off-road hybrid electric vehicles

Cooperative energy management and eco-driving of plug-in hybrid electric vehicle via multi-agent reinforcement learning

Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change

An adaptive hierarchical energy management strategy for hybrid electric vehicles combining heuristic domain knowledge and data-driven deep reinforcement learning

A reinforcement learning-based energy management strategy for fuel cell hybrid vehicle considering real-time velocity prediction

An improved soft actor-critic-based energy management strategy of heavy-duty hybrid electric vehicles with dual-engine system

Deep Reinforcement Learning-Based Energy Management for a Series Hybrid Electric Vehicle Enabled by History Cumulative Trip Information

Plug‐In Hybrid Electric Vehicle Energy Management with Clutch Engagement Control via Continuous‐Discrete Reinforcement Learning