Abstract:This article describes the application of Reinforcement Learning (RL) with an embedded heuristic algorithm to a multi-objective hybrid vehicle optimization. A multi-objective optimization problem (MOP) is defined as a minimization of total energy consumption and trip time resulting from optimal control of vehicle speed over a known route. First, a computationally efficient heuristic optimization algorithm is formulated to solve the MOP for multiple traffic scenarios. Then, the off-line integration of RL is applied to the heuristic optimization algorithm process and utilized to solve the MOP. Finally, the online optimization capability of the machine learning algorithm is discussed, as well as its extension to the vehicle routing problem and the hybrid electric vehicle. The specific scenario investigated is where a generic vehicle begins a trip on a one-lane highway. The length of the highway and the number of vehicles and traffic signals on the road are generic as well. The vehicle must decide on the optimal sequence of speed (or acceleration/deceleration level) for each time step to minimize both the total energy consumption and trip time until it reaches the end of the route. The agent is assumed to be capable of sensing and estimating the relative speed and distance to other vehicles using advanced driver assistance systems (ADAS) sensors or through vehicle-to-vehicle (V2V) communications. Vehicle-to-infrastructure (V2I) communication is assumed for all vehicles so that location of traffic signals and their signal times are known in advance. The constraints in the optimization include speed limits, no traffic signal violation, and no collision with other vehicles. For the three traffic scenarios, the achieved energy savings by the heuristic algorithm is between 11% and 17% compared to the average consumption in kilowatt-hour (kWh) of the design of experiments (DOE) type of traffic simulation.

Reinforcement Learning‐Based Co‐Optimization of Adaptive Cruise Speed Control and Energy Management for Fuel Cell Vehicles

Integrated Motion and Powertrain Predictive Control of Intelligent Fuel Cell/Battery Hybrid Vehicles

Research on Energy Management of Hydrogen Fuel Cell Bus Based on Deep Reinforcement Learning Considering Velocity Control

A Reinforcement Learning Algorithm for Speed Optimization and Optimal Energy Management of Advanced Driver Assistance Systems and Connected Vehicles

A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses

Reinforcement learning-based energy management strategies of fuel cell hybrid vehicles with multi-objective control

A reinforcement learning-based energy management strategy for fuel cell hybrid vehicle considering real-time velocity prediction

Predictive Energy Management for Fuel Cell Hybrid Vehicles Considering Efficiency and Safety

Safe Deep Reinforcement Learning-Based Constrained Optimal Control Scheme for HEV Energy Management

Nonlinear Model Predictive Cruise Control of Hybrid Electric Vehicle

Adaptive optimal control strategy of fuel economy for fuel cell battery storage system using in HEV applications

Energy-Oriented Hybrid Cooperative Adaptive Cruise Control for Fuel Cell Electric Vehicle Platoons

Economy-oriented vehicle adaptive cruise control with coordinating multiple objectives function

Co-Optimization of Adaptive Cruise Control and Hybrid Electric Vehicle Energy Management via Model Predictive Mixed Integer Control

Minimum Fuel Consumption Strategy in Autonomous Adaptive Cruise Control Scenarios

Optimization-Driven Powertrain-Oriented Adaptive Cruise Control to Improve Energy Saving and Passenger Comfort

Integrated Longitudinal Speed Decision-Making and Energy Efficiency Control for Connected Electrified Vehicles

Hierarchical eco-driving control strategy for connected automated fuel cell hybrid vehicles and scenario-/hardware-in-the loop validation

Optimization-oriented adaptive equivalent consumption minimization strategy based on short-term demand power prediction for fuel cell hybrid vehicle

Trip distance adaptive power prediction control strategy optimization for a Plug-in Fuel Cell Electric Vehicle

Energy Management Strategy of Fuel Cell Commercial Vehicles Based on Adaptive Rules