Abstract:As connectivity and sensing technologies become more mature, automated vehicles can predict future driving situations and utilize this information to drive more energy-efficiently than human-driven vehicles. However, future information beyond the limited connectivity and sensing range is difficult to predict and utilize, limiting the energy-saving potential of energy-efficient driving. Thus, we combine a conventional speed optimization planner, developed in our previous work, and reinforcement learning to propose a real-time intelligent speed optimization planner for connected and automated vehicles. We briefly summarize the conventional speed optimization planner with limited information, based on closed-form energy-optimal solutions, and present its multiple parameters that determine reference speed trajectories. Then, we use a deep reinforcement learning (DRL) algorithm, such as a deep Q-learning algorithm, to find the policy of how to adjust these parameters in real-time to dynamically changing situations in order to realize the full potential of energy-efficient driving. The model-free DRL algorithm, based on the experience of the system, can learn the optimal policy through iteratively interacting with different driving scenarios without increasing the limited connectivity and sensing range. The training process of the parameter adaptation policy exploits a high-fidelity simulation framework that can simulate multiple vehicles with full powertrain models and the interactions between vehicles and their environment. We consider intersection-approaching scenarios where there is one traffic light with different signal phase and timing setup. Results show that the learned optimal policy enables the proposed intelligent speed optimization planner to properly adjust the parameters in a piecewise constant manner, leading to additional energy savings without increasing total travel time compared to the conventional speed optimization planner.

A Fast Optimal Speed Planning System in Arterial Roads for Intelligent and Connected Vehicles.

A Safety-Enhanced Eco-Driving Strategy for Connected and Autonomous Vehicles: A Hierarchical and Distributed Framework

Speed Planning for Autonomous Driving in Dynamic Urban Driving Scenarios

Energy-Efficient Speed Planning for Autonomous Driving in Dynamic Traffic Scenarios

Dynamic path-speed planning algorithm for autonomous driving on structured roads

A Dynamic Temporal and Spatial Speed Control Strategy for Partially Connected Automated Vehicles at a Signalized Arterial

An Economical Velocity Planning Algorithm for Intelligent Connected Electric Vehicles Based on Real-Time Traffic Information

Speed Planning Strategy in Urban Environments Considering Passenger’s Preferences, Traffic Signals and Road Limits

Design and Comparison of Fuel-Saving Speed Planning Algorithms for Automated Vehicles.

Optimal Speed Planning and Collision Avoidance Control for Electric Vehicles Considering Traffic Lights

A Deep Reinforcement Learning Approach for Optimized Speed Planning of Connected and Autonomous Vehicles

Arterial Velocity Planning Based on Traffic Light Conditions for Driver Assist Driving System

Co-Optimization of Speed Planning and Power Management for Automated HEVs in Unstructured Road Scenarios

Energy-optimized adaptive cruise control strategy design at intersection for electric vehicles based on speed planning

A Real-Time Intelligent Speed Optimization Planner Using Reinforcement Learning

Toward a More Complete, Flexible, and Safer Speed Planning for Autonomous Driving via Convex Optimization

A Novel Speed Control Strategy for Electric Vehicles with Optimal Energy Consumption under Multiple Constraints

Hierarchical Speed Planner for Automated Vehicles: A Framework for Lagrangian Variable Speed Limit in Mixed Autonomy Traffic

Adaptive Speed Optimization Strategy at Signalized Intersections Based on the Penetration Rate of Connected Automated Vehicles

Dynamic Cooperative Speed Optimization at Signalized Arterials with Various Platoons

A Green Wave Ecological Global Speed Planning under the Framework of Vehicle–Road–Cloud Integration