Abstract:Lane changing behavior has a significant impact on traffic efficiency and may lead to traffic delays or even accidents. It is important to plan a safe and efficient lane-changing trajectory that coordinates with the surrounding environment. Most conventional lane-changing models need to establish and solve constrained optimization models during the whole process, while reinforcement learning can just take the current state as input and directly output actions to vehicles. This study develops a lane-changing model using the deep deterministic policy gradient method, which can simultaneously control the lateral and longitudinal motions of the vehicle. To optimize its performance, a reward function is properly designed by combining safety, efficiency, gap, headway, and comfort features. To avoid collisions, a safety modification model is developed to check and correct acceleration at every time step. The driving trajectory data of 1169 lane-changing scenarios extracted from the Next Generation Simulation (NGSIM) dataset are used to train and test the model. The proposed model can quickly converge in training phase. Testing results show it can complete safe and efficient lane changing in different lane-changing scenarios with both shorter time headway and lane-changing duration than human drivers. Compared with the conventional dynamic lane-changing trajectory planning model, our model can reduce collision risk. It is also evaluated in automated and nonautomated mixed traffic in SUMO. Simulation results show that the proposed model also has a positive effect on the average speed of overall traffic flow.

Highway Exiting Planner for Automated Vehicles Using Reinforcement Learning

Rollout-Based Interactive Motion Planning for Automated Vehicles *

Developing Smart Lane-changing Strategies for CAVs on Freeways based on MOBIL and Reinforcement Learning

A Dynamic Trajectory Planning Method for Lane-Changing Maneuver of Connected and Automated Vehicles

A Reinforcement Learning Approach to Smart Lane Changes of Self-driving Cars

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

A Novel Dynamic Lane-Changing Trajectory Planning Model for Automated Vehicles Based on Reinforcement Learning

An efficient planning method based on deep reinforcement learning with hybrid actions for autonomous driving on highway

An Evolutionary Learning Framework of Lane-Changing Control for Autonomous Vehicles at Freeway Off-Ramps

Integrating Deep Reinforcement Learning with Optimal Trajectory Planner for Automated Driving.

Multi-Vehicles Decision-Making in Interactive Highway Exit: A Graph Reinforcement Learning Approach

Merging Planning in Dense Traffic Scenarios Using Interactive Safe Reinforcement Learning

Development of an Efficient Driving Strategy for Connected and Automated Vehicles at Signalized Intersections: A Reinforcement Learning Approach

Dynamic motion planner with trajectory optimisation for automated highway lane‐changing driving

Combining Decision Making and Trajectory Planning for Lane Changing Using Deep Reinforcement Learning

Monte-Carlo Tree Search for Behavior Planning in Autonomous Driving

A Multi-Agent Reinforcement Learning Approach For Safe and Efficient Behavior Planning Of Connected Autonomous Vehicles

A multi-agent reinforcement learning-based longitudinal and lateral control of CAVs to improve traffic efficiency in a mandatory lane change scenario

Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions using Reinforcement Learning

Highway Decision-Making and Motion Planning for Autonomous Driving via Soft Actor-Critic

Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning