Abstract:Cooperative on-ramp merging control for connected and automated vehicles (CAVs) can effectively improve traffic throughput and vehicle fuel efficiency at highway on-ramp merging bottlenecks. However, in the mixed traffic scenario where CAVs and human-driven vehicles (HDVs) coexist, the uncertain maneuvers of human drivers pose a major challenge to merging control in terms of safety and flexibility. To this end, this paper proposes a hierarchical cooperative on-ramp merging control strategy for CAVs to optimize flexible trajectories with safety guarantees in mixed traffic. First, the on-ramp merging control problem for CAVs is considered in the case of a three-vehicle coordination, resulting in an optimal control problem (OCP) coordinating on-ramp and main-lane CAVs for efficient operation while satisfying multiple safety-critical constraints. Second, a two-level hierarchical control architecture is developed to solve the OCP with mixed state-control constraints. The upper-level planner solves an unconstrained OCP with Pontryagin’s Minimum Principle to calculate an expected merging position, which is embedded in the variable time headway of safe merging constraints in the lower-level controller. Then, the controller converts the nonlinear OCP with safety-critical constraints to a quadratic programing (QP) problem by exploiting Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). By solving the QP efficiently, the time and energy efficient trajectory for each CAV is obtained. In addition, a receding horizon control framework is employed, which enables CAVs to determine flexible merging opportunity and tackle the disturbances caused by HDVs. Finally, comprehensive simulation results show that the proposed cooperative on-ramp merging strategy has potential in enabling merging flexibility, improving traffic efficiency and energy economy in real time.

Cooperative Highway Work Zone Merge Control Based on Reinforcement Learning in a Connected and Automated Environment

Enhancing Cooperation of Vehicle Merging Control in Heavy Traffic Using Communication-Based Soft Actor-Critic Algorithm

Multi-Vehicle Cooperative Decision-Making in Merging Area Based on Deep Multi-Agent Reinforcement Learning

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

Battery-aware cooperative merging strategy of connected electric vehicles based on reinforcement learning with hindsight experience replay

Decentralized Cooperative Lane Changing at Freeway Weaving Areas Using Multi-Agent Deep Reinforcement Learning

A Cooperative Control Algorithm for Real-time On-ramp Merging of Connected and Automated Vehicles

On the Impact of Cooperative Autonomous Vehicles in Improving Freeway Merging: A Modified Intelligent Driver Model-Based Approach

Combining Reinforcement Learning with Model Predictive Control for On-Ramp Merging

Cooperative Group Control Strategy in the on-Ramp Area for Connected and Automated Vehicles under Mixed Traffic Environment

Autonomous Ramp Merge Maneuver Based on Reinforcement Learning with Continuous Action Space

Novel Decision-Making Strategy for Connected and Autonomous Vehicles in Highway On-Ramp Merging

Spatio-temporal cooperative control Method of Highway Ramp Merge Based on Vehicle-road Coordination

A Cooperative Merging Control Method for Freeway Ramps in Connected and Autonomous Driving

Deep Multi-agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic

Safety-Critical and Flexible Cooperative On-Ramp Merging Control of Connected and Automated Vehicles in Mixed Traffic

Connected and Automated Vehicles in Mixed-Traffic: Learning Human Driver Behavior for Effective On-Ramp Merging

A Hierarchical Model-Based Optimization Control Approach for Cooperative Merging by Connected Automated Vehicles

RACE-SM: Reinforcement Learning Based Autonomous Control for Social On-Ramp Merging

Cooperative lane-changing in mixed traffic: a deep reinforcement learning approach

Cooperative Merging Strategy for Connected Vehicles at Highway On-Ramps