Abstract:Lane change decision-making is a complex task due to intricate vehicle-vehicle and vehicle-infrastructure interactions. Existing algorithms for lane-change control often depend on vehicles with a certain level of autonomy (e.g., autonomous or connected autonomous vehicles). To address the challenges posed by low penetration rates of autonomous vehicles and the high costs of precise data collection, this study proposes a dynamic lane change regulation design based on multi-agent reinforcement learning (MARL) to enhance freeway traffic efficiency. The proposed framework leverages multi-lane macroscopic traffic models that describe spatial-temporal dynamics of the density and speed for each lane. Lateral traffic flow between adjacent lanes, resulting from aggregated lane-changing behaviors, is modeled as source terms exchanged between the partial differential equations (PDEs). We propose a lane change regulation strategy using MARL, where one agent is placed at each discretized lane grid. The state of each agent is represented by aggregated vehicle attributes within its grid, generated from the SUMO microscopic simulation environment. The agent's actions are lane-change regulations for vehicles in its grid. Specifically, lane-change regulation signals are computed at a centralized traffic management center and then broadcast to connected vehicles in the corresponding lane grids. Compared to vehicle-level maneuver control, this approach achieves a higher regulation rate by leveraging vehicle connectivity while introducing no critical safety concerns, and accommodating varying levels of connectivity and autonomy within the traffic system. The proposed model is simulated and evaluated in varied traffic scenarios and demand conditions. Experimental results demonstrate that the method improves overall traffic efficiency with minimal additional energy consumption while maintaining driving safety.

Introducing Liveness into Multi-lane Spatial Logic lane change controllers using UPPAAL

A Lane Changing Time Point and Path Tracking Framework for Autonomous Ground Vehicle

A Reinforcement Learning Approach to Smart Lane Changes of Self-driving Cars

A Dynamic Trajectory Planning Method for Lane-Changing Maneuver of Connected and Automated Vehicles

Developing Smart Lane-changing Strategies for CAVs on Freeways based on MOBIL and Reinforcement Learning

Modeling lane changing behavior using fuzzy logic

Reinforcement Learning for Freeway Lane-Change Regulation via Connected Vehicles

CommonUppRoad: A Framework of Formal Modelling, Verifying, Learning, and Visualisation of Autonomous Vehicles

Autonomous lane-change controller via mixed logical dynamical

LC-LLM: Explainable Lane-Change Intention and Trajectory Predictions with Large Language Models

LCS-TF: Multi-Agent Deep Reinforcement Learning-Based Intelligent Lane-Change System for Improving Traffic Flow

A Long-Short-Term Mixed-Integer Formulation for Highway Lane Change Planning

An Improved Hierarchical Deep Reinforcement Learning Algorithm for Multi-Intelligent Vehicle Lane Change

UCLF: an Uncertainty-Aware Cooperative Lane-Changing Framework for Connected Autonomous Vehicles in Mixed Traffic.

Extending Urban Multi-Lane Spatial Logic to Formalise Road Junction Rules

Formal Verification of Platoon Control Strategies

Enforcing Timing Properties in Motorway Traffic

Chance-Aware Lane Change with High-Level Model Predictive Control Through Curriculum Reinforcement Learning

Autonomous lane-change controller

A Game Theory-based Model Predictive Controller for Mandatory Lane Change of Multiple Vehicles

Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change