Abstract:With the capability of intelligent control and communicating with surrounding vehicles and infrastructures, connected and automated vehicles (CAVs) can drive cooperatively and have more positive effects on traffic efficiency. Cooperative and real-time path planning for CAVs stands as a pivotal solution to mitigate traffic congestion and augment travel efficiency. However, most of the existing path planning schemes predominantly concentrate on minimizing the travel times of vehicles, sidelining the broader issue of alleviating traffic congestion in urban settings. Therefore, in this paper, we propose a novel collaborative vehicle path planning scheme, leveraging the intelligent control and the communicating ability of CAVs. The primary objective is to reduce traffic congestion within the overall transportation system and improve traffic efficiency. Specifically, we focus on a general urban scenario with various types of vehicles, including CAVs, connected vehicles (CVs), and traditional human-driven vehicles (TVs), To enhance traffic efficiency in such a scenario, we design a collaborative path planning scheme to discover the efficient paths for both CAVs as well as CVs. In this scheme, we treat each CAV as an agent and formulate the multiple CAVs' path-planning problem as a Markov game. To solve the above Markov game, we design a multi-agent convolutional attention reinforcement learning (MACA) framework to generate paths with minimal travel time for CAVs. More concretely, the proposed MACA framework incorporates a convolutional neural network (CNN) layer to capture spatial correlation behind traffic conditions. Additionally, a graph attention network (GAT) layer is employed to integrate the influence of neighboring agents during the path-planning process. To further reduce traffic congestion, we extend the MACA framework into a collaborative MACA (C-MACA) scheme in vehicular networks, where CAVs are empowered to periodically broadcast their path information to surrounding CVs, providing valuable insights for their path planning. Subsequently, to prevent new congestion caused by the aggregation of CVs, we design a heuristic algorithm for CVs to make informed path decisions. We build up a simulator based on a real-world city road map and conduct extensive experiments. The experimental results demonstrate that the proposed scheme can decrease CVs' travel time by up to 10.9 % and reduce the average queue length around junctions by up to 6.5 % over several state-of-the-art approaches, without sacrificing the travel efficiency of CAVs.

Leveraging CAVs to Improve Traffic Efficiency: an MARL-Based Approach

A Multi-Agent Reinforcement Learning Approach For Safe and Efficient Behavior Planning Of Connected Autonomous Vehicles

Balancing Computation Speed and Quality: A Decentralized Motion Planning Method for Cooperative Lane Changes of Connected and Automated Vehicles.

Leveraging the Capabilities of Connected and Autonomous Vehicles and Multi-Agent Reinforcement Learning to Mitigate Highway Bottleneck Congestion

Shared Information-Based Safe And Efficient Behavior Planning For Connected Autonomous Vehicles

Distributed Maneuver Planning with Connected and Automated Vehicles for Boosting Traffic Efficiency

Providing real-time en-route suggestions to CAVs for congestion mitigation: A two-way deep reinforcement learning approach

Dynamic lane changing trajectory planning for CAV: A multi-agent model with path preplanning

Optimization of Isolated Intersection Signal Timing and Trajectory Planning Under Mixed Traffic Environment: The Flexible Catalysis of Connected and Automated Vehicles

Autonomous Intersection Management with Heterogeneous Vehicles: A Multi-Agent Reinforcement Learning Approach

MARP: A Cooperative Multiagent DRL System for Connected Autonomous Vehicle Platooning

Hierarchical Optimal Maneuver Planning and Trajectory Control at On-Ramps With Multiple Mainstream Lanes

V2X Communication Assisted Hierarchical Path Planning for Connected and Automated Vehicles

Decentralized Optimal Coordination of Connected and Automated Vehicles for Multiple Traffic Scenarios

A multi-agent reinforcement learning-based longitudinal and lateral control of CAVs to improve traffic efficiency in a mandatory lane change scenario

Cooperative platoon forming strategy for connected autonomous vehicles in mixed traffic flow

Safety-Critical and Flexible Cooperative On-Ramp Merging Control of Connected and Automated Vehicles in Mixed Traffic

Ethics and Cooperative Optimization Scheme for CAVs with Velocity-Prioritized Emergency Vehicles at Signal-Free Intersections

Multi-objective coordinated control strategy for mixed traffic with partially connected and automated vehicles in urban corridors

Trajectory planning for connected and automated vehicles at isolated signalized intersections under mixed traffic environment

Towards Optimal Lane-changing Coordination of CAVs in Multi-lane Mixed Traffic Scenarios