Abstract:In this paper, platoons of autonomous vehicles operating in urban road networks are considered. From a methodological point of view, the problem of interest consists of formally characterizing vehicle state trajectory tubes by means of routing decisions complying with traffic congestion criteria. To this end, a novel distributed control architecture is conceived by taking advantage of two methodologies: deep reinforcement learning and model predictive control. On one hand, the routing decisions are obtained by using a distributed reinforcement learning algorithm that exploits available traffic data at each road junction. On the other hand, a bank of model predictive controllers is in charge of computing the more adequate control action for each involved vehicle. Such tasks are here combined into a single framework: the deep reinforcement learning output (action) is translated into a set-point to be tracked by the model predictive controller; conversely, the current vehicle position, resulting from the application of the control move, is exploited by the deep reinforcement learning unit for improving its reliability. The main novelty of the proposed solution lies in its hybrid nature: on one hand it fully exploits deep reinforcement learning capabilities for decision-making purposes; on the other hand, time-varying hard constraints are always satisfied during the dynamical platoon evolution imposed by the computed routing decisions. To efficiently evaluate the performance of the proposed control architecture, a co-design procedure, involving the SUMO and MATLAB platforms, is implemented so that complex operating environments can be used, and the information coming from road maps (links, junctions, obstacles, semaphores, etc.) and vehicle state trajectories can be shared and exchanged. Finally by considering as operating scenario a real entire city block and a platoon of eleven vehicles described by double-integrator models, several simulations have been performed with the aim to put in light the main features of the proposed approach. Moreover, it is important to underline that in different operating scenarios the proposed reinforcement learning scheme is capable of significantly reducing traffic congestion phenomena when compared with well-reputed competitors.

Platoon Control in Traffic Networks: New Challenges And Opportunities

Adaptive Vehicle Platooning with Joint Network-Traffic Approach

Cooperative Distributed Predictive Control for Collision-Free Vehicle Platoons

Platoon Control of Connected Vehicles from a Networked Control Perspective: Literature Review, Component Modeling, and Controller Synthesis

Coordinating Vehicle Platoons for Highway Bottleneck Decongestion and Throughput Improvement

Autonomous Vehicle Platoons in Urban Road Networks: A Joint Distributed Reinforcement Learning and Model Predictive Control Approach

A platoon-based eco-driving control mechanism for low-density traffic flow

A Controller for Network-Assisted CACC based Platooning

Traffic Scheduling and Control in Fully Connected and Automated Networks

A Platoon Formation Framework in a Mixed Traffic Environment

Real-time Traffic Impedance and Priority Based Cooperative Path Planning Mechanism for SOC-ITS: Efficiency and Equilibrium

Cooperative platoon control for a mixed traffic flow including human drive vehicles and connected and autonomous vehicles

An Adaptive Traffic-Flow Management System with a Cooperative Transitional Maneuver for Vehicular Platoons

Cooperative Driving of Heterogeneous Uncertain Nonlinear Connected and Autonomous Vehicles via Distributed Switching Robust PID-like Control

A Platoon-Based Cooperative Optimal Control for Connected Autonomous Vehicles at Highway On-Ramps under Heavy Traffic

Evaluating Traffic Efficiency and Safety by Varying Truck Platoon Characteristics in a Critical Traffic Situation

Traffic Control Via Platoons of Intelligent Vehicles for Saving Fuel Consumption in Freeway Systems

Hindrance-Aware Platoon Formation for Connected Vehicles in Mixed Traffic

Mixed platoon control of automated and human-driven vehicles at a signalized intersection: Dynamical analysis and optimal control

Distributed platoon assignment and lane selection for traffic flow optimization

Adaptive Control of Interconnected Networked Systems with Application to Heterogeneous Platooning