Abstract:In this paper, platoons of autonomous vehicles operating in urban road networks are considered. From a methodological point of view, the problem of interest consists of formally characterizing vehicle state trajectory tubes by means of routing decisions complying with traffic congestion criteria. To this end, a novel distributed control architecture is conceived by taking advantage of two methodologies: deep reinforcement learning and model predictive control. On one hand, the routing decisions are obtained by using a distributed reinforcement learning algorithm that exploits available traffic data at each road junction. On the other hand, a bank of model predictive controllers is in charge of computing the more adequate control action for each involved vehicle. Such tasks are here combined into a single framework: the deep reinforcement learning output (action) is translated into a set-point to be tracked by the model predictive controller; conversely, the current vehicle position, resulting from the application of the control move, is exploited by the deep reinforcement learning unit for improving its reliability. The main novelty of the proposed solution lies in its hybrid nature: on one hand it fully exploits deep reinforcement learning capabilities for decision-making purposes; on the other hand, time-varying hard constraints are always satisfied during the dynamical platoon evolution imposed by the computed routing decisions. To efficiently evaluate the performance of the proposed control architecture, a co-design procedure, involving the SUMO and MATLAB platforms, is implemented so that complex operating environments can be used, and the information coming from road maps (links, junctions, obstacles, semaphores, etc.) and vehicle state trajectories can be shared and exchanged. Finally by considering as operating scenario a real entire city block and a platoon of eleven vehicles described by double-integrator models, several simulations have been performed with the aim to put in light the main features of the proposed approach. Moreover, it is important to underline that in different operating scenarios the proposed reinforcement learning scheme is capable of significantly reducing traffic congestion phenomena when compared with well-reputed competitors.

Kernel-based planning and imitation learning control for flow smoothing in mixed autonomy traffic

A Shared Control Approach for Autonomous Vehicles via Driver Behaviors Learning

Adaptive Vehicle Platooning with Joint Network-Traffic Approach

Traffic Smoothing Controllers for Autonomous Vehicles Using Deep Reinforcement Learning and Real-World Trajectory Data

Integrated Behavior Planning and Motion Control for Autonomous Vehicles with Traffic Rules Compliance

An Adaptive Control Framework for Mixed Autonomy Traffic Platoon

Interaction-aware Traffic Prediction and Scenario-based Model Predictive Control for Autonomous Vehicles on Highways

Merging Planning in Dense Traffic Scenarios Using Interactive Safe Reinforcement Learning

Cooperative control of a platoon of connected autonomous vehicles and unconnected human‐driven vehicles

Active Learning with Dual Model Predictive Path-Integral Control for Interaction-Aware Autonomous Highway On-ramp Merging

Bringing Diversity to Autonomous Vehicles: An Interpretable Multi-vehicle Decision-making and Planning Framework

Reinforcement learning-based adaptive speed controllers in mixed autonomy condition

Hierarchical Speed Planner for Automated Vehicles: A Framework for Lagrangian Variable Speed Limit in Mixed Autonomy Traffic

A Fast Integrated Planning and Control Framework for Autonomous Driving via Imitation Learning

Path Planning and Cooperative Control for Automated Vehicle Platoon Using Hybrid Automata

NeuroFlow: Development of lightweight and efficient model integration scheduling strategy for autonomous driving system

Autonomous Vehicle Platoons in Urban Road Networks: A Joint Distributed Reinforcement Learning and Model Predictive Control Approach

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

Enabling Mixed Autonomy Traffic Control

Decentralized Robust Data-driven Predictive Control for Smoothing Mixed Traffic Flow

Cooperative platoon control for a mixed traffic flow including human drive vehicles and connected and autonomous vehicles