Abstract:By using kinematic state information obtained through vehicle‐to‐vehicle communications, connected autonomous vehicles (CAVs) can drive cooperatively to alleviate shockwave propagation associated with traffic disturbances. However, during the transition to full autonomy, CAVs and human‐driven vehicles (HDVs) will coexist on the road, creating mixed‐flow traffic. The inherent heterogeneity and randomness in human driving behavior can generate additional disturbances in the traffic flow. Further, HDVs without communication functionality (unconnected HDVs) can cause the control performance of CAVs to degrade by negatively impacting platoon formation. To proactively mitigate the negative impacts of HDVs in mixed‐flow traffic, this study proposes a cooperative control strategy with three components for platoons consisting of CAVs and unconnected HDVs: (i) a number estimator for estimating the number of HDVs between two CAVs, (ii) a kinematic state predictor for predicting the kinematic states of HDVs, and (iii) a multi‐anticipative car‐following controller (i.e., control strategy using kinematic state information of multiple preceding vehicles) for CAVs to maintain string stability and desired time headway. To initialize the proposed strategy, the number estimator is developed using a deep neural network (DNN). Then, a DNN‐based kinematic state predictor predicts the kinematic states of HDVs for CAVs to enable multi‐anticipative car‐following control. The multi‐anticipative car‐following controller is implemented using an extended intelligent driver model‐guided deep deterministic policy gradient algorithm, which ensures safety, string stability, and traffic efficiency. The effectiveness of the proposed control strategy is validated through numerical experiments using NGSIM data. Results indicate that the proposed strategy can produce accurate estimations of the number and the kinematic states of HDVs between CAVs. Further, it can achieve string stability while maintaining smaller time headways, compared to car‐following models used for training guidance under different market penetration rates of CAVs, which significantly improves traffic smoothness and mobility.

A Multi-agent Reinforcement Learning Based Control Method for Connected and Autonomous Vehicles in A Mixed Platoon

Robustness Analysis of Platoon Control for Mixed Types of Vehicles

Enforcing Cooperative Safety for Reinforcement Learning-based Mixed-Autonomy Platoon Control

Augmented Mixed Vehicular Platoon Control with Dense Communication Reinforcement Learning for Traffic Oscillation Alleviation

Distributed Cooperative Control and Optimization of Connected Automated Vehicles Platoon Against Cut-in Behaviors of Social Drivers

Predictive Information Multiagent Deep Reinforcement Learning for Automated Truck Platooning Control

Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning

Mixed platoon control of automated and human-driven vehicles at a signalized intersection: Dynamical analysis and optimal control

A Reinforcement Learning-Based Vehicle Platoon Control Strategy for Reducing Energy Consumption in Traffic Oscillations

An Adaptive Control Framework for Mixed Autonomy Traffic Platoon

Cooperative control of a platoon of connected autonomous vehicles and unconnected human‐driven vehicles

Learning the Policy for Mixed Electric Platoon Control of Automated and Human-Driven Vehicles at Signalized Intersection: A Random Search Approach

Safety Guaranteed Robust Multi-Agent Reinforcement Learning with Hierarchical Control for Connected and Automated Vehicles

Improving safety in mixed traffic: A learning-based model predictive control for autonomous and human-driven vehicle platooning

Robust Distributed Model Predictive Control of Multi-Platoon Leader in Mixed Traffic

Driver-centric data-driven robust model predictive control for mixed vehicular platoon

Path Planning and Cooperative Control for Automated Vehicle Platoon Using Hybrid Automata

Towards Safe and Robust Autonomous Vehicle Platooning: A Self-Organizing Cooperative Control Framework

A Multi-Agent Reinforcement Learning Approach For Safe and Efficient Behavior Planning Of Connected Autonomous Vehicles

Communication-Efficient Decentralized Multi-Agent Reinforcement Learning for Cooperative Adaptive Cruise Control