Abstract:In the last few years, researchers have applied machine learning strategies in the context of vehicular platoons to increase the safety and efficiency of cooperative transportation. Reinforcement Learning methods have been employed in the longitudinal spacing control of Cooperative Adaptive Cruise Control systems, but to date, none of those studies have addressed problems of disturbance rejection in such scenarios. Characteristics such as uncertain parameters in the model and external interferences may prevent agents from reaching null-spacing errors when traveling at cruising speed. On the other hand, complex communication topologies lead to specific training processes that can not be generalized to other contexts, demanding re-training every time the configuration changes. Therefore, in this paper, we propose an approach to generalize the training process of a vehicular platoon, such that the acceleration command of each agent becomes independent of the network topology. Also, we have modeled the acceleration input as a term with integral action, such that the Artificial Neural Network is capable of learning corrective actions when the states are disturbed by unknown effects. We illustrate the effectiveness of our proposal with experiments using different network topologies, uncertain parameters, and external forces. Comparative analyses, in terms of the steady-state error and overshoot response, were conducted against the state-of-the-art literature. The findings offer new insights concerning generalization and robustness of using Reinforcement Learning in the control of autonomous platoons.

An Adaptive Longitudinal Platooning Design Based on Concurrent Learning

Cooperative Distributed Predictive Control for Collision-Free Vehicle Platoons

Adaptive Vehicle Platooning with Joint Network-Traffic Approach

Nonlinear Consensus-Based Connected Vehicle Platoon Control Incorporating Car-Following Interactions and Heterogeneous Time Delays.

Longitudinal Platoon Control of Connected Vehicles: Analysis and Verification

Scalable and Resilient Platooning Control of Cooperative Automated Vehicles

Hierarchical Lane-Changing Control for Vehicle Platoons in Prescribed Performance

An integrated longitudinal and lateral control of vehicle platoons

Self Learning-Based Platooning Control Strategy for Connected Autonomous Vehicles with Switching Topologies

Safeguard Vehicle Platooning Based on Resilient Control Against False Data Injection Attacks

Towards Safe and Robust Autonomous Vehicle Platooning: A Self-Organizing Cooperative Control Framework

Multiple-Model Switching Control of Vehicle Longitudinal Dynamics for Platoon-Level Automation.

Safe and Efficient Cooperative Platooning

Online Data-driven Input Mapping Mixed Platoon Control with Variable Order Model

Distributed MPC of Vehicle Platoons Considering Longitudinal and Lateral Coupling

Robust Longitudinal Control for Vehicular Autonomous Platoons Using Deep Reinforcement Learning

Potential Field-Based Cooperative Adaptive Cruising Control for Longitudinal Following and Lane Changing of Vehicle Platooning

Observer-based event-triggered adaptive platooning control for autonomous vehicles with motion uncertainties

Data-Driven Cooperative Adaptive Cruise Control for Unknown Nonlinear Vehicle Platoons

A Novel Vehicle Platoon Following Controller Based on Deep Deterministic Policy Gradient Algorithms

Learning-Based Platooning Control of Automated Vehicles via Multiple Description Encoding Mechanisms