Abstract:<p>A model used for velocity control during car following is proposed based on reinforcement learning (RL). To optimize driving performance, a reward function is developed by referencing human driving data and combining driving features related to safety, efficiency, and comfort. With the developed reward function, the RL agent learns to control vehicle speed in a fashion that maximizes cumulative rewards, through trials and errors in the simulation environment. To avoid potential unsafe actions, the proposed RL model is incorporated with a collision avoidance strategy for safety checks. The safety check strategy is used during both model training and testing phases, which results in faster convergence and zero collisions. A total of 1,341 car-following events extracted from the Next Generation Simulation (NGSIM) dataset are used to train and test the proposed model. The performance of the proposed model is evaluated by the comparison with empirical NGSIM data and with adaptive cruise control (ACC) algorithm implemented through model predictive control (MPC). The experimental results show that the proposed model demonstrates the capability of safe, efficient, and comfortable velocity control and outperforms human drivers in that it 1) has larger TTC values than those of human drivers, 2) can maintain efficient and safe headways around 1.2s, and 3) can follow the lead vehicle comfortably with smooth acceleration (jerk value is only a third of that of human drivers). Compared with the MPC-based ACC algorithm, the proposed model has better performance in terms of safety, comfort, and especially running speed during testing (more than 200 times faster). The results indicate that the proposed approach could contribute to the development of better autonomous driving systems. Source code of this paper can be found at <a href="https://github.com/MeixinZhu/Velocity_control">https://github.com/MeixinZhu/Velocity_control</a>.</p>

Adaptive velocity control of an autonomous vehicle using input–error model reference approach

Predictive Control Method of Autonomous Vehicle Based on Tracking-error Model

Adaptive robust control algorithm for enhanced path-tracking performance of automated driving in critical scenarios

Adaptive Estimation of Vehicle Velocity From Updated Dynamic Model for Control of Anti-Lock Braking System

Model Reference Adaptive Control during Mode Transition of a Parallel Hybrid Electric Vehicle

Internal Model-Based Robust Path-Following Control for Autonomous Vehicles

Data-driven design of model-free control for reference model tracking based on an ultra-local model: Application to vehicle yaw rate control

A Novel Adaptive Steering Torque Control Approach for Human–Machine Cooperation Autonomous Vehicles

Speed-Adaptive Model-Free Path-Tracking Control for Autonomous Vehicles: Analysis and Design

Integrated robust control of path following and lateral stability for autonomous in-wheel-motor-driven electric vehicles

Model Reference Adaptive Control Based on Adjustable Reference Model during Mode Transition for Hybrid Electric Vehicles

Speed-Adaptive Model-Free Lateral Control for Automated Cars

A Data-Driven Model-Reference Adaptive Control Approach Based on Reinforcement Learning

Smooth longitudinal driving strategy with adjustable nonlinear reference model for autonomous vehicles

A Fault-Tolerant Control Strategy for Distributed Drive Electric Vehicles Based on Model Reference Adaptive Control

Simulation and Optimization of a Reference Adaptive Control Model for a Gough-Stewart Platform

Asymptotically stable adaptive control for automobile active suspension system

RISE-Based Integrated Motion Control of Autonomous Ground Vehicles with Asymptotic Prescribed Performance

Learning-Based Control of Autonomous Vehicles Using an Adaptive Neuro-Fuzzy Inference System and the Linear Matrix Inequality Approach

Research on Intelligent Vehicle Trajectory Tracking Control Based on Improved Adaptive MPC

Safe, efficient, and comfortable velocity control based on reinforcement learning for autonomous driving