Abstract:Reinforcement learning (RL) based techniques have been employed for the tracking and adaptive cruise control of a small-scale vehicle with the aim to transfer the obtained knowledge to a full-scale intelligent vehicle in the near future. Unlike most other control techniques, the purpose of this study is to seek a practical method that enables the vehicle, in the real environment and in real time, to learn the control behavior on its own while adapting to the changing circumstances. In this context, it is necessary to design an algorithm that symmetrically considers both time efficiency and accuracy. Meanwhile, in order to realize adaptive cruise control specifically, a set of symmetrical control actions consisting of steering angle and vehicle speed needs to be optimized simultaneously. In this paper, firstly, the experimental setup of the small-scale intelligent vehicle is introduced. Subsequently, three model-free RL algorithm are conducted to develop and finally form the strategy to keep the vehicle within its lanes at constant and top velocity. Furthermore, a model-based RL strategy is compared that incorporates learning from real experience and planning from simulated experience. Finally, a Q-learning based adaptive cruise control strategy is intermixed to the existing tracking control architecture to allow the vehicle slow-down in the curve and accelerate on straightaways. The experimental results show that the Q-learning and Sarsa (λ) algorithms can achieve a better tracking behavior than the conventional Sarsa, and Q-learning outperform Sarsa (λ) in terms of computational complexity. The Dyna-Q method performs similarly with the Sarsa (λ) algorithms, but with a significant reduction of computational time. Compared with a fine-tuned proportion integration differentiation (PID) controller, the good-balanced Q-learning is seen to perform better and it can also be easily applied to control problems with over one control actions.

Autonomous Driving Vehicle Control Auto-Calibration System: An Industry-Level, Data-Driven and Learning-based Vehicle Longitudinal Dynamic Calibrating Algorithm

A Long-focus Camera and Telemetry LiDAR Calibration for Rapid Transit Equipment.

Autonomous Vehicle Control Through the Dynamics and Controller Learning

Adaptive Learning-Based Path-Tracking Control for Unknown Vehicle Systems under Performance Optimization

Online Active Set-Based Longitudinal and Lateral Model Predictive Tracking Control of Electric Autonomous Driving

Longitudinal robust dynamic programming control for driving robot vehicles with performance self-learning

Online Camera-to-ground Calibration for Autonomous Driving

Longitudinal Hierarchical Control of Autonomous Vehicle Based on Deep Reinforcement Learning and PID Algorithm

Model-free Adaptive Control Based Lateral Control of Self-driving Car

Reinforcement Learning Approach to Design Practical Adaptive Control for a Small-Scale Intelligent Vehicle

An intelligent human-machine interaction-based longitudinal control strategy for autonomous vehicles

Data-Driven Trajectory Tracking Control Algorithm Design for Fast Migration to Different Autonomous Vehicles

A multi-objective calibration framework for capturing the behavioral patterns of autonomously-driven vehicles

Human-like mechanism deep learning model for longitudinal motion control of autonomous vehicles

End-to-end adaptive cruise control based on timing network

Auto-calibration Method Using Stop Signs for Urban Autonomous Driving Applications

Identification and Learning in Autonomous Vehicle Control Systems

Finite-time Optimized Robust Control with Adaptive State Estimation Algorithm for Autonomous Heavy Vehicle

Adaptive Dynamic Surface Longitudinal Tracking Control of Autonomous Vehicles

Integrated longitudinal and lateral control for autonomous vehicles with active load transfer strategy at the handling limits

A Learning-Based Tune-Free Control Framework for Large Scale Autonomous Driving System Deployment