Abstract:Autonomous racing creates challenging control problems, but Model Predictive Control (MPC) has made promising steps toward solving both the minimum lap-time problem and head-to-head racing. Yet, accurate models of the system are necessary for model-based control, including models of vehicle dynamics and opponent behavior. Both dynamics model error and opponent behavior can be modeled with Gaussian Process (GP) regression. GP models can be updated iteratively from data collected using the controller, but the strength of the GP model depends on the diversity of the training data. We propose a novel active exploration mechanism for iterative GP regression that purposefully collects additional data at regions of higher uncertainty in the GP model. In the exploration, a MPC collects diverse data by balancing the racing objectives and the exploration criterion; then the GP is re-trained. The process is repeated iteratively; in later iterations, the exploration is deactivated, and only the racing objectives are optimized. Thus, the MPC can achieve better performance by leveraging the improved GP model. We validate our approach in the highly realistic racing simulation platform Gran Turismo Sport of Sony Interactive Entertainment Inc for a minimum lap time challenge, and in numerical simulation of head-to-head. Our active exploration mechanism yields a significant improvement in the GP prediction accuracy compared to previous approaches and, thus, an improved racing performance.

Cautious Model Predictive Control Using Gaussian Process Regression

Gaussain Process-based MPC for DC Motor Servo System with State Constraints and Load Disturbance

Active Design of Dynamic GP Models for Model Predictive Control Using Expected Improvement

Learning For Predictive Control: A Dual Gaussian Process Approach

A Tutorial on Gaussian Process Learning-based Model Predictive Control

Implementable Stability Guaranteed Lyapunov-Based Data-Driven Model Predictive Control with Evolving Gaussian Process

Towards safe and tractable Gaussian process-based MPC: Efficient sampling within a sequential quadratic programming framework

Adaptive Stochastic Model Predictive Control of Linear Systems Using Gaussian Process Regression

Gaussian Process-Based Learning Model Predictive Control with Application to USV

Model Predictive Control with Gaussian-Process-Supported Dynamical Constraints for Autonomous Vehicles

Enhanced Gaussian Process Regression for Active Learning Model-based Predictive Control

Active Exploration in Iterative Gaussian Process Regression for Uncertainty Modeling in Autonomous Racing

Design of Model Predictive Control for Time-Varying Nonlinear System Based on Gaussian Process Regression Modeling

Stochastic Error Bounds in Nonlinear Model Predictive Control with Gaussian Processes via Parameter-Varying Embeddings

Learning-Based Design of Off-Policy Gaussian Controllers: Integrating Model Predictive Control and Gaussian Process Regression

Adaptive Robust Control of Uncertain Euler-Lagrange Systems Using Gaussian Processes.

Safety Enhancement for Nonlinear Systems Via Learning-Based Model Predictive Control with Gaussian Process Regression

Gaussian Process Based Model Predictive Control for Overtaking in Autonomous Driving

Gaussian Process Model Predictive Control of An Unmanned Quadrotor

Online Learning of Interaction Dynamics with Dual Model Predictive Control for Multi-Agent Systems Using Gaussian Processes

Hybrid Gaussian Process Modeling Applied to Economic Stochastic Model Predictive Control of Batch Processes