Abstract:In this letter, we propose a framework for adapting the controller's parameters based on learning optimal solutions from contextual black-box optimization problems. We consider a class of control design problems for dynamical systems operating in different environments or conditions represented by contextual parameters. The overarching goal is to identify the controller parameters that maximize the controlled system's performance, given different realizations of the contextual parameters. We formulate a contextual Bayesian optimization problem in which the solution is actively learned using Gaussian processes to approximate the controller adaptation strategy. We demonstrate the efficacy of the proposed framework with a simulation-to-real example. We learn the optimal weighting strategy of a model predictive control for connected and automated vehicles interacting with human-driven vehicles from simulations and then deploy it in a real-time experiment.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the adaptive adjustment of controller parameters when the dynamic system operates in different environments or conditions. Specifically, the authors propose a learning framework based on contextual Bayesian optimization (CBO) to adapt to the optimal controller settings under different environmental parameters. ### Problem Description In many practical applications, control systems need to operate under changing environmental or task conditions, such as different driving styles in automotive powertrain systems, the interaction between connected and autonomous vehicles and human - driven vehicles, etc. Traditional controller parameter - tuning methods usually assume that the system parameters are constant, which may not be applicable in practical applications. Therefore, this paper aims to solve the following problems: 1. **How to automatically adjust controller parameters according to different environmental or task conditions**: Traditional methods are difficult to deal with the situation where system parameters change over time and environment. 2. **How to maximize the performance of the control system under these changing conditions**: That is, to find the controller parameters that can make the system perform optimally in different situations. ### Solution To solve the above problems, the authors propose a learning framework based on contextual Bayesian optimization. The specific steps are as follows: - **Define context and optimization variables**: Consider the parameters of the system and the controller as context and optimization variables. Context parameters can include the operating set - points of the system, the weights in the cost function, the time - varying coefficients of the system dynamics, etc. - **Use Gaussian process to learn the latent mapping**: Use Gaussian processes (GPs) to learn the mapping relationship from the context to the optimal solution, so as to realize the adaptive adjustment of the controller parameters. - **Active sampling technique**: Adopt an adaptive sampling technique to select the most informative context samples to accelerate the learning process and improve the accuracy of the model. ### Application Example The authors verified the effectiveness of this framework through an example from simulation to practical application. Specifically, they learned the weight adjustment strategy of model predictive control (MPC) in a simulated environment and applied it to a real - time experiment, demonstrating the effectiveness of this method in dealing with the interaction between connected and autonomous vehicles and human - driven vehicles. ### Summary This research provides a new method to solve the problem of controller adaptive adjustment in dynamic systems under changing environments, and is especially suitable for application scenarios that require rapid response to environmental changes, such as the control of autonomous vehicles.

Controller Adaptation via Learning Solutions of Contextual Bayesian Optimization

Autonomous Vehicle Control Through the Dynamics and Controller Learning

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Learning-Based Neural Dynamic Surface Predictive Control for MMC

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

OCCAM: Online Continuous Controller Adaptation with Meta-Learned Models

Bayesian Learning-Based Adaptive Control for Safety Critical Systems

Contextual Tuning of Model Predictive Control for Autonomous Racing

Online Adaptation of Kernel Learning Adaptive Predictive Controller

Learning Based NMPC Adaptation for Autonomous Driving using Parallelized Digital Twin

Bayesian Learning Approach to Model Predictive Control

Hierarchical Meta-learning-based Adaptive Controller

A Safe Reinforcement Learning driven Weights-varying Model Predictive Control for Autonomous Vehicle Motion Control

Model-Assisted Probabilistic Safe Adaptive Control With Meta-Bayesian Learning

Violation-aware contextual Bayesian optimization for controller performance optimization with unmodeled constraints

A Bayesian optimization framework for the automatic tuning of MPC-based shared controllers

Context-aware LLM-based Safe Control Against Latent Risks

Learning-Based Multi-controller Coordination for Self-Optimization.

Learning-Based Design of Off-Policy Gaussian Controllers: Integrating Model Predictive Control and Gaussian Process Regression

Composite Adaptive Online Inverse Optimal Control Approach to Human Behavior Learning

Dream to Explore: Adaptive Simulations for Autonomous Systems