Abstract:We provide an algorithm for the simultaneous system identification and model predictive control of nonlinear systems. The algorithm has finite-time near-optimality guarantees and asymptotically converges to the optimal (non-causal) controller. Particularly, the algorithm enjoys sublinear dynamic regret, defined herein as the suboptimality against an optimal clairvoyant controller that knows how the unknown disturbances and system dynamics will adapt to its actions. The algorithm is self-supervised and applies to control-affine systems with unknown dynamics and disturbances that can be expressed in reproducing kernel Hilbert spaces. Such spaces can model external disturbances and modeling errors that can even be adaptive to the system's state and control input. For example, they can model wind and wave disturbances to aerial and marine vehicles, or inaccurate model parameters such as inertia of mechanical systems. The algorithm first generates random Fourier features that are used to approximate the unknown dynamics or disturbances. Then, it employs model predictive control based on the current learned model of the unknown dynamics (or disturbances). The model of the unknown dynamics is updated online using least squares based on the data collected while controlling the system. We validate our algorithm in both hardware experiments and physics-based simulations. The simulations include (i) a cart-pole aiming to maintain the pole upright despite inaccurate model parameters, and (ii) a quadrotor aiming to track reference trajectories despite unmodeled aerodynamic drag effects. The hardware experiments include a quadrotor aiming to track a circular trajectory despite unmodeled aerodynamic drag effects, ground effects, and wind disturbances.

Nonlinear Dual control based on Fast Moving Horizon estimation and Model Predictive Control with an observability constraint

Nonlinear Model Predictive Path Tracking Control for Autonomous Vehicles Based on Orthogonal Collocation Method

A Dual Adaptive Robust Control for Nonlinear Systems with Parameter and State Estimation

Nonlinear Model Predictive Control Based on PSO and LMI Optimizing Algorithm

Support Vector Machine Based Nonlinear Model Multi-Step-ahead Optimizing Predictive Control

Networked Dual-Mode Adaptive Horizon MPC for Constrained Nonlinear Systems

Simultaneous System Identification and Model Predictive Control with No Dynamic Regret

A Simple and Efficient Algorithm for Nonlinear Model Predictive Control

Nonlinear stochastic predictive control with unscented transformation for semi-autonomous vehicles

A Feedback Linearized Model Predictive Control Strategy for Input-Constrained Self-Driving Cars

Real-time Nonlinear Model Predictive Control using One-step Optimizations and Reachable Sets

A Dual-Mode Nonlinear Model Predictive Control Scheme With Extended Terminal Constraint Sets

A Stochastic Nonlinear Model Predictive Control with an Uncertainty Propagation Horizon for Autonomous Vehicle Motion Control

R$^2$NMPC: A Real-Time Reduced Robustified Nonlinear Model Predictive Control with Ellipsoidal Uncertainty Sets for Autonomous Vehicle Motion Control

Observer-Based NN Control for Nonlinear Systems With Full-State Constraints and External Disturbances

A Dual-mode Nonlinear Model Predictive Control with the Enlarged Terminal Constraint Sets

Efficient Nonlinear Model Predictive Control by Leveraging Linear Parameter-Varying Embedding and Sequential Quadratic Programming

A Non-Linear Offset-Free Model Predictive Control Design Approach

Input-Constrained-Nonlinear-Dynamic-Model-Based Predictive Position Control of Planar Motors.

Nonlinear Model Predictive Control Using Adaptive Hinging Hyperplanes Model

Learning-based model predictive control with moving horizon state estimation for autonomous racing