Abstract:We provide an algorithm for the simultaneous system identification and model predictive control of nonlinear systems. The algorithm has finite-time near-optimality guarantees and asymptotically converges to the optimal (non-causal) controller. Particularly, the algorithm enjoys sublinear dynamic regret, defined herein as the suboptimality against an optimal clairvoyant controller that knows how the unknown disturbances and system dynamics will adapt to its actions. The algorithm is self-supervised and applies to control-affine systems with unknown dynamics and disturbances that can be expressed in reproducing kernel Hilbert spaces. Such spaces can model external disturbances and modeling errors that can even be adaptive to the system's state and control input. For example, they can model wind and wave disturbances to aerial and marine vehicles, or inaccurate model parameters such as inertia of mechanical systems. The algorithm first generates random Fourier features that are used to approximate the unknown dynamics or disturbances. Then, it employs model predictive control based on the current learned model of the unknown dynamics (or disturbances). The model of the unknown dynamics is updated online using least squares based on the data collected while controlling the system. We validate our algorithm in both hardware experiments and physics-based simulations. The simulations include (i) a cart-pole aiming to maintain the pole upright despite inaccurate model parameters, and (ii) a quadrotor aiming to track reference trajectories despite unmodeled aerodynamic drag effects. The hardware experiments include a quadrotor aiming to track a circular trajectory despite unmodeled aerodynamic drag effects, ground effects, and wind disturbances.

An Alternating Identification Algorithm for a Class of Nonlinear Dynamical Systems

A nonlinear predictive control algorithm based on fuzzy online modeling and discrete optimization

Joint State and Parameter Estimation of Nonlinear Dynamical Systems Through Alternating Optimization

Identifiability and Identification of Switching Dynamical Networks: A Data-Based Approach

An Adaptive Linear Element Based Method for Identification of Linear Parameter Varying Models

A Fully Decoupled Adaptive Identification Algorithm For Nonlinear System

Online Identification of Nonlinear Systems With Separable Structure

Fault Identification for a Class of Nonlinear Systems of Canonical Form via Deterministic Learning

Robust Identification for Unknown Nonlinear Multivariable Systems Based on Dynamic Neural Networks

One Step Iterative Strategy for Nonlinear System Identification

Improved genetic programming for system identification

Nonlinear Adaptive Control Using Multiple Identification Models

An Algebraic Geometric Approach to the Identification of A Class of Linear Hybrid Systems

Efficient Identification Of Rbf Neural-Net Models For Nonlinear Discrete-Time Multivariable Dynamical-Systems

Identification of Analytic Nonlinear Dynamical Systems with Non-asymptotic Guarantees

Identification methods of nonlinear systems based on the kernel functions

Nonlinear System Identification With Genetic Algorithms

Adaptive identification of linear infinite-dimensional systems

Iterative Learning Identification with Bias Compensation for Stochastic Linear Time-Varying Systems.

Identification Of Time-Varying Nonlinear System Using Wavelet Decomposition

Simultaneous System Identification and Model Predictive Control with No Dynamic Regret