Abstract:We provide an algorithm for the simultaneous system identification and model predictive control of nonlinear systems. The algorithm has finite-time near-optimality guarantees and asymptotically converges to the optimal (non-causal) controller. Particularly, the algorithm enjoys sublinear dynamic regret, defined herein as the suboptimality against an optimal clairvoyant controller that knows how the unknown disturbances and system dynamics will adapt to its actions. The algorithm is self-supervised and applies to control-affine systems with unknown dynamics and disturbances that can be expressed in reproducing kernel Hilbert spaces. Such spaces can model external disturbances and modeling errors that can even be adaptive to the system's state and control input. For example, they can model wind and wave disturbances to aerial and marine vehicles, or inaccurate model parameters such as inertia of mechanical systems. The algorithm first generates random Fourier features that are used to approximate the unknown dynamics or disturbances. Then, it employs model predictive control based on the current learned model of the unknown dynamics (or disturbances). The model of the unknown dynamics is updated online using least squares based on the data collected while controlling the system. We validate our algorithm in both hardware experiments and physics-based simulations. The simulations include (i) a cart-pole aiming to maintain the pole upright despite inaccurate model parameters, and (ii) a quadrotor aiming to track reference trajectories despite unmodeled aerodynamic drag effects. The hardware experiments include a quadrotor aiming to track a circular trajectory despite unmodeled aerodynamic drag effects, ground effects, and wind disturbances.

Certainty Equivalent Perception-Based Control

A Composite Adaptive Robust Control for Nonlinear Systems with Model Uncertainties

Robust Guarantees for Perception-Based Control

Safe Perception-Based Control under Stochastic Sensor Uncertainty using Conformal Prediction

Guaranteeing Safety of Learned Perception Modules via Measurement-Robust Control Barrier Functions

Safety-Aware Learning-Based Control of Systems with Uncertainty Dependent Constraints (extended version)

Learning Safe, Generalizable Perception-Based Hybrid Control With Certificates

Kernel-based Learning for Safe Control of Discrete-Time Unknown Systems under Incomplete Observations

Learning-Based Optimal Control with Performance Guarantees for Unknown Systems with Latent States

Myopically Verifiable Probabilistic Certificates for Safe Control and Learning

Learning to Control under Uncertainty with Data-Based Iterative Linear Quadratic Regulator

A General Safety Framework for Learning-Based Control in Uncertain Robotic Systems

Robust Control Barrier Functions with Uncertainty Estimation

Optimized Control Invariance Conditions for Uncertain Input-Constrained Nonlinear Control Systems

Statistical verification of autonomous system controllers under timing uncertainties

Probabilistic Guarantees for Nonlinear Safety-Critical Optimal Control

Safe Online Dynamics Learning with Initially Unknown Models and Infeasible Safety Certificates

Robust Control Under Uncertainty via Bounded Rationality and Differential Privacy

Perception-Based Sampled-Data Optimization of Dynamical Systems

Confidence-Aware Safe and Stable Control of Control-Affine Systems

Simultaneous System Identification and Model Predictive Control with No Dynamic Regret