Abstract:We provide an algorithm for the simultaneous system identification and model predictive control of nonlinear systems. The algorithm has finite-time near-optimality guarantees and asymptotically converges to the optimal (non-causal) controller. Particularly, the algorithm enjoys sublinear dynamic regret, defined herein as the suboptimality against an optimal clairvoyant controller that knows how the unknown disturbances and system dynamics will adapt to its actions. The algorithm is self-supervised and applies to control-affine systems with unknown dynamics and disturbances that can be expressed in reproducing kernel Hilbert spaces. Such spaces can model external disturbances and modeling errors that can even be adaptive to the system's state and control input. For example, they can model wind and wave disturbances to aerial and marine vehicles, or inaccurate model parameters such as inertia of mechanical systems. The algorithm first generates random Fourier features that are used to approximate the unknown dynamics or disturbances. Then, it employs model predictive control based on the current learned model of the unknown dynamics (or disturbances). The model of the unknown dynamics is updated online using least squares based on the data collected while controlling the system. We validate our algorithm in both hardware experiments and physics-based simulations. The simulations include (i) a cart-pole aiming to maintain the pole upright despite inaccurate model parameters, and (ii) a quadrotor aiming to track reference trajectories despite unmodeled aerodynamic drag effects. The hardware experiments include a quadrotor aiming to track a circular trajectory despite unmodeled aerodynamic drag effects, ground effects, and wind disturbances.

Adaptive Identification Control Method for Aircraft Dynamic Parameters under Passive Excitation

A Model Predictive Control Approach with Relevant Identification in Dynamic PLS Framework

On extended state Kalman filter-based identification algorithm for aerodynamic parameters

Model Identification of Aircraft Vertical Tail Using Neural Network

Online Parameter Estimation for Fixed-Wing UAV Based on DREM Method and Adaptive Control

Study on Identification Method for Parameter Uncertainty Model of Aero Engine

An improved online system identification method for tiltrotor aircraft

Application of Neural Network Based on Real-Time Recursive Learning and Kalman Filter in Flight Data Identification

Aerodynamic Parameters Identification Based on Special Excitation Signals and Filter Error Method

Calculation And Identification Of The Aerodynamic Parameters For Small-Scaled Fixed-Wing Uavs

Identifiability Implies Robust, Globally Exponentially Convergent On-line Parameter Estimation: Application to Model Reference Adaptive Control

Fuzzy Dynamic Characteristic Modeling and Adaptive Control of Nonlinear Systems and Its Application to Hypersonic Vehicles

Adaptive control for excitation and parameter identification of a three-axis spacecraft simulator with full-state constraints

The Anti-windup Adaptive Control of Aircraft Based on Neural Network

Modeling and adaptive control of air vehicles with partial nonlinear parametrization

Simultaneous System Identification and Model Predictive Control with No Dynamic Regret

Dynamic Surface Control of Hypersonic Aircraft with Parameter Estimation

Aerodynamic Parameter Identification for Hypersonic Vehicles Considering Input Measurement Errors

A fast identification method of vehicle longitudinal dynamic parameters for intelligent cruise control

Aerodynamic Parameter Identification of UAV Based on Output-Error Method

Unsteady Aerodynamic Identification of Aircraft at High Angles of Attack