Abstract:A fundamental challenge in learning an unknown dynamical system is to reduce model uncertainty by making measurements while maintaining safety. We formulate a mathematical definition of what it means to safely learn a dynamical system by sequentially deciding where to initialize trajectories. The state of the system must stay within a safety region for a horizon of $T$ time steps under the action of all dynamical systems that (i) belong to a given initial uncertainty set, and (ii) are consistent with information gathered so far. First, we consider safely learning a linear dynamical system involving $n$ states. For the case $T=1$, we present an LP-based algorithm that either safely recovers the true dynamics from at most $n$ trajectories, or certifies that safe learning is impossible. For $T=2$, we give an SDP representation of the set of safe initial conditions and show that $\lceil n/2 \rceil$ trajectories generically suffice for safe learning. For $T = \infty$, we provide SDP-representable inner approximations of the set of safe initial conditions and show that one trajectory generically suffices for safe learning. We extend a number of our results to the cases where the initial uncertainty set contains sparse, low-rank, or permutation matrices, or when the system has a control input. Second, we consider safely learning a general class of nonlinear dynamical systems. For the case $T=1$, we give an SOCP-based representation of the set of safe initial conditions. For $T=\infty$, we provide semidefinite representable inner approximations to the set of safe initial conditions. We show how one can safely collect trajectories and fit a polynomial model of the nonlinear dynamics that is consistent with the initial uncertainty set and best agrees with the observations. We also present some extensions to cases where the measurements are noisy or the dynamical system involves disturbances.

Robust Learning of Nonlinear Dynamical Systems with Safety and Stability Properties

Dynamical System Learning Using Extreme Learning Machines with Safety and Stability Guarantees

Fast and Stable Learning of Dynamical Systems Based on Extreme Learning Machine.

Active Sampling based Safe Identification of Dynamical Systems using Extreme Learning Machines and Barrier Certificates

Safely Learning Dynamical Systems

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier Functions

Learning Lyapunov-Stable Polynomial Dynamical Systems Through Imitation

Robust Safety-Critical Control for Dynamic Robotics

Providing Safety Assurances for Systems with Unknown Dynamics

Learning H-Infinity Locomotion Control

Stabilizing Dynamic Systems through Neural Network Learning: A Robust Approach

Safe Learning MPC with Limited Model Knowledge and Data

Learning Complex Motion Plans using Neural ODEs with Safety and Stability Guarantees

Safety-Aware Learning-Based Control of Systems with Uncertainty Dependent Constraints (extended version)

Learning Robust Safety Controllers for Uncertain Input-Affine Polynomial Systems

Robust Output-Lifted Learning Model Predictive Control

Robust Model-Free Control Framework with Safety Constraints for a Fully Electric Linear Actuator System

SafEDMD: A certified learning architecture tailored to data-driven control of nonlinear dynamical systems

Robust Learning-Based Control for Uncertain Nonlinear Systems With Validation on a Soft Robot

ELM-based Adaptive Neural Estimation for Actuator Faults Detection and Diagnosis of Nonlinear Uncertain Systems