Abstract:When learning stable linear dynamical systems from data, three important properties are desirable: i) predictive accuracy, ii) provable stability, and iii) computational efficiency. Unconstrained minimization of reconstruction errors leads to high accuracy and efficiency but cannot guarantee stability. Existing methods to remedy this focus on enforcing stability while also ensuring accuracy, but do so only at the cost of increased computation. In this work, we investigate if a straightforward approach can \textit{simultaneously} offer all three desiderata of learning stable linear systems. Specifically, we consider a post-hoc approach that manipulates the spectrum of the learned system matrix after it is learned in an unconstrained fashion. We call this approach \textit{spectrum clipping} (SC) as it involves eigen decomposition and subsequent reconstruction of the system matrix after clipping all of its eigenvalues that are larger than one to one (without altering the eigenvectors). Through detailed experiments involving two different applications and publicly available benchmark datasets, we demonstrate that this simple technique can simultaneously learn highly accurate linear systems that are provably stable. Notably, we demonstrate that SC can achieve similar or better performance than strong baselines while being \textit{orders-of-magnitude} faster. We also show that SC can be readily combined with Koopman operators to learn stable nonlinear dynamics, such as those underlying complex dexterous manipulation skills involving multi-fingered robotic hands. Our codes and dataset can be found at \href{<a class="link-external link-https" href="https://github.com/GT-STAR-Lab/spec_clip" rel="external noopener nofollow">this https URL</a>}{<a class="link-external link-https" href="https://github.com/GT-STAR-Lab/spec" rel="external noopener nofollow">this https URL</a>\_clip}.

Koopman Spectrum Nonlinear Regulators and Efficient Online Learning

Learning Koopman Operators with Control Using Bi-level Optimization

Nonparametric Control-Koopman Operator Learning: Flexible and Scalable Models for Prediction and Control

Koopman-Assisted Reinforcement Learning

Online Real-time Learning of Dynamical Systems from Noisy Streaming Data: A Koopman Operator Approach

Model Predictive Control of Nonlinear Dynamics Using Online Adaptive Koopman Operators

Learning Koopman-based Stability Certificates for Unknown Nonlinear Systems

Limits and Powers of Koopman Learning

Koopman Operators in Robot Learning

Data-driven optimal control of unknown nonlinear dynamical systems using the Koopman operator

Learning Noise-Robust Stable Koopman Operator for Control with Hankel DMD

Data-driven End-to-end Learning of Pole Placement Control for Nonlinear Dynamics via Koopman Invariant Subspaces

Online Stackelberg Optimization via Nonlinear Control

Data-Efficient Reinforcement Learning for Complex Nonlinear Systems

Koopman Data-Driven Predictive Control with Robust Stability and Recursive Feasibility Guarantees

Learning Stable Koopman Embeddings for Identification and Control

Online learning of Koopman operator using streaming data from different dynamical regimes

Sharp Spectral Rates for Koopman Operator Learning

Extracting Koopman Operators for Prediction and Control of Non-linear Dynamics Using Two-stage Learning and Oblique Projections

On the Surprising Effectiveness of Spectrum Clipping in Learning Stable Linear Dynamics

Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systems