Abstract:SIAM Journal on Applied Dynamical Systems, Volume 23, Issue 1, Page 885-923, March 2024. Data-driven models for nonlinear dynamical systems based on approximating the underlying Koopman operator or generator have proven to be successful tools for forecasting, feature learning, state estimation, and control. It has become well known that the Koopman generators for control-affine systems also have affine dependence on the input, leading to convenient finite-dimensional bilinear approximations of the dynamics. Yet there are still two main obstacles that limit the scope of current approaches for approximating the Koopman generators of systems with actuation. First, the performance of existing methods depends heavily on the choice of basis functions over which the Koopman generator is to be approximated; and there is currently no universal way to choose them for systems that are not measure preserving. Second, if we do not observe the full state, then it becomes necessary to account for the dependence of the output time series on the sequence of supplied inputs when constructing observables to approximate Koopman operators. To address these issues, we write the dynamics of observables governed by the Koopman generator as a bilinear hidden Markov model and determine the model parameters using the expectation-maximization algorithm. The E step involves a standard Kalman filter and smoother, while the M step resembles control-affine dynamic mode decomposition for the generator. We demonstrate the performance of this method on three examples, including recovery of a finite-dimensional Koopman-invariant subspace for an actuated system with a slow manifold; estimation of Koopman eigenfunctions for the unforced Duffing equation; and model-predictive control of a fluidic pinball system based only on noisy observations of lift and drag.

On Koopman-based surrogate models for non-holonomic robots

Data-Driven Predictive Control of Nonholonomic Robots Based on a Bilinear Koopman Realization: Data Does Not Replace Geometry

Task-optimal data-driven surrogate models for eNMPC via differentiable simulation and optimization

Koopman-based surrogate models for multi-objective optimization of agent-based systems

Deep Koopman Operator Based Model Predictive Control for Nonlinear Robotics Systems

Derivative-Based Koopman Operators for Real-Time Control of Robotic Systems

Learning Koopman Operators with Control Using Bi-level Optimization

Simulation Modeling of Highly Dynamic Omnidirectional Mobile Robots Based on Real-World Data

Data-Driven Models for Control Engineering Applications Using the Koopman Operator

Koopman-based control of nonlinear systems with closed-loop guarantees

Koopman System Approximation Based Optimal Control of Multiple Robots -- Part I: Concepts and Formulations

Learning Bilinear Models of Actuated Koopman Generators from Partially-Observed Trajectories

Dynamics Harmonic Analysis of Robotic Systems: Application in Data-Driven Koopman Modelling

Koopman System Approximation Based Optimal Control of Multiple Robots -- Part II: Simulations and Evaluations

Koopman-based control using sum-of-squares optimization: Improved stability guarantees and data efficiency

Incorporating ESO into Deep Koopman Operator Modelling for Control of Autonomous Vehicles

Learning Bilinear Models of Actuated Koopman Generators from Partially Observed Trajectories

Incorporating ESO into Deep Koopman Operator Modeling for Control of Autonomous Vehicles

Nonparametric Inverse Dynamic Models for Multimodal Interactive Robots

Modeling and Control of Soft Robots Using the Koopman Operator and Model Predictive Control

Toward Control of Wheeled Humanoid Robots with Unknown Payloads: Equilibrium Point Estimation via Real-to-Sim Adaptation