Abstract:Linearity of Koopman operators and simplicity of their estimators coupled with model-reduction capabilities has lead to their great popularity in applications for learning dynamical systems. While nonparametric Koopman operator learning in infinite-dimensional reproducing kernel Hilbert spaces is well understood for autonomous systems, its control system analogues are largely unexplored. Addressing systems with control inputs in a principled manner is crucial for fully data-driven learning of controllers, especially since existing approaches commonly resort to representational heuristics or parametric models of limited expressiveness and scalability. We address the aforementioned challenge by proposing a universal framework via control-affine reproducing kernels that enables direct estimation of a single operator even for control systems. The proposed approach, called control-Koopman operator regression (cKOR), is thus completely analogous to Koopman operator regression of the autonomous case. First in the literature, we present a nonparametric framework for learning Koopman operator representations of nonlinear control-affine systems that does not suffer from the curse of control input dimensionality. This allows for reformulating the infinite-dimensional learning problem in a finite-dimensional space based solely on data without apriori loss of precision due to a restriction to a finite span of functions or inputs as in other approaches. For enabling applications to large-scale control systems, we also enhance the scalability of control-Koopman operator estimators by leveraging random projections (sketching). The efficacy of our novel cKOR approach is demonstrated on both forecasting and control tasks.

Koopman-based Control for Stochastic Systems: Application to Enhanced Sampling

Markov Chain Monte Carlo for Koopman-based Optimal Control: Technical Report

A Koopman framework for rare event simulation in stochastic differential equations

Koopman Data-Driven Predictive Control with Robust Stability and Recursive Feasibility Guarantees

Koopman-based control of nonlinear systems with closed-loop guarantees

Sampling-based Stochastic Data-driven Predictive Control under Data Uncertainty

Kernel-based Koopman approximants for control: Flexible sampling, error analysis, and stability

Near Optimal Control for a Class of Stochastic Hybrid Systems.

Learning Koopman eigenfunctions of stochastic diffusions with optimal importance sampling and ISOKANN

Extended Kalman filter -- Koopman operator for tractable stochastic optimal control

Mean Field Control by Stochastic Koopman Operator via a Spectral Method

Koopman Representations of Dynamic Systems with Control

Mixed-Integer Path-Stable Optimisation, with Applications in Model-Predictive Control of Water Systems

Data-Driven Stochastic Optimal Control using Linear Transfer Operators

Constrained stochastic optimal control with learned importance sampling: A path integral approach

Nonparametric Control-Koopman Operator Learning: Flexible and Scalable Models for Prediction and Control

Kernel-Based Optimal Control: An Infinitesimal Generator Approach

Adaptive Stochastic Predictive Control from Noisy Data: A Sampling-based Approach

Data-driven optimal control of unknown nonlinear dynamical systems using the Koopman operator

Data-Driven Stochastic Optimal Control with Safety Constraints using Linear Transfer Operators

Koopman-based Policy Iteration for Robust Optimal Control