Abstract:Linearity of Koopman operators and simplicity of their estimators coupled with model-reduction capabilities has lead to their great popularity in applications for learning dynamical systems. While nonparametric Koopman operator learning in infinite-dimensional reproducing kernel Hilbert spaces is well understood for autonomous systems, its control system analogues are largely unexplored. Addressing systems with control inputs in a principled manner is crucial for fully data-driven learning of controllers, especially since existing approaches commonly resort to representational heuristics or parametric models of limited expressiveness and scalability. We address the aforementioned challenge by proposing a universal framework via control-affine reproducing kernels that enables direct estimation of a single operator even for control systems. The proposed approach, called control-Koopman operator regression (cKOR), is thus completely analogous to Koopman operator regression of the autonomous case. First in the literature, we present a nonparametric framework for learning Koopman operator representations of nonlinear control-affine systems that does not suffer from the curse of control input dimensionality. This allows for reformulating the infinite-dimensional learning problem in a finite-dimensional space based solely on data without apriori loss of precision due to a restriction to a finite span of functions or inputs as in other approaches. For enabling applications to large-scale control systems, we also enhance the scalability of control-Koopman operator estimators by leveraging random projections (sketching). The efficacy of our novel cKOR approach is demonstrated on both forecasting and control tasks.

Kernel-Based Optimal Control: An Infinitesimal Generator Approach

Data-Driven Optimal Feedback Laws via Kernel Mean Embeddings

A Gradient-based Kernel Optimization Approach for Parabolic Distributed Parameter Control Systems

Data-Driven Stochastic Optimal Control Using Kernel Gradients

Stochastic Optimal Control as Approximate Input Inference

Nonparametric Control-Koopman Operator Learning: Flexible and Scalable Models for Prediction and Control

Near Optimal Control for a Class of Stochastic Hybrid Systems.

Data-Driven Stochastic Optimal Control using Linear Transfer Operators

A Multilevel Approach for Stochastic Nonlinear Optimal Control

Learning the Infinitesimal Generator of Stochastic Diffusion Processes

Data-driven optimal control via linear transfer operators: A convex approach

Data-Driven Near-Optimal Control of Nonlinear Systems Over Finite Horizon

Constrained stochastic optimal control with learned importance sampling: A path integral approach

Data-driven optimal control of unknown nonlinear dynamical systems using the Koopman operator

Data-Driven Stochastic Optimal Control with Safety Constraints using Linear Transfer Operators

Learning optimal controllers: a dynamical motion primitive approach

An Operator Learning Approach to Nonsmooth Optimal Control of Nonlinear PDEs

Data-Driven Optimal Control Using Perron-Frobenius Operator

Learning-Based Optimal Control with Performance Guarantees for Unknown Systems with Latent States

Linear-quadratic optimal control for infinite-dimensional input-state-output systems

Neural Control Systems