Abstract:Operator learning, the approximation of mappings between infinite-dimensional function spaces using ideas from machine learning, has gained increasing research attention in recent years. Approximate operators, learned from data, hold promise to serve as efficient surrogate models for problems in computational science and engineering, complementing traditional numerical methods. However, despite their empirical success, our understanding of the underpinning mathematical theory is in large part still incomplete. In this paper, we study the approximation of Lipschitz operators in expectation with respect to Gaussian measures. We prove higher Gaussian Sobolev regularity of Lipschitz operators and establish lower and upper bounds on the Hermite polynomial approximation error. We further consider the reconstruction of Lipschitz operators from $m$ arbitrary (adaptive) linear samples. A key finding is the tight characterization of the smallest achievable error for all possible (adaptive) sampling and reconstruction maps in terms of $m$. It is shown that Hermite polynomial approximation is an optimal recovery strategy, but we have the following curse of sample complexity: No method to approximate Lipschitz operators based on finitely many samples can achieve algebraic convergence rates in $m$. On the positive side, we prove that a sufficiently fast spectral decay of the covariance operator of the Gaussian measure guarantees convergence rates which are arbitrarily close to any algebraic rate in the large data limit $m \to \infty$. Finally, we focus on the recovery of Lipschitz operators from finitely many point samples. We consider Christoffel sampling and weighted least-squares approximation, and present an algorithm which provably achieves near-optimal sample complexity.

Algorithms for computing the optimal Lipschitz constant of interpolants with Lipschitz derivative

Optimization of Approximate Solution of Integral Equations of Several Variables

On the Hermite interpolation

Lipschitz Interpolation: Non-parametric Convergence under Bounded Stochastic Noise

Construction of Optimal Algorithms for Function Approximation in Gaussian Sobolev Spaces

The Convergence of the Geometric Interpolation Algorithm.

Construction techniques for highly accurate quasi-interpolation operators

On Optimal Interpolation In Linear Regression

Optimal Birkhoff Interpolation and Birkhoff Numbers in Some Function Spaces

Goldstein Stationarity in Lipschitz Constrained Optimization

Adaptive Algorithms for Relatively Lipschitz Continuous Convex Optimization Problems

Stable Rational Approximation in the Context of Interpolation and Convex Optimization

Algorithm for Optimization and Interpolation based on Hyponormality

On Degree-Constrained Analytic Interpolation with Interpolation Points Close to the Boundary.

The Inverse Problem of Analytic Interpolation with Degree Constraint

On the Optimality of Target-Data-Dependent Kernel Greedy Interpolation in Sobolev Reproducing Kernel Hilbert Spaces

Efficient Lipschitzian Global Optimization of Hölder Continuous Multivariate Functions

Accelerated method of finding for the minimum of arbitrary Lipschitz convex function

Learning Lipschitz Operators with respect to Gaussian Measures with Near-Optimal Sample Complexity

The best approximation of a given function in L 2 -norm by Lipschitz functions with gradient constraint

Generalized Interpolation in H(Infinity) with A Complexity Constraint