Abstract:Operator learning, the approximation of mappings between infinite-dimensional function spaces using ideas from machine learning, has gained increasing research attention in recent years. Approximate operators, learned from data, hold promise to serve as efficient surrogate models for problems in computational science and engineering, complementing traditional numerical methods. However, despite their empirical success, our understanding of the underpinning mathematical theory is in large part still incomplete. In this paper, we study the approximation of Lipschitz operators in expectation with respect to Gaussian measures. We prove higher Gaussian Sobolev regularity of Lipschitz operators and establish lower and upper bounds on the Hermite polynomial approximation error. We further consider the reconstruction of Lipschitz operators from $m$ arbitrary (adaptive) linear samples. A key finding is the tight characterization of the smallest achievable error for all possible (adaptive) sampling and reconstruction maps in terms of $m$. It is shown that Hermite polynomial approximation is an optimal recovery strategy, but we have the following curse of sample complexity: No method to approximate Lipschitz operators based on finitely many samples can achieve algebraic convergence rates in $m$. On the positive side, we prove that a sufficiently fast spectral decay of the covariance operator of the Gaussian measure guarantees convergence rates which are arbitrarily close to any algebraic rate in the large data limit $m \to \infty$. Finally, we focus on the recovery of Lipschitz operators from finitely many point samples. We consider Christoffel sampling and weighted least-squares approximation, and present an algorithm which provably achieves near-optimal sample complexity.

Optimal Recovery of a Family of Operators from Inaccurate Measurements on a Compact Set

On the Optimal Recovery of One Family of Operators on a Class of Functions from Approximate Information about Its Spectrum

On the Best Recovery of a Family of Operators on the Manifold

On the construction of families of optimal recovery methods for linear operators

Optimal recovery of linear operators from information of random functions

Instances of Computational Optimal Recovery: Dealing with Observation Errors

Full Recovery from Point Values: an Optimal Algorithm for Chebyshev Approximability Prior

Near-Optimal Recovery of Linear and N-Convex Functions on Unions of Convex Sets

Radius of Information for Two Intersected Centered Hyperellipsoids and Implications in Optimal Recovery from Inaccurate Data

Towards optimal algorithms for the recovery of low-dimensional models with linear rates

S-Procedure Relaxation: a Case of Exactness Involving Chebyshev Centers

Learning Lipschitz Operators with respect to Gaussian Measures with Near-Optimal Sample Complexity

Volume estimates and their applications in the problem of optimal recovery

Approximability models and optimal system identification

Towards optimal sensor placement for inverse problems in spaces of measures

On Robust Recovery of Signals from Indirect Observations

Near-Optimal Estimation of Linear Functionals with Log-Concave Observation Errors

Optimal recovery and generalized Carlson inequality for weights with symmetry properties

Stochastic Recovery Of Sparse Signals From Random Measurements

Metric Approximation of Set-Valued Functions of Bounded Variation by Integral Operators