Abstract:Operator learning, the approximation of mappings between infinite-dimensional function spaces using ideas from machine learning, has gained increasing research attention in recent years. Approximate operators, learned from data, hold promise to serve as efficient surrogate models for problems in computational science and engineering, complementing traditional numerical methods. However, despite their empirical success, our understanding of the underpinning mathematical theory is in large part still incomplete. In this paper, we study the approximation of Lipschitz operators in expectation with respect to Gaussian measures. We prove higher Gaussian Sobolev regularity of Lipschitz operators and establish lower and upper bounds on the Hermite polynomial approximation error. We further consider the reconstruction of Lipschitz operators from $m$ arbitrary (adaptive) linear samples. A key finding is the tight characterization of the smallest achievable error for all possible (adaptive) sampling and reconstruction maps in terms of $m$. It is shown that Hermite polynomial approximation is an optimal recovery strategy, but we have the following curse of sample complexity: No method to approximate Lipschitz operators based on finitely many samples can achieve algebraic convergence rates in $m$. On the positive side, we prove that a sufficiently fast spectral decay of the covariance operator of the Gaussian measure guarantees convergence rates which are arbitrarily close to any algebraic rate in the large data limit $m \to \infty$. Finally, we focus on the recovery of Lipschitz operators from finitely many point samples. We consider Christoffel sampling and weighted least-squares approximation, and present an algorithm which provably achieves near-optimal sample complexity.

Exponential Approximation of Band-Limited Functions from Nonuniform Sampling by Regularization Methods

On the Rate of Convergence by Generalized Baskakov Operators

Optimal parameter choice for regularized Shannon sampling formulas

Convergence on Extrapolation for Band-limited Function

Generalized Sampling Theorem

Sampling recovery in Bochner spaces and applications to parametric PDEs with log-normal random inputs

How Slow is Shannon'S Reconstruction for Bandlimited Signals?

Extrapolation of Bandlimited Signals in Linear Canonical Transform Domain

Approximation Properties of Exponential Sampling Series in Logarithmic Weighted Spaces

On Sampling of Bandlimited Graph Signals

A modification of the periodic nonuniform sampling involving derivatives with a Gaussian multiplier

2 Preliminaries 2 . 1 Graph Laplacian and Bandlimited Graph Signals

Error analysis of regularized trigonometric linear regression with unbounded sampling: a statistical learning viewpoint

A Sampling Theorem for the Fractional Fourier Transform Without Band-Limiting Constraints

Sampling discretization of the uniform norm and applications

Approximation Properties of Mellin-Steklov Type Exponential Sampling Series

Learning Lipschitz Operators with respect to Gaussian Measures with Near-Optimal Sample Complexity

Certain Approximation Results for Kantorovich Exponential Sampling Series

Exponential Concentration in Stochastic Approximation

Weighted Approximation By Max-Product Generalized Exponential Sampling Series

Exponential sum approximations of finite completely monotonic functions