Abstract:This manuscript addresses the problem of approximating an unknown function from point evaluations. When obtaining these point evaluations is costly, minimising the required sample size becomes crucial, and it is unreasonable to reserve a sufficiently large test sample for estimating the approximation accuracy. Therefore, an approximation with a certified quasi-optimality factor is required. This article shows that such an approximation can be obtained when the sought function lies in a reproducing kernel Hilbert space (RKHS) and is to be approximated in a finite-dimensional linear subspace. However, selecting the sample points to minimise the quasi-optimality factor requires optimising over an infinite set of points and computing exact inner products in RKHS, which is often infeasible in practice. Extending results from optimal sampling for $L^2$ approximation, the present manuscript proves that random points, drawn independently from the Christoffel sampling distribution associated with $\mathcal{V}_d$, can yield a controllable quasi-optimality factor with high probability. Inspired by this result, a novel sampling scheme, coined subspace-informed volume sampling, is introduced and evaluated in numerical experiments, where it outperforms classical i.i.d. Christoffel sampling and continuous volume sampling. To reduce the size of such a random sample, an additional greedy subsampling scheme with provable suboptimality bounds is introduced. Our presentation is of independent interest to the community researching the parametrised background data weak (PBDW) method, as it offers a simpler interpretation of the method.

Optimal parameter choice for regularized Shannon sampling formulas

Regularized Shannon sampling formulas related to the special affine Fourier transform

Exponential Approximation of Band-Limited Functions from Nonuniform Sampling by Regularization Methods

Non-Uniform Randomized Sampling for Multivariate Approximation by High Order Parzen Windows

Continuous window functions for NFFT

How Slow is Shannon'S Reconstruction for Bandlimited Signals?

Subsampling at Information Theoretically Optimal Rates

Parameter choice strategies for regularized least squares approximation of noisy continuous functions on the unit circle

Optimal Sampling Points in Reproducing Kernel Hilbert Spaces

Spurious minimizers in non uniform Fourier sampling optimization

Determination of parameters of models of signal deviation from neighboring samples by convex functions

Low-complexity Graph Sampling with Noise and Signal Reconstruction via Neumann Series

Almost-sure quasi-optimal approximation in reproducing kernel Hilbert spaces

Adaptive window width selection algorithm for Gabor transform based on entropy

Optimal Regularization Parameter Estimation for Spectral Regression Discriminant Analysis

Optimal sampling for least squares approximation with general dictionaries

Optimal parameter estimation for linear SPDEs from multiple measurements

Optimal Rates for Vector-Valued Spectral Regularization Learning Algorithms

Optimal Learning Rates for Regularized Least-Squares with a Fourier Capacity Condition

A practical guide to the recovery of wavelet coefficients from Fourier measurements

Sampling theorems with derivatives in shift-invariant spaces generated by periodic exponential B-splines