Abstract:This manuscript addresses the problem of approximating an unknown function from point evaluations. When obtaining these point evaluations is costly, minimising the required sample size becomes crucial, and it is unreasonable to reserve a sufficiently large test sample for estimating the approximation accuracy. Therefore, an approximation with a certified quasi-optimality factor is required. This article shows that such an approximation can be obtained when the sought function lies in a reproducing kernel Hilbert space (RKHS) and is to be approximated in a finite-dimensional linear subspace. However, selecting the sample points to minimise the quasi-optimality factor requires optimising over an infinite set of points and computing exact inner products in RKHS, which is often infeasible in practice. Extending results from optimal sampling for $L^2$ approximation, the present manuscript proves that random points, drawn independently from the Christoffel sampling distribution associated with $\mathcal{V}_d$, can yield a controllable quasi-optimality factor with high probability. Inspired by this result, a novel sampling scheme, coined subspace-informed volume sampling, is introduced and evaluated in numerical experiments, where it outperforms classical i.i.d. Christoffel sampling and continuous volume sampling. To reduce the size of such a random sample, an additional greedy subsampling scheme with provable suboptimality bounds is introduced. Our presentation is of independent interest to the community researching the parametrised background data weak (PBDW) method, as it offers a simpler interpretation of the method.

On the Optimality of Target-Data-Dependent Kernel Greedy Interpolation in Sobolev Reproducing Kernel Hilbert Spaces

On the optimality of target-data-dependent kernel greedy interpolation in Sobolev Reproducing Kernel Hilbert Spaces

On the convergence of generalized kernel-based interpolation by greedy data selection algorithms

Greedy Adaptive Local Recovery of Functions in Sobolev Spaces

On Optimal Interpolation In Linear Regression

Scattered Data Interpolation on Embedded Submanifolds with Restricted Positive Definite Kernels: Sobolev Error Estimates

Extending error bounds for radial basis function interpolation to measuring the error in higher order Sobolev norms

Error Bounds for a Kernel-Based Constrained Optimal Smoothing Approximation

A new analysis of empirical interpolation methods and Chebyshev greedy algorithms

Efficient Numerical Integration in Reproducing Kernel Hilbert Spaces via Leverage Scores Sampling

Kernel Interpolation of High Dimensional Scattered Data

Hermite kernel surrogates for the value function of high-dimensional nonlinear optimal control problems

Finetuning greedy kernel models by exchange algorithms

Improving digital signal interpolation: L2-optimal kernels with kernel-invariant interpolation speed

Doubling the rate -- improved error bounds for orthogonal projection with application to interpolation

Almost-sure quasi-optimal approximation in reproducing kernel Hilbert spaces

Approximation of optimization problems with constraints through kernel Sum-Of-Squares

Linear Convergence of Stochastic Iterative Greedy Algorithms With Sparse Constraints