Abstract:We find probability error bounds for approximations of functions $f$ in a separable reproducing kernel Hilbert space $\mathcal{H}$ with reproducing kernel $K$ on a base space $X$, firstly in terms of finite linear combinations of functions of type $K_{x_i}$ and then in terms of the projection $\pi^n_x$ on $\mathrm{Span}\{K_{x_i}\}^n_{i=1}$, for random sequences of points $x=(x_i)_i$ in $X$. Given a probability measure $P$, letting $P_K$ be the measure defined by $\mathrm{d} P_K(x)=K(x,x)\mathrm{d} P(x)$, $x\in X$, our approach is based on the nonexpansive operator \[L^2(X;P_K)\ni\lambda\mapsto L_{P,K}\lambda:=\int_X \lambda(x)K_x\mathrm{d} P(x)\in \mathcal{H},\] where the integral exists in the Bochner sense. Using this operator, we then define a new reproducing kernel Hilbert space, denoted by $\mathcal{H}_P$, that is the operator range of $L_{P,K}$. Our main result establishes bounds, in terms of the operator $L_{P,K}$, on the probability that the Hilbert space distance between an arbitrary function $f\in\mathcal{H}$ and linear combinations of functions of type $K_{x_i}$, for $(x_i)_i$ sampled independently from $P$, falls below a given threshold. For sequences of points $(x_i)_{i=1}^\infty$ constituting a so-called uniqueness set, the orthogonal projections $\pi^n_x$ to $\mathrm{Span}\{K_{x_i}\}^n_{i=1}$ converge in the strong operator topology to the identity operator. We prove that, under the assumption that $\mathcal{H}_P$ is dense in $\mathcal{H}$, any sequence of iid samples from $P$ yields a uniqueness set with probability $1$. This result improves on previous error bounds in weaker norms, such as uniform or $L^p$ norms, which yield only convergence in probability and not a.c. convergence. Two examples that show the applicability of this result to a uniform distribution on a compact interval and to the Hardy space $H^2(\mathbb{D})$ are presented as well.

Reproducing Kernels of Sobolev Spaces on ℝ^d and Applications to Embedding Constants and Tractability

A New Reproducing Kernel Method for Duffing Equations.

Integration in reproducing kernel Hilbert spaces of Gaussian kernels

Reproducing Kernel Functions Represented By Form Of Polynomials

Exact Estimates of Functions in Sobolev Spaces with Uniform Norm

Reproducing kernel Hilbert spaces on manifolds: Sobolev and Diffusion spaces

Entropy numbers of Reproducing Hilbert Space of zonal positive definite kernels on compact two-point homogeneous spaces

Unified Native Spaces in Kernel Methods

Kernels of discrete convolutions and subdivision operators

The Expansion of the Function with Two Unknowns on the Reproducing Kernel Space

A Note on Reproducing Kernels for Sobolev Spaces

Generalized Newton-Leibniz Formula and the Embedding of the Sobolev Functions with Dominating Mixed Smoothness into Hölder Spaces

Strong tractability of multivariate integration using quasi-Monte Carlo algorithms

Tropical Reproducing Kernels and Optimization

Optimal function spaces and Sobolev embeddings

Rigidity, boundary interpolation and reproducing kernels

Nonlinear expansions in reproducing kernel Hilbert spaces

Multilinear Strongly Singular Integral Operators with Generalized Kernels on RD-Spaces

Error Analysis of Kernel/GP Methods for Nonlinear and Parametric PDEs

A constructive approach to strong tractability using Quasi-Monte Carlo algorithms

Probability error bounds for approximation of functions in reproducing kernel Hilbert spaces