Abstract:We find probability error bounds for approximations of functions $f$ in a separable reproducing kernel Hilbert space $\mathcal{H}$ with reproducing kernel $K$ on a base space $X$, firstly in terms of finite linear combinations of functions of type $K_{x_i}$ and then in terms of the projection $\pi^n_x$ on $\mathrm{Span}\{K_{x_i}\}^n_{i=1}$, for random sequences of points $x=(x_i)_i$ in $X$. Given a probability measure $P$, letting $P_K$ be the measure defined by $\mathrm{d} P_K(x)=K(x,x)\mathrm{d} P(x)$, $x\in X$, our approach is based on the nonexpansive operator \[L^2(X;P_K)\ni\lambda\mapsto L_{P,K}\lambda:=\int_X \lambda(x)K_x\mathrm{d} P(x)\in \mathcal{H},\] where the integral exists in the Bochner sense. Using this operator, we then define a new reproducing kernel Hilbert space, denoted by $\mathcal{H}_P$, that is the operator range of $L_{P,K}$. Our main result establishes bounds, in terms of the operator $L_{P,K}$, on the probability that the Hilbert space distance between an arbitrary function $f\in\mathcal{H}$ and linear combinations of functions of type $K_{x_i}$, for $(x_i)_i$ sampled independently from $P$, falls below a given threshold. For sequences of points $(x_i)_{i=1}^\infty$ constituting a so-called uniqueness set, the orthogonal projections $\pi^n_x$ to $\mathrm{Span}\{K_{x_i}\}^n_{i=1}$ converge in the strong operator topology to the identity operator. We prove that, under the assumption that $\mathcal{H}_P$ is dense in $\mathcal{H}$, any sequence of iid samples from $P$ yields a uniqueness set with probability $1$. This result improves on previous error bounds in weaker norms, such as uniform or $L^p$ norms, which yield only convergence in probability and not a.c. convergence. Two examples that show the applicability of this result to a uniform distribution on a compact interval and to the Hardy space $H^2(\mathbb{D})$ are presented as well.

Nonuniform sampling, reproducing kernels, and the associated Hilbert spaces

New characterizations of reproducing kernel Hilbert spaces and applications to metric geometry

Reproducing kernels and choices of associated feature spaces, in the form of $L^{2}$-spaces

Positive Definite Kernels, Algorithms, Frames, and Approximations

Signal reconstruction using determinantal sampling

Relevant Sampling in a reproducing kernel subspace of Orlicz space

Optimal Sampling Points in Reproducing Kernel Hilbert Spaces

A new kernel method for the uniform approximation in reproducing kernel Hilbert spaces

Sampling recovery in $L_2$ and other norms

Entropy numbers of Reproducing Hilbert Space of zonal positive definite kernels on compact two-point homogeneous spaces

On the stability test for reproducing kernel Hilbert spaces

Sparse multiresolution representations with adaptive kernels

Noncommutative reproducing kernel Hilbert spaces

Reproducing kernel Hilbert spaces on manifolds: Sobolev and Diffusion spaces

Pseudo-inverse reconstruction of bandlimited signals from nonuniform generalized samples with orthogonal kernels

Learning in RKHM: a $C^*$-Algebraic Twist for Kernel Machines

Probability error bounds for approximation of functions in reproducing kernel Hilbert spaces

Generalization Properties of Hyper-Rkhs and Its Applications

An algebra structure for reproducing kernel Hilbert spaces

Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey

A refinement of the stability test for reproducing kernel Hilbert spaces