Abstract:Besides standard Lagrange interpolation, i.e., interpolation of target functions from scattered point evaluations, positive definite kernel functions are well-suited for the solution of more general reconstruction problems. This is due to the intrinsic structure of the underlying reproducing kernel Hilbert space (RKHS). In fact, kernel-based interpolation has been applied to the reconstruction of bivariate functions from scattered Radon samples in computerized tomography (cf. Iske, 2018) and, moreover, to the numerical solution of elliptic PDEs (cf. Wenzel et al., 2022). As shown in various previous contributions, numerical algorithms and theoretical results from kernel-based Lagrange interpolation can be transferred to more general interpolation problems. In particular, greedy point selection methods were studied in (Wenzel et al., 2022), for the special case of Sobolev kernels. In this paper, we aim to develop and analyze more general kernel-based interpolation methods, for less restrictive settings. To this end, we first provide convergence results for generalized interpolation under minimalistic assumptions on both the selected kernel and the target function. Finally, we prove convergence of popular greedy data selection algorithms for totally bounded sets of functionals. Supporting numerical results are provided for illustration.

On the Convergence Rate of Kernel-Based Sequential Greedy Regression

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Linear Convergence of Stochastic Iterative Greedy Algorithms With Sparse Constraints

Optimal learning rates for Kernel Conjugate Gradient regression

On the convergence analysis of the greedy randomized Kaczmarz method

Online Kernel Learning with a Near Optimal Sparsity Bound

Convergence of Unregularized Online Learning Algorithms

On the convergence of generalized kernel-based interpolation by greedy data selection algorithms

Convergence Analysis of Asynchronous Stochastic Recursive Gradient Algorithms

The learning performance of the weak rescaled pure greedy algorithms

Efficient Online Learning for Large-Scale Sparse Kernel Logistic Regression

Convergence Analysis of Kernel Conjugate Gradient for Functional Linear Regression

Constrained recursive kernel density/regression estimation by stochastic quasi-gradient methods

On the optimality of target-data-dependent kernel greedy interpolation in Sobolev Reproducing Kernel Hilbert Spaces

Generalization in Kernel Regression Under Realistic Assumptions

Stochastic Low-Rank Kernel Learning for Regression

Iterative Kernel Regression with Preconditioning

Convergence of Gaussian process regression: Optimality, robustness, and relationship with kernel ridge regression

Kernel $ε$-Greedy for Contextual Bandits

Non-uniform Nyström approximation for sparse kernel regression: Theoretical analysis and experimental evaluation