Random sampling and unisolvent interpolation by almost everywhere analytic functions

Francesco Dell'Accio,Alvise Sommariva,Marco Vianello

2023-03-24

Abstract:We prove a.s. (almost sure) unisolvency of interpolation by continuous random sampling with respect to any given density, in spaces of multivariate a.e. (almost everywhere) analytic functions. Examples are given concerning polynomial and RBF approximation.

Numerical Analysis

What problem does this paper attempt to address?

A note on polynomial-free unisolvence of polyharmonic splines at random points

Len Bos,Alvise Sommariva,Marco Vianello

2023-12-21

Abstract:In this note we prove almost sure unisolvence of RBF interpolation on randomly distributed sequences by a wide class of polyharmonic splines (including Thin-Plate Splines), without polynomial addition.

Numerical Analysis
Polynomial-free unisolvence of polyharmonic splines with odd exponent by random sampling

Alvise Sommariva,Marco Vianello

2024-01-24

Abstract:In a recent paper almost sure unisolvence of RBF interpolation at random points with no polynomial addition was proved, for Thin-Plate Splines and Radial Powers with noninteger exponent. The proving technique left unsolved the case of odd exponents. In this short note we prove almost sure polynomial-free unisolvence in such instances, by a deeper analysis of the interpolation matrix determinant and fundamental properties of analytic functions.

Numerical Analysis
Randomized least-squares with minimal oversampling and interpolation in general spaces

Abdellah Chkifa,Matthieu Dolbeault

2024-02-13

Abstract:In approximation of functions based on point values, least-squares methods provide more stability than interpolation, at the expense of increasing the sampling budget. We show that near-optimal approximation error can nevertheless be achieved, in an expected $L^2$ sense, as soon as the sample size $m$ is larger than the dimension $n$ of the approximation space by a constant ratio. On the other hand, for $m=n$, we obtain an interpolation strategy with a stability factor of order $n$. The proposed sampling algorithms are greedy procedures based on <a class="link-https" data-arxiv-id="0808.0163" href="https://arxiv.org/abs/0808.0163">arXiv:0808.0163</a> and <a class="link-https" data-arxiv-id="1508.03261" href="https://arxiv.org/abs/1508.03261">arXiv:1508.03261</a>, with polynomial computational complexity.

Numerical Analysis
Random interpolation in the Nevanlinna and Smirnov classes and related spaces

Giuseppe Lamberti

2024-09-27

Abstract:We study random interpolating sequences with prescribed radii in the Nevanlinna and Smirnov classes. As it turns out these are characterized by the Blaschke condition. This follows from a more general result. Indeed, we show that this characterization is true in so-called big Hardy-Orlicz spaces. It is noteworthy to mention that conditions for deterministic interpolation in these spaces are given by harmonic majorants, the existence of which is difficult to check in general.

Complex Variables,Functional Analysis,Probability
Sampling recovery in Bochner spaces and applications to parametric PDEs with log-normal random inputs

Felix Bartel,Dinh Dũng

2024-10-22

Abstract:We proved convergence rates of linear sampling recovery of functions in an abstract Bochner space satisfying some weighted $\ell_2$-summability of their generalized polynomial chaos expansion coefficients, by extended least squares methods. As applications to a problem in Computational Uncertainty Quantification, we derived convergence rates of linear collocation approximation of solutions to parametric elliptic PDEs with log-normal random inputs, and of relevant infinite dimensional holomorphic functions on $\mathbb R^\infty$. These convergence rates significantly improve the known results. From the general results we also received the same convergence rates of linear collocation approximation of solutions to parametric elliptic PDEs with affine random inputs.

Numerical Analysis
Unisolvence of unsymmetric random Kansa collocation by Gaussians and other analytic RBF vanishing at infinity

Alvise Sommariva,Marco Vianello

2024-05-29

Abstract:We give a short proof of almost sure invertibility of unsymmetric random Kansa collocation matrices by a class of analytic RBF vanishing at infinity, for the Poisson equation with Dirichlet boundary conditions. Such a class includes popular Positive Definite instances such as Gaussians, Generalized Inverse MultiQuadrics and Matern RBF. The proof works on general domains in any dimension, with any distribution of boundary collocation points and any continuous random distribution of internal collocation points.

Numerical Analysis,Probability
Random sampling and polynomial-free interpolation by Generalized MultiQuadrics

A. Sommariva,M. Vianello

2024-04-16

Abstract:We prove that interpolation matrices for Generalized MultiQuadrics (GMQ) of order greater than one are almost surely nonsingular without polynomial addition, in any dimension and with any continuous random distribution of sampling points. We also include a new class of generalized MultiQuadrics recently proposed by Buhmann and Ortmann.

Numerical Analysis
Random points are good for universal discretization

F. Dai,V. Temlyakov

DOI: https://doi.org/10.1016/j.jmaa.2023.127570

IF: 1.417

2024-01-01

Journal of Mathematical Analysis and Applications

Abstract:There has been significant progress in the study of sampling discretization of integral norms for both a designated finite-dimensional function space and a finite collection of such function spaces (universal discretization). Sampling discretization results turn out to be very useful in various applications, particularly in sampling recovery. Recent sampling discretization results typically provide existence of good sampling points for discretization. In this paper, we show that independent and identically distributed random points provide good universal discretization with high probability. Furthermore, we demonstrate that a simple greedy algorithm based on those points that are good for universal discretization provides excellent sparse recovery results in the square norm.

mathematics, applied
Univariate interpolation by exponential functions and gaussian RBFs for generic sets of nodes

Dmitry Yarotsky

DOI: https://doi.org/10.1016/j.jat.2012.11.007

2012-10-22

Abstract:We consider interpolation of univariate functions on arbitrary sets of nodes by Gaussian radial basis functions or by exponential functions. We derive closed-form expressions for the interpolation error based on the Harish-Chandra-Itzykson-Zuber formula. We then prove the exponential convergence of interpolation for functions analytic in a sufficiently large domain. As an application, we prove the global exponential convergence of optimization by expected improvement for such functions.

Numerical Analysis,Optimization and Control
A Random Integration Algorithm for High-dimensional Function Spaces

Liang Chen,Minqiang Xu,Haizhang Zhang

2024-06-24

Abstract:We introduce a novel random integration algorithm that boasts both high convergence order and polynomial tractability for functions characterized by sparse frequencies or rapidly decaying Fourier coefficients. Specifically, for integration in periodic isotropic Sobolev space and the isotropic Sobolev space with compact support, our approach attains a nearly optimal root mean square error (RMSE) bound. In contrast to previous nearly optimal algorithms, our method exhibits polynomial tractability, ensuring that the number of samples does not scale exponentially with increasing dimensions. Our integration algorithm also enjoys nearly optimal bound for weighted Korobov space. Furthermore, the algorithm can be applied without the need for prior knowledge of weights, distinguishing it from the component-by-component algorithm. For integration in the Wiener algebra, the sample complexity of our algorithm is independent of the decay rate of Fourier coefficients. The effectiveness of the integration is confirmed through numerical experiments.

Numerical Analysis
Almost-Uniform Sampling of Points on High-Dimensional Algebraic Varieties

Mahdi Cheraghchi,Amin Shokrollahi

DOI: https://doi.org/10.48550/arXiv.0902.1254

2009-02-07

Data Structures and Algorithms

Abstract:We consider the problem of uniform sampling of points on an algebraic variety. Specifically, we develop a randomized algorithm that, given a small set of multivariate polynomials over a sufficiently large finite field, produces a common zero of the polynomials almost uniformly at random. The statistical distance between the output distribution of the algorithm and the uniform distribution on the set of common zeros is polynomially small in the field size, and the running time of the algorithm is polynomial in the description of the polynomials and their degrees provided that the number of the polynomials is a constant.
Relevant Sampling in a reproducing kernel subspace of Orlicz space

Shivam Bajpeyi,Dhiraj Patel,S. Sivananthan

DOI: https://doi.org/10.1142/s021953052450012x

IF: 1.9559

2024-03-22

Analysis and Applications

Abstract:In this paper, we aim to provide a general paradigm for dealing with the sampling and random sampling problem in a reproducing kernel subspace of Orlicz space [Formula: see text]. We consider the function space [Formula: see text] as the image of an idempotent integral operator on [Formula: see text], where the integral kernel satisfies certain off-diagonal decay and regularity conditions. The model example of such reproducing kernel subspace of [Formula: see text] includes the finitely generated shift-invariant space and signal space with a finite rate of innovation. We show that a signal in [Formula: see text] can be stably reconstructed from its samples at distinct points separated by a sufficiently small gap. Next, we deduce that the random sampling inequality holds with a high probability for the class of functions in [Formula: see text] concentrated on a cube [Formula: see text], when the samples collected at i.i.d. random points are drawn on [Formula: see text] of order [Formula: see text].

mathematics, applied
Almost-sure quasi-optimal approximation in reproducing kernel Hilbert spaces

Philipp Trunschke,Anthony Nouy

2024-10-08

Abstract:This manuscript addresses the problem of approximating an unknown function from point evaluations. When obtaining these point evaluations is costly, minimising the required sample size becomes crucial, and it is unreasonable to reserve a sufficiently large test sample for estimating the approximation accuracy. Therefore, an approximation with a certified quasi-optimality factor is required. This article shows that such an approximation can be obtained when the sought function lies in a reproducing kernel Hilbert space (RKHS) and is to be approximated in a finite-dimensional linear subspace. However, selecting the sample points to minimise the quasi-optimality factor requires optimising over an infinite set of points and computing exact inner products in RKHS, which is often infeasible in practice. Extending results from optimal sampling for $L^2$ approximation, the present manuscript proves that random points, drawn independently from the Christoffel sampling distribution associated with $\mathcal{V}_d$, can yield a controllable quasi-optimality factor with high probability. Inspired by this result, a novel sampling scheme, coined subspace-informed volume sampling, is introduced and evaluated in numerical experiments, where it outperforms classical i.i.d. Christoffel sampling and continuous volume sampling. To reduce the size of such a random sample, an additional greedy subsampling scheme with provable suboptimality bounds is introduced. Our presentation is of independent interest to the community researching the parametrised background data weak (PBDW) method, as it offers a simpler interpretation of the method.

Numerical Analysis
Sampling and interpolation for analytic selfmappings of the disc

Nacho Monreal Galan,Michael Papadimitrakis

2023-08-02

Abstract:Two different problems are considered here. First, a characterization of sampling sequences for the class of analytic functions from the disc into itself is given. Second, a version of Schwarz-Pick Lemma for $n$ points leads to an interpolation problem for the same functions, which may be considered as a particular case of the classical Nevanlinna-Pick interpolation problem.

Complex Variables
Marcinkiewicz--Zygmund inequalities for scattered and random data on the $q$-sphere

Frank Filbir,Ralf Hielscher,Thomas Jahn,Tino Ullrich

2023-03-01

Abstract:The recovery of multivariate functions and estimating their integrals from finitely many samples is one of the central tasks in modern approximation theory. Marcinkiewicz--Zygmund inequalities provide answers to both the recovery and the quadrature aspect. In this paper, we put ourselves on the $q$-dimensional sphere $\mathbb{S}^q$, and investigate how well continuous $L_p$-norms of polynomials $f$ of maximum degree $n$ on the sphere $\mathbb{S}^q$ can be discretized by positively weighted $L_p$-sum of finitely many samples, and discuss the relationship between the offset between the continuous and discrete quantities, the number and distribution of the (deterministic or randomly chosen) sample points $\xi_1,\ldots,\xi_N$ on $\mathbb{S}^q$, the dimension $q$, and the polynomial degree $n$.

Numerical Analysis
Non-uniform Random Sampling and Reconstruction in Signal Spaces with Finite Rate of Innovation

Yancheng Lu,Jun Xian

DOI: https://doi.org/10.1007/s10440-019-00298-6

IF: 1.563

2019-11-06

Acta Applicandae Mathematicae

Abstract:We consider non-uniform random sampling in a signal space with finite rate of innovation (V^{2}(varLambda,varPhi) subset{mathrm {L}}^{2}(mathbb {R}^{d})) generated by a series of functions (varPhi=(phi_{lambda})_{lambda invarLambda}). A subset (V_{R,delta}^{2}(varLambda,varPhi)) of (V^{2}(varLambda,varPhi)) is consisting of functions concentrates at least (1-delta) of the whole energy in a cube with side lengths (R). Under mild assumptions on the generators and the probability distribution, we show that for (R) sufficiently large, taking (O(R^{d} log(R^{d}))) many samples with such the non-uniform distribution yields a sampling set for (V_{R,delta}^{2}(varLambda,varPhi)) with high probability. We impose compact support on the generators as an additional constraint for obtaining a reconstruction algorithm from non-uniform random sampling with high probability.

mathematics, applied
Efficient Numerical Integration in Reproducing Kernel Hilbert Spaces via Leverage Scores Sampling

Antoine Chatalic,Nicolas Schreuder,Ernesto De Vito,Lorenzo Rosasco

2023-11-23

Abstract:In this work we consider the problem of numerical integration, i.e., approximating integrals with respect to a target probability measure using only pointwise evaluations of the integrand. We focus on the setting in which the target distribution is only accessible through a set of $n$ i.i.d. observations, and the integrand belongs to a reproducing kernel Hilbert space. We propose an efficient procedure which exploits a small i.i.d. random subset of $m<n$ samples drawn either uniformly or using approximate leverage scores from the initial observations. Our main result is an upper bound on the approximation error of this procedure for both sampling strategies. It yields sufficient conditions on the subsample size to recover the standard (optimal) $n^{-1/2}$ rate while reducing drastically the number of functions evaluations, and thus the overall computational cost. Moreover, we obtain rates with respect to the number $m$ of evaluations of the integrand which adapt to its smoothness, and match known optimal rates for instance for Sobolev spaces. We illustrate our theoretical findings with numerical experiments on real datasets, which highlight the attractive efficiency-accuracy tradeoff of our method compared to existing randomized and greedy quadrature methods. We note that, the problem of numerical integration in RKHS amounts to designing a discrete approximation of the kernel mean embedding of the target distribution. As a consequence, direct applications of our results also include the efficient computation of maximum mean discrepancies between distributions and the design of efficient kernel-based tests.

Machine Learning,Numerical Analysis
Optimal approximation of infinite-dimensional holomorphic functions II: recovery from i.i.d. pointwise samples

Ben Adcock,Nick Dexter,Sebastian Moraga

2024-07-20

Abstract:Infinite-dimensional, holomorphic functions have been studied in detail over the last several decades, due to their relevance to parametric differential equations and computational uncertainty quantification. The approximation of such functions from finitely many samples is of particular interest, due to the practical importance of constructing surrogate models to complex mathematical models of physical processes. In a previous work, [5] we studied the approximation of so-called Banach-valued, $(\boldsymbol{b},\varepsilon)$-holomorphic functions on the infinite-dimensional hypercube $[-1,1]^{\mathbb{N}}$ from $m$ (potentially adaptive) samples. In particular, we derived lower bounds for the adaptive $m$-widths for classes of such functions, which showed that certain algebraic rates of the form $m^{1/2-1/p}$ are the best possible regardless of the sampling-recovery pair. In this work, we continue this investigation by focusing on the practical case where the samples are pointwise evaluations drawn identically and independently from a probability measure. Specifically, for Hilbert-valued $(\boldsymbol{b},\varepsilon)$-holomorphic functions, we show that the same rates can be achieved (up to a small polylogarithmic or algebraic factor) for essentially arbitrary tensor-product Jacobi (ultraspherical) measures. Our reconstruction maps are based on least squares and compressed sensing procedures using the corresponding orthonormal Jacobi polynomials. In doing so, we strengthen and generalize past work that has derived weaker nonuniform guarantees for the uniform and Chebyshev measures (and corresponding polynomials) only. We also extend various best $s$-term polynomial approximation error bounds to arbitrary Jacobi polynomial expansions. Overall, we demonstrate that i.i.d.\ pointwise samples are near-optimal for the recovery of infinite-dimensional, holomorphic functions.

Numerical Analysis

Random sampling and unisolvent interpolation by almost everywhere analytic functions

A note on polynomial-free unisolvence of polyharmonic splines at random points

Polynomial-free unisolvence of polyharmonic splines with odd exponent by random sampling

Randomized least-squares with minimal oversampling and interpolation in general spaces

Random interpolation in the Nevanlinna and Smirnov classes and related spaces

Sampling recovery in Bochner spaces and applications to parametric PDEs with log-normal random inputs

Unisolvence of unsymmetric random Kansa collocation by Gaussians and other analytic RBF vanishing at infinity

Random sampling and polynomial-free interpolation by Generalized MultiQuadrics

Random points are good for universal discretization

Univariate interpolation by exponential functions and gaussian RBFs for generic sets of nodes

A Random Integration Algorithm for High-dimensional Function Spaces

Almost-Uniform Sampling of Points on High-Dimensional Algebraic Varieties

Relevant Sampling in a reproducing kernel subspace of Orlicz space

Almost-sure quasi-optimal approximation in reproducing kernel Hilbert spaces

Sampling and interpolation for analytic selfmappings of the disc

Marcinkiewicz--Zygmund inequalities for scattered and random data on the $q$-sphere

Non-uniform Random Sampling and Reconstruction in Signal Spaces with Finite Rate of Innovation

Efficient Numerical Integration in Reproducing Kernel Hilbert Spaces via Leverage Scores Sampling

Optimal approximation of infinite-dimensional holomorphic functions II: recovery from i.i.d. pointwise samples