Abstract:Given any domain $X \subseteq \mathbb{R}^d$ and a probability measure $\rho$ on $X$, we study the problem of approximating in $L^2(X,\rho)$ a given function $u:X\to\mathbb{R}$, using its noiseless pointwise evaluations at random samples. For any given linear space $V\subset L^2(X,\rho)$ with dimension $n$, previous works have shown that stable and optimally converging weighted least-squares (WLS) estimators can be constructed using $m$ random samples distributed according to an auxiliary probability measure $\mu$ that depends on $V$, with $m$ being linearly proportional to $n$ up to a logarithmic term. As a first contribution, we present novel results on the stability and accuracy of WLS estimators with a given approximation space, using random samples that are more structured than those used in the previous analysis. As a second contribution, we study approximation by WLS estimators in the adaptive setting. For any sequence of nested spaces $(V_k)_{k} \subset L^2(X,\rho)$, we show that a sequence of WLS estimators of $u$, one for each space $V_k$, can be sequentially constructed such that (i) the estimators remain provably stable with high probability and optimally converging in expectation, simultaneously for all iterations from one to $k$, and (ii) the overall number of samples necessary to construct all the first $k$ estimators remains linearly proportional to the dimension of $V_k$, up to a logarithmic term. The overall number of samples takes into account all the samples generated to build all the estimators from iteration one to $k$. We propose two sampling algorithms that achieve this goal. The first one is a purely random algorithm that recycles most of the samples from the previous iterations. The second algorithm recycles all the samples from all the previous iterations. Such an achievement is made possible by crucially exploiting the structure of the random samples. Finally we apply the results from our analysis to develop numerical methods for the adaptive approximation of functions in high dimension.

Approximation Properties of Exponential Sampling Series in Logarithmic Weighted Spaces

Weighted Approximation By Max-Product Generalized Exponential Sampling Series

Approximation Properties of Mellin-Steklov Type Exponential Sampling Series

Approximation by Modified Generalized Sampling Series

Approximation in Hilbert spaces of the Gaussian and related analytic kernels

Strong Approximation Theorems for Geometrically Weighted Random Series and Their Applications

Certain Approximation Results for Kantorovich Exponential Sampling Series

On the Asymptotic Approximation of Inverse Moment under Sub-Linear Expectations

Advancements in nonlinear exponential sampling: convergence, quantitative analysis and Voronovskaya-type formula

Adaptive Approximation by Optimal Weighted Least-Squares Methods

Approximation on Variable Exponent Spaces by Linear Integral Operators

Polynomials with exponents in compact convex sets and associated weighted extremal functions -- Approximations and regularity

Optimal approximations of power-laws with exponentials

Nonlinear Weighted Best Simultaneous Approximation in Banach Spaces

Infinite-Variate $L^2$-Approximation with Nested Subspace Sampling

Exponential Approximation of Band-Limited Functions from Nonuniform Sampling by Regularization Methods

Approximation by Modified Taylor Polynomials in the Harmonically Weighted Dirichlet Spaces

Exponential Concentration in Stochastic Approximation

Some Approximation Properties of Parametric Baskakov–Schurer–Szász Operators Through a Power Series Summability Method

Universal exponential pointwise convergence for weighted multiple ergodic averages over $ \mathbb{T}^\infty $

Exponential approximation in variable exponent Lebesgue spaces on the real line