Abstract:Given any domain $X \subseteq \mathbb{R}^d$ and a probability measure $\rho$ on $X$, we study the problem of approximating in $L^2(X,\rho)$ a given function $u:X\to\mathbb{R}$, using its noiseless pointwise evaluations at random samples. For any given linear space $V\subset L^2(X,\rho)$ with dimension $n$, previous works have shown that stable and optimally converging weighted least-squares (WLS) estimators can be constructed using $m$ random samples distributed according to an auxiliary probability measure $\mu$ that depends on $V$, with $m$ being linearly proportional to $n$ up to a logarithmic term. As a first contribution, we present novel results on the stability and accuracy of WLS estimators with a given approximation space, using random samples that are more structured than those used in the previous analysis. As a second contribution, we study approximation by WLS estimators in the adaptive setting. For any sequence of nested spaces $(V_k)_{k} \subset L^2(X,\rho)$, we show that a sequence of WLS estimators of $u$, one for each space $V_k$, can be sequentially constructed such that (i) the estimators remain provably stable with high probability and optimally converging in expectation, simultaneously for all iterations from one to $k$, and (ii) the overall number of samples necessary to construct all the first $k$ estimators remains linearly proportional to the dimension of $V_k$, up to a logarithmic term. The overall number of samples takes into account all the samples generated to build all the estimators from iteration one to $k$. We propose two sampling algorithms that achieve this goal. The first one is a purely random algorithm that recycles most of the samples from the previous iterations. The second algorithm recycles all the samples from all the previous iterations. Such an achievement is made possible by crucially exploiting the structure of the random samples. Finally we apply the results from our analysis to develop numerical methods for the adaptive approximation of functions in high dimension.

Adapting to Unknown Smoothness by Aggregation of Thresholded Wavelet Estimators

Uniform almost sure convergence and asymptotic distribution of the wavelet-based estimators of partial derivatives of multivariate density function under weak dependence

Adaptation to inhomogeneous smoothness for densities with irregularities

Minimax adaptive wavelet estimator for the simultaneous blind deconvolution with fractional Gaussian noise

Heavy-tailed Bayesian nonparametric adaptation

Ideal Bayesian Spatial Adaptation

Wasserstein-based Minimax Estimation of Dependence in Multivariate Regularly Varying Extremes

Convergence of the Adapted Smoothed Empirical Measures

Estimation in the convolution structure density model. Part II: adaptation over the scale of anisotropic classes

Adaptive reconstruction of imperfectly-observed monotone functions, with applications to uncertainty quantification

On posterior distribution of Bayesian wavelet thresholding

Adaptive Approximation by Optimal Weighted Least-Squares Methods

Strong uniform convergence rates of the linear wavelet estimator of a multivariate copula density

Wavelet Function Estimation Involving Time Series

Benign overfitting and adaptive nonparametric regression

Adaptive estimation of a quadratic functional by model selection

Optimal uniform convergence rates and asymptotic normality for series estimators under weak dependence and weak conditions

Adaptive Methods or Variational Inequalities with Relatively Smooth and Reletively Strongly Monotone Operators

Adaptive estimation of a function from its Exponential Radon Transform in presence of noise

Directional Smoothness and Gradient Methods: Convergence and Adaptivity

Adaptive Denoising Based on Wavelet Thresholding Method