Abstract:Given any domain $X \subseteq \mathbb{R}^d$ and a probability measure $\rho$ on $X$, we study the problem of approximating in $L^2(X,\rho)$ a given function $u:X\to\mathbb{R}$, using its noiseless pointwise evaluations at random samples. For any given linear space $V\subset L^2(X,\rho)$ with dimension $n$, previous works have shown that stable and optimally converging weighted least-squares (WLS) estimators can be constructed using $m$ random samples distributed according to an auxiliary probability measure $\mu$ that depends on $V$, with $m$ being linearly proportional to $n$ up to a logarithmic term. As a first contribution, we present novel results on the stability and accuracy of WLS estimators with a given approximation space, using random samples that are more structured than those used in the previous analysis. As a second contribution, we study approximation by WLS estimators in the adaptive setting. For any sequence of nested spaces $(V_k)_{k} \subset L^2(X,\rho)$, we show that a sequence of WLS estimators of $u$, one for each space $V_k$, can be sequentially constructed such that (i) the estimators remain provably stable with high probability and optimally converging in expectation, simultaneously for all iterations from one to $k$, and (ii) the overall number of samples necessary to construct all the first $k$ estimators remains linearly proportional to the dimension of $V_k$, up to a logarithmic term. The overall number of samples takes into account all the samples generated to build all the estimators from iteration one to $k$. We propose two sampling algorithms that achieve this goal. The first one is a purely random algorithm that recycles most of the samples from the previous iterations. The second algorithm recycles all the samples from all the previous iterations. Such an achievement is made possible by crucially exploiting the structure of the random samples. Finally we apply the results from our analysis to develop numerical methods for the adaptive approximation of functions in high dimension.

Stability of Discrete Empirical Interpolation and Gappy Proper Orthogonal Decomposition with Randomized and Deterministic Sampling Points

Piecewise linear interpolation of noise in finite element approximations of parabolic SPDEs

Compressive Sampling of Polynomial Chaos Expansions: Convergence Analysis and Sampling Strategies

High-order empirical interpolation methods for real time solution of parametrized nonlinear PDEs

Nonlinear Model Reduction via Discrete Empirical Interpolation

Stability and Sample-based Approximations of Composite Stochastic Optimization Problems

Online randomized interpolative decomposition with a posteriori error estimator for temporal PDE data reduction

Model order reduction with novel discrete empirical interpolation methods in space-time

Model order reduction with novel discrete empirical interpolation methods in space–time

A meshless method to compute the proper orthogonal decomposition and its variants from scattered data

Lipschitz Interpolation: Non-parametric Convergence under Bounded Stochastic Noise

Randomized least-squares with minimal oversampling and interpolation in general spaces

First-order empirical interpolation method for real-time solution of parametric time-dependent nonlinear PDEs

A Distributed Block-Split Gibbs Sampler with Hypergraph Structure for High-Dimensional Inverse Problems

Adaptive Approximation by Optimal Weighted Least-Squares Methods

Stochastic interpolation of sparsely sampled time series via multi-point fractional Brownian bridges

On log-concave approximations of high-dimensional posterior measures and stability properties in non-linear inverse problems

Stability of Least Square Approximation under Random Sampling

Sparse Discrete Empirical Interpolation Method: State Estimation from Few Sensors

Sparse approximation of data-driven Polynomial Chaos expansions: an induced sampling approach

Hierarchic Flows to Estimate and Sample High-dimensional Probabilities