Abstract:The distribution of centered Gaussian random fields (GRFs) indexed by compacta such as smooth, bounded Euclidean domains or smooth, compact and orientable manifolds is determined by their covariance operators. We consider centered GRFs given as variational solutions to coloring operator equations driven by spatial white noise, with an elliptic self-adjoint pseudodifferential coloring operator from the Hörmander class. This includes the Matérn class of GRFs as a special case. Using biorthogonal multiresolution analyses on the manifold, we prove that the precision and covariance operators, respectively, may be identified with bi-infinite matrices and finite sections may be diagonally preconditioned rendering the condition number independent of the dimension p of this section. We prove that a tapering strategy by thresholding applied on finite sections of the bi-infinite precision and covariance matrices results in optimally numerically sparse approximations. That is, asymptotically only linearly many nonzero matrix entries are sufficient to approximate the original section of the bi-infinite covariance or precision matrix using this tapering strategy to arbitrary precision. The locations of these nonzero matrix entries can be determined a priori. The tapered covariance or precision matrices may also be optimally diagonally preconditioned. Analysis of the relative size of the entries of the tapered covariance matrices motivates novel, multilevel Monte Carlo (MLMC) oracles for covariance estimation, in sample complexity that scales log-linearly with respect to the number p of parameters. In addition, we propose and analyze novel compressive algorithms for simulating and kriging of GRFs. The complexity (work and memory vs. accuracy) of these three algorithms scales near-optimally in terms of the number of parameters p of the sample-wise approximation of the GRF in Sobolev scales.

Simulating Gaussian vectors via randomized dimension reduction and PCA

Which exceptional low-dimensional projections of a Gaussian point cloud can be found in polynomial time?

Limit results for distributed estimation of invariant subspaces in multiple networks inference and PCA

Matrix normal PCA for interpretable dimension reduction and graphical noise modeling

Contraction rates and projection subspace estimation with Gaussian process priors in high dimension

Generalized Principal Component Analysis for Large-dimensional Matrix Factor Model

Multilevel approximation of Gaussian random fields: Covariance compression, estimation, and spatial prediction

Empirical approximation of the gaussian distribution in $\mathbb{R}^d$

Optimal Differentially Private PCA and Estimation for Spiked Covariance Matrices

Gaussian Approximations for the $k$th coordinate of sums of random vectors

On Probabilistic Embeddings in Optimal Dimension Reduction

Uniqueness of Non-Gaussianity-Based Dimension Reduction

Gaussian universality for approximately polynomial functions of high-dimensional data

Estimation of multiple mean vectors in high dimension

Statistical Inference on High Dimensional Gaussian Graphical Regression Models

Principal component analysis for Gaussian process posteriors

Covariance estimation with direction dependence accuracy

Statistical Inference for High-Dimensional Matrix-Variate Factor Model

Subspace Principal Angle Preserving Property Of Gaussian Random Projection

Robust Gaussian Covariance Estimation in Nearly-Matrix Multiplication Time

A note on estimating the dimension from a random geometric graph