Abstract:Many problems in high-dimensional statistics appear to have a statistical-computational gap: a range of values of the signal-to-noise ratio where inference is information-theoretically possible, but (conjecturally) computationally intractable. A canonical such problem is Tensor PCA, where we observe a tensor $Y$ consisting of a rank-one signal plus Gaussian noise. Multiple lines of work suggest that Tensor PCA becomes computationally hard at a critical value of the signal's magnitude. In particular, below this transition, no low-degree polynomial algorithm can detect the signal with high probability; conversely, various spectral algorithms are known to succeed above this transition. We unify and extend this work by considering tensor networks, orthogonally invariant polynomials where multiple copies of $Y$ are "contracted" to produce scalars, vectors, matrices, or other tensors. We define a new set of objects, tensor cumulants, which provide an explicit, near-orthogonal basis for invariant polynomials of a given degree. This basis lets us unify and strengthen previous results on low-degree hardness, giving a combinatorial explanation of the hardness transition and of a continuum of subexponential-time algorithms that work below it, and proving tight lower bounds against low-degree polynomials for recovering rather than just detecting the signal. It also lets us analyze a new problem of distinguishing between different tensor ensembles, such as Wigner and Wishart tensors, establishing a sharp computational threshold and giving evidence of a new statistical-computational gap in the Central Limit Theorem for random tensors. Finally, we believe these cumulants are valuable mathematical objects in their own right: they generalize the free cumulants of free probability theory from matrices to tensors, and share many of their properties, including additivity under additive free convolution.

Random Tensor Analysis: Outlier Detection and Sample-Size Determination

Distance-based outlier detection for high dimension, low sample size data

Chernoff Bounds for Tensor Expanders on Riemannian Manifolds Using Graph Laplacian Approximation

Random Tensor Inequalities and Tail bounds for Bivariate Random Tensor Means, Part II

T product Tensors Part II: Tail Bounds for Sums of Random T product Tensors

Random Tensor Inequalities and Tail bounds for Bivariate Random Tensor Means, Part I

Tail Bounds for Functions of Weighted Tensor Sums Derived from Random Walks on Riemannian Manifolds

On Dimension-free Tail Inequalities for Sums of Random Matrices and Applications.

Statistical Inference for Low-Rank Tensors: Heteroskedasticity, Subgaussianity, and Applications

General tail bounds for random tensors summation: Majorization approach

Outlier Cluster Formation in Spectral Clustering

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Randomized Algorithms for the Approximations of Tucker and the Tensor Train Decompositions.

A Novel Tensor Algebraic Approach for High-Dimensional Outlier Detection under Data Misalignment

Robust Data Clustering with Outliers via Transformed Tensor Low-Rank Representation

Randomized Algorithms for Computation of Tucker Decomposition and Higher Order SVD (HOSVD)

Outliers for deformed inhomogeneous random matrices

On spectral outliers of inhomogeneous symmetric random matrices

Tail bounds for Multivariate Random Tensor Means

Tensor cumulants for statistical inference on invariant distributions

Statistical Inference in Tensor Completion: Optimal Uncertainty Quantification and Statistical-to-Computational Gaps