Abstract:In this paper, we consider inference and uncertainty quantification for low Tucker rank tensors with additive noise in the high-dimensional regime. Focusing on the output of the higher-order orthogonal iteration (HOOI) algorithm, a commonly used algorithm for tensor singular value decomposition, we establish non-asymptotic distributional theory and study how to construct confidence regions and intervals for both the estimated singular vectors and the tensor entries in the presence of heteroskedastic subgaussian noise, which are further shown to be optimal for homoskedastic Gaussian noise. Furthermore, as a byproduct of our theoretical results, we establish the entrywise convergence of HOOI when initialized via diagonal deletion. To further illustrate the utility of our theoretical results, we then consider several concrete statistical inference tasks. First, in the tensor mixed-membership blockmodel, we consider a two-sample test for equality of membership profiles, and we propose a test statistic with consistency under local alternatives that exhibits a power improvement relative to the corresponding matrix test considered in several previous works. Next, we consider simultaneous inference for small collections of entries of the tensor, and we obtain consistent confidence regions. Finally, focusing on the particular case of testing whether entries of the tensor are equal, we propose a consistent test statistic that shows how index overlap results in different asymptotic standard deviations. All of our proposed procedures are fully data-driven, adaptive to noise distribution and signal strength, and do not rely on sample-splitting, and our main results highlight the effect of higher-order structures on estimation relative to the matrix setting. Our theoretical results are demonstrated through numerical simulations.

Efficient Alternating Least Squares Algorithms for Truncated HOSVD of Higher-Order Tensors.

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

On The Tensor Svd And The Optimal Low Rank Orthogonal Approximation Of Tensors

A rank-adaptive higher-order orthogonal iteration algorithm for truncated Tucker decomposition

Efficient algorithms for Tucker decomposition via approximate matrix multiplication

Very Large-Scale Singular Value Decomposition Using Tensor Train Networks

RA-HOOI: Rank-adaptive higher-order orthogonal iteration for the fixed-accuracy low multilinear-rank approximation of tensors

Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions

HOSCF: Efficient decoupling algorithms for finding the best rank-one approximation of higher-order tensors

Randomized Algorithms for Computation of Tucker Decomposition and Higher Order SVD (HOSVD)

Multiscale Analysis for Higher-order Tensors

Incremental algorithms for truncated higher-order singular value decompositions

Statistical Inference for Low-Rank Tensors: Heteroskedasticity, Subgaussianity, and Applications

A multilinear Nyström algorithm for low-rank approximation of tensors in Tucker format

On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors

Empirical Evaluation of Four Tensor Decomposition Algorithms

Hot-SVD: Higher-Order t-Singular Value Decomposition for Tensors based on Tensor-Tensor Product

Randomized Alternating Least Squares for Canonical Tensor Decompositions: Application to a PDE with Random Data

The Sup-norm Perturbation of HOSVD and Low Rank Tensor Denoising

On Quaternion Higher-Order Singular Value Decomposition: Models and Analysis

Fast Updating Truncated SVD for Representation Learning with Sparse Matrices