Abstract:In this paper, we consider inference and uncertainty quantification for low Tucker rank tensors with additive noise in the high-dimensional regime. Focusing on the output of the higher-order orthogonal iteration (HOOI) algorithm, a commonly used algorithm for tensor singular value decomposition, we establish non-asymptotic distributional theory and study how to construct confidence regions and intervals for both the estimated singular vectors and the tensor entries in the presence of heteroskedastic subgaussian noise, which are further shown to be optimal for homoskedastic Gaussian noise. Furthermore, as a byproduct of our theoretical results, we establish the entrywise convergence of HOOI when initialized via diagonal deletion. To further illustrate the utility of our theoretical results, we then consider several concrete statistical inference tasks. First, in the tensor mixed-membership blockmodel, we consider a two-sample test for equality of membership profiles, and we propose a test statistic with consistency under local alternatives that exhibits a power improvement relative to the corresponding matrix test considered in several previous works. Next, we consider simultaneous inference for small collections of entries of the tensor, and we obtain consistent confidence regions. Finally, focusing on the particular case of testing whether entries of the tensor are equal, we propose a consistent test statistic that shows how index overlap results in different asymptotic standard deviations. All of our proposed procedures are fully data-driven, adaptive to noise distribution and signal strength, and do not rely on sample-splitting, and our main results highlight the effect of higher-order structures on estimation relative to the matrix setting. Our theoretical results are demonstrated through numerical simulations.

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

Efficient Alternating Least Squares Algorithms for Truncated HOSVD of Higher-Order Tensors.

Efficient algorithms for Tucker decomposition via approximate matrix multiplication

On The Tensor Svd And The Optimal Low Rank Orthogonal Approximation Of Tensors

Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions

Very Large-Scale Singular Value Decomposition Using Tensor Train Networks

On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors

A multilinear Nyström algorithm for low-rank approximation of tensors in Tucker format

A rank-adaptive higher-order orthogonal iteration algorithm for truncated Tucker decomposition

RA-HOOI: Rank-adaptive higher-order orthogonal iteration for the fixed-accuracy low multilinear-rank approximation of tensors

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

HOSCF: Efficient decoupling algorithms for finding the best rank-one approximation of higher-order tensors

Multiscale Analysis for Higher-order Tensors

Performance of the Low-Rank TT-SVD for Large Dense Tensors on Modern MultiCore CPUs

A Random Matrix Approach to Low-Multilinear-Rank Tensor Approximation

Efficient Algorithms for Low Tubal Rank Tensor Approximation with Applications to Image Compression, Super-Resolution and Deep Learning

An Iterative Reweighted Method for Tucker Decomposition of Incomplete Multiway Tensors

Statistical Inference for Low-Rank Tensors: Heteroskedasticity, Subgaussianity, and Applications

Randomized Alternating Least Squares for Canonical Tensor Decompositions: Application to a PDE with Random Data

A sequential multilinear Nyström algorithm for streaming low-rank approximation of tensors in Tucker format