Abstract:The tensor train (TT) format enjoys appealing advantages in handling structural high-order tensors. The recent decade has witnessed the wide applications of TT-format tensors from diverse disciplines, among which tensor completion has drawn considerable attention. Numerous fast algorithms, including the Riemannian gradient descent (RGrad), have been proposed for the TT-format tensor completion. However, the theoretical guarantees of these algorithms are largely missing or sub-optimal, partly due to the complicated and recursive algebraic operations in TT-format decomposition. Moreover, existing results established for the tensors of other formats, for example, Tucker and CP, are inapplicable because the algorithms treating TT-format tensors are substantially different and more involved. In this paper, we provide, to our best knowledge, the first theoretical guarantees of the convergence of RGrad algorithm for TT-format tensor completion, under a nearly optimal sample size condition. The RGrad algorithm converges linearly with a constant contraction rate that is free of tensor condition number without the necessity of re-conditioning. We also propose a novel approach, referred to as the sequential second-order moment method, to attain a warm initialization under a similar sample size requirement. As a byproduct, our result even significantly refines the prior investigation of RGrad algorithm for matrix completion. Lastly, statistically (near) optimal rate is derived for RGrad algorithm if the observed entries consist of random sub-Gaussian noise. Numerical experiments confirm our theoretical discovery and showcase the computational speedup gained by the TT-format decomposition.

Randomized algorithms for computing the tensor train approximation and their applications

Randomized Algorithms for the Approximations of Tucker and the Tensor Train Decompositions.

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

A Randomized Block Krylov Method for Tensor Train Approximation

Efficient Algorithms for Low Tubal Rank Tensor Approximation with Applications to Image Compression, Super-Resolution and Deep Learning

Distributed memory parallel adaptive tensor-train cross approximation

An Efficient Randomized Fixed-Precision Algorithm for Tensor Singular Value Decomposition

Efficient algorithms for Tucker decomposition via approximate matrix multiplication

Nonconvex Robust High-Order Tensor Completion Using Randomized Low-Rank Approximation

The Computation of Low Multilinear Rank Approximations of Tensors Via Power Scheme and Random Projection

Randomized algorithms for streaming low-rank approximation in tree tensor network format

Low-Rank Tucker Approximation of a Tensor from Streaming Data

An Efficient Randomized Algorithm for Computing the Approximate Tucker Decomposition

Very Large-Scale Singular Value Decomposition Using Tensor Train Networks

Efficient randomized tensor-based algorithms for function approximation and low-rank kernel interactions

Several Approximation Algorithms for Sparse Best Rank-1 Approximation to Higher-Order Tensors

Tensor Train Factorization and Completion under Noisy Data with Prior Analysis and Rank Estimation

Provable Tensor-Train Format Tensor Completion by Riemannian Optimization

Faster Tensor Train Decomposition for Sparse Data

Parallel Randomized Tucker Decomposition Algorithms