Abstract:The low-tubal-rank tensor model has been recently proposed for real-world multidimensional data. In this paper, we study the low-tubal-rank tensor completion problem, i.e., to recover a third-order tensor by observing a subset of its elements selected uniformly at random. We propose a fast iterative algorithm, called {\em Tubal-Alt-Min}, that is inspired by a similar approach for low-rank matrix completion. The unknown low-tubal-rank tensor is represented as the product of two much smaller tensors with the low-tubal-rank property being automatically incorporated, and Tubal-Alt-Min alternates between estimating those two tensors using tensor least squares minimization. First, we note that tensor least squares minimization is different from its matrix counterpart and nontrivial as the circular convolution operator of the low-tubal-rank tensor model is intertwined with the sub-sampling operator. Second, the theoretical performance guarantee is challenging since Tubal-Alt-Min is iterative and nonconvex in nature. We prove that 1) Tubal-Alt-Min guarantees exponential convergence to the global optima, and 2) for an $n \times n \times k$ tensor with tubal-rank $r \ll n$, the required sampling complexity is $O(nr^2k \log^3 n)$ and the computational complexity is $O(n^2rk^2 \log^2 n)$. Third, on both synthetic data and real-world video data, evaluation results show that compared with tensor-nuclear norm minimization (TNN-ADMM), Tubal-Alt-Min improves the recovery error dramatically (by orders of magnitude). It is estimated that Tubal-Alt-Min converges at an exponential rate $10^{-0.4423 \text{Iter}}$ where $\text{Iter}$ denotes the number of iterations, which is much faster than TNN-ADMM's $10^{-0.0332 \text{Iter}}$, and the running time can be accelerated by more than $5$ times for a $200 \times 200 \times 20$ tensor.

On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors

Symmetric Rank-1 Approximation of Symmetric High-Order Tensors.

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

On The Tensor Svd And The Optimal Low Rank Orthogonal Approximation Of Tensors

Some Convergence Results on the Regularized Alternating Least-Squares Method for Tensor Decomposition

Decomposing tensors via rank-one approximations

Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplay

The Computation of Low Multilinear Rank Approximations of Tensors Via Power Scheme and Random Projection

Low Rank Tensor Decompositions and Approximations

Low-rank optimization on Tucker tensor varieties

Robust Approximations of Low-Rank Minimization for Tensor Completion

Rank Properties and Computational Methods for Orthogonal Tensor Decompositions

Decomposition of linear tensor transformations

HOSCF: Efficient decoupling algorithms for finding the best rank-one approximation of higher-order tensors

Asymptotic Log-Det Sum-of-Ranks Minimization via Tensor (Alternating) Iteratively Reweighted Least Squares

Adaptive Low-Rank Methods: Problems on Sobolev Spaces

Nonconvex Robust High-Order Tensor Completion Using Randomized Low-Rank Approximation

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

An Approximate Projection onto the Tangent Cone to the Variety of Third-Order Tensors of Bounded Tensor-Train Rank

Subrank and optimal reduction of scalar multiplications to generic tensors

Low-tubal-rank Tensor Completion using Alternating Minimization