Abstract:The low-tubal-rank tensor model has been recently proposed for real-world multidimensional data. In this paper, we study the low-tubal-rank tensor completion problem, i.e., to recover a third-order tensor by observing a subset of its elements selected uniformly at random. We propose a fast iterative algorithm, called {\em Tubal-Alt-Min}, that is inspired by a similar approach for low-rank matrix completion. The unknown low-tubal-rank tensor is represented as the product of two much smaller tensors with the low-tubal-rank property being automatically incorporated, and Tubal-Alt-Min alternates between estimating those two tensors using tensor least squares minimization. First, we note that tensor least squares minimization is different from its matrix counterpart and nontrivial as the circular convolution operator of the low-tubal-rank tensor model is intertwined with the sub-sampling operator. Second, the theoretical performance guarantee is challenging since Tubal-Alt-Min is iterative and nonconvex in nature. We prove that 1) Tubal-Alt-Min guarantees exponential convergence to the global optima, and 2) for an $n \times n \times k$ tensor with tubal-rank $r \ll n$, the required sampling complexity is $O(nr^2k \log^3 n)$ and the computational complexity is $O(n^2rk^2 \log^2 n)$. Third, on both synthetic data and real-world video data, evaluation results show that compared with tensor-nuclear norm minimization (TNN-ADMM), Tubal-Alt-Min improves the recovery error dramatically (by orders of magnitude). It is estimated that Tubal-Alt-Min converges at an exponential rate $10^{-0.4423 \text{Iter}}$ where $\text{Iter}$ denotes the number of iterations, which is much faster than TNN-ADMM's $10^{-0.0332 \text{Iter}}$, and the running time can be accelerated by more than $5$ times for a $200 \times 200 \times 20$ tensor.

Adaptive Cross Tubal Tensor Approximation

Adaptive Cross Tubal Tensor Approximation

Efficient Algorithms for Low Tubal Rank Tensor Approximation with Applications to Image Compression, Super-Resolution and Deep Learning

Low-tubal-rank Tensor Completion using Alternating Minimization

Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent

Cross Tensor Approximation Methods for Compression and Dimensionality Reduction

An Efficient Randomized Fixed-Precision Algorithm for Tensor Singular Value Decomposition

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

Fast randomized algorithms for computing the generalized tensor SVD based on the tubal product

Randomized algorithms for computing the tensor train approximation and their applications

Distributed memory parallel adaptive tensor-train cross approximation

Multi-Tubal Rank of Third Order Tensor and Related Low Rank Tensor Completion Problem

Robust Low-Tubal-rank tensor recovery Using Discrete Empirical Interpolation Method with Optimized Slice/Feature Selection

Effective Streaming Low-Tubal-Rank Tensor Approximation via Frequent Directions

Very Large-Scale Singular Value Decomposition Using Tensor Train Networks

A Randomized Algorithm for Tensor Singular Value Decomposition using an Arbitrary Number of Passes

A hybrid Alternating Least Squares -- TT Cross algorithm for parametric PDEs

Robust low tubal rank tensor recovery via L 2 E criterion

Tensor N-tubal rank and its convex relaxation for low-rank tensor recovery

Hot-SVD: Higher-Order t-Singular Value Decomposition for Tensors based on Tensor-Tensor Product

Efficient Alternating Least Squares Algorithms for Truncated HOSVD of Higher-Order Tensors.