Abstract:The low-tubal-rank tensor model has been recently proposed for real-world multidimensional data. In this paper, we study the low-tubal-rank tensor completion problem, i.e., to recover a third-order tensor by observing a subset of its elements selected uniformly at random. We propose a fast iterative algorithm, called {\em Tubal-Alt-Min}, that is inspired by a similar approach for low-rank matrix completion. The unknown low-tubal-rank tensor is represented as the product of two much smaller tensors with the low-tubal-rank property being automatically incorporated, and Tubal-Alt-Min alternates between estimating those two tensors using tensor least squares minimization. First, we note that tensor least squares minimization is different from its matrix counterpart and nontrivial as the circular convolution operator of the low-tubal-rank tensor model is intertwined with the sub-sampling operator. Second, the theoretical performance guarantee is challenging since Tubal-Alt-Min is iterative and nonconvex in nature. We prove that 1) Tubal-Alt-Min guarantees exponential convergence to the global optima, and 2) for an $n \times n \times k$ tensor with tubal-rank $r \ll n$, the required sampling complexity is $O(nr^2k \log^3 n)$ and the computational complexity is $O(n^2rk^2 \log^2 n)$. Third, on both synthetic data and real-world video data, evaluation results show that compared with tensor-nuclear norm minimization (TNN-ADMM), Tubal-Alt-Min improves the recovery error dramatically (by orders of magnitude). It is estimated that Tubal-Alt-Min converges at an exponential rate $10^{-0.4423 \text{Iter}}$ where $\text{Iter}$ denotes the number of iterations, which is much faster than TNN-ADMM's $10^{-0.0332 \text{Iter}}$, and the running time can be accelerated by more than $5$ times for a $200 \times 200 \times 20$ tensor.

A novel minimization framework of tensor tubal rank and its multi-dimensional image completion application

A Novel $ \ell_{0} $ Minimization Framework of Tensor Tubal Rank and Its Multi-Dimensional Image Completion Application

T-SVD Based Non-convex Tensor Completion and Robust Principal Component Analysis.

Tensor completion via nonconvex tensor ring rank minimization with guaranteed convergence

Iterative Tensor Eigen Rank Minimization for Low-Rank Tensor Completion.

Low rank tensor completion with sparse regularization in a transformed domain

Nonconvex Tensor Rank Minimization and Its Applications to Tensor Recovery.

Rank Minimization on Tensor Ring: A New Paradigm in Scalable Tensor Decomposition and Completion

Hybrid Singular Value Thresholding For Tensor Completion

A Novel Shrinkage Operator for Tensor Completion with Low-Tubal-Rank Approximation

Rank Revealing‐based Tensor Completion Using Improved Generalized Tensor Multi‐rank Minimization

TENSOR TRAIN RANK MINIMIZATION WITH NONLOCAL SELF-SIMILARITY FOR TENSOR COMPLETION

A New Surrogate for Tensor Multirank and Applications in Image and Video Completion

Tensor Completion Via a Multi-Linear Low-N-rank Factorization Model

Tensor Ring Decomposition with Rank Minimization on Latent Space: An Efficient Approach for Tensor Completion

TENSOR COMPLETION VIA GLOBAL LOW-TUBAL-RANKNESS AND NONLOCAL SELF-SIMILARITY

Multi-Tubal Rank of Third Order Tensor and Related Low Rank Tensor Completion Problem

Two New Low Rank Tensor Completion Methods Based on Sum Nuclear Norm

Low-tubal-rank Tensor Completion using Alternating Minimization

Unifying tensor factorization and tensor nuclear norm approaches for low-rank tensor completion

A Novel Tensor Ring Sparsity Measurement for Image Completion