Abstract:The low-tubal-rank tensor model has been recently proposed for real-world multidimensional data. In this paper, we study the low-tubal-rank tensor completion problem, i.e., to recover a third-order tensor by observing a subset of its elements selected uniformly at random. We propose a fast iterative algorithm, called {\em Tubal-Alt-Min}, that is inspired by a similar approach for low-rank matrix completion. The unknown low-tubal-rank tensor is represented as the product of two much smaller tensors with the low-tubal-rank property being automatically incorporated, and Tubal-Alt-Min alternates between estimating those two tensors using tensor least squares minimization. First, we note that tensor least squares minimization is different from its matrix counterpart and nontrivial as the circular convolution operator of the low-tubal-rank tensor model is intertwined with the sub-sampling operator. Second, the theoretical performance guarantee is challenging since Tubal-Alt-Min is iterative and nonconvex in nature. We prove that 1) Tubal-Alt-Min guarantees exponential convergence to the global optima, and 2) for an $n \times n \times k$ tensor with tubal-rank $r \ll n$, the required sampling complexity is $O(nr^2k \log^3 n)$ and the computational complexity is $O(n^2rk^2 \log^2 n)$. Third, on both synthetic data and real-world video data, evaluation results show that compared with tensor-nuclear norm minimization (TNN-ADMM), Tubal-Alt-Min improves the recovery error dramatically (by orders of magnitude). It is estimated that Tubal-Alt-Min converges at an exponential rate $10^{-0.4423 \text{Iter}}$ where $\text{Iter}$ denotes the number of iterations, which is much faster than TNN-ADMM's $10^{-0.0332 \text{Iter}}$, and the running time can be accelerated by more than $5$ times for a $200 \times 200 \times 20$ tensor.

An L1-L2 Variant of Tubal Nuclear Norm for Guaranteed Tensor Recovery

Exact Low Tubal Rank Tensor Recovery from Gaussian Measurements

Robust low tubal rank tensor recovery via L 2 E criterion

Tensor N-tubal rank and its convex relaxation for low-rank tensor recovery

Tensor recovery using the tensor nuclear norm based on nonconvex and nonlinear transformations

Low-n-rank tensor recovery based on multi-linear augmented Lagrange multiplier method

Fast and Accurate Matrix Completion Via Truncated Nuclear Norm Regularization

Robust Low Tubal Rank Tensor Completion via Factor Tensor Norm Minimization

Two New Low Rank Tensor Completion Methods Based on Sum Nuclear Norm

Learnable Spatial-Spectral Transform-Based Tensor Nuclear Norm for Multi-Dimensional Visual Data Recovery

Low-tubal-rank Tensor Completion using Alternating Minimization

Tensor Recovery via Multi-linear Augmented Lagrange Multiplier Method

Nonlinear Transform Induced Tensor Nuclear Norm for Tensor Completion

On The Synergy Between Nonconvex Extensions of The Tensor Nuclear Norm for Tensor Recovery

Guaranteed matrix recovery using weighted nuclear norm plus weighted total variation minimization

A Scale-Invariant Relaxation in Low-Rank Tensor Recovery with an Application to Tensor Completion

Convex recovery of tensors using nuclear norm penalization

TIHN: Tensor Improved Huber Norm for low-rank tensor recovery

Matrix completion by Truncated Nuclear Norm Regularization

Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent

Truncated nuclear norm regularization for low-rank tensor completion