Abstract:Tensor data (i.e., the data having multiple dimensions) are quickly growing in scale in many practical applications, which poses new challenges for data modeling and analysis approaches, such as high-order relations of large complexity, gross noise, and varying data scale. Existing low-rank data analysis methods, which are effective at analyzing matrix data, may fail in the regime of tensor data due to these challenges. A robust and scalable low-rank tensor modeling method is heavily desired. In this paper, we develop an online robust low-rank tensor modeling (ORLTM) method to address these challenges. The ORLTM method leverages the high-order correlations among all tensor modes to model an intrinsic low-rank structure of streaming tensor data online and can effectively analyze data residing in a mixture of multiple subspaces by virtue of dictionary learning. ORLTM consumes a very limited memory space that remains constant regardless of the increase of tensor data size, which facilitates processing tensor data at a large scale. More concretely, it models each mode unfolding of streaming tensor data using the bilinear formulation of tensor nuclear norms. With this reformulation, ORLTM employs a stochastic optimization algorithm to learn the tensor low-rank structure alternatively for online updating. To capture the final tensors, ORLTM uses an average pooling operation on folded tensors in all modes. We also provide the analysis regarding computational complexity, memory cost, and convergence. Moreover, we extend ORLTM to the image alignment scenario by incorporating the geometrical transformations and linearizing the constraints. Extensive empirical studies on synthetic database and three practical vision tasks, including video background subtraction, image alignment, and visual tracking, have demonstrated the superiority of the proposed method.

OTLRM: Orthogonal Learning-based Low-Rank Metric for Multi-Dimensional Inverse Problems

HLRTF: Hierarchical Low-Rank Tensor Factorization for Inverse Problems in Multi-Dimensional Imaging

Robust Low-Rank Tensor Recovery Via Nonconvex Singular Value Minimization.

Online Robust Low-Rank Tensor Learning.

Tensor Denoising Using Low-Rank Tensor Train Decomposition

Online Robust Low-Rank Tensor Modeling for Streaming Data Analysis

Multilinear Low-Rank Tensors on Graphs & Applications

Low-Tubal-Rank Tensor Recovery with Multilayer Subspace Prior Learning

Learnable Spatial-Spectral Transform-Based Tensor Nuclear Norm for Multi-Dimensional Visual Data Recovery

Dynamic MRI Using Learned Transform-based Tensor Low-Rank Network (Lt^2lr-Net)

Tensor Recovery via Nonconvex Low-Rank Approximation

Low-Rank Tensor Completion Based on Nonconvex Regularization

A Scale-Invariant Relaxation in Low-Rank Tensor Recovery with an Application to Tensor Completion

Robust High-Order Tensor Recovery Via Nonconvex Low-Rank Approximation

T$^2$LR-Net: An Unrolling Reconstruction Network Learning Transformed Tensor Low-Rank prior for Dynamic MR Imaging

Low-Rank Tensor Learning by Generalized Nonconvex Regularization

Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization

A Novel $ \ell_{0} $ Minimization Framework of Tensor Tubal Rank and Its Multi-Dimensional Image Completion Application

Generalized Higher Order Orthogonal Iteration for Tensor Learning and Decomposition

Nonconvex Low Tubal Rank Tensor Minimization

Enhanced tensor low-rank representation learning for multi-view clustering.