Abstract:Tensor data (i.e., the data having multiple dimensions) are quickly growing in scale in many practical applications, which poses new challenges for data modeling and analysis approaches, such as high-order relations of large complexity, gross noise, and varying data scale. Existing low-rank data analysis methods, which are effective at analyzing matrix data, may fail in the regime of tensor data due to these challenges. A robust and scalable low-rank tensor modeling method is heavily desired. In this paper, we develop an online robust low-rank tensor modeling (ORLTM) method to address these challenges. The ORLTM method leverages the high-order correlations among all tensor modes to model an intrinsic low-rank structure of streaming tensor data online and can effectively analyze data residing in a mixture of multiple subspaces by virtue of dictionary learning. ORLTM consumes a very limited memory space that remains constant regardless of the increase of tensor data size, which facilitates processing tensor data at a large scale. More concretely, it models each mode unfolding of streaming tensor data using the bilinear formulation of tensor nuclear norms. With this reformulation, ORLTM employs a stochastic optimization algorithm to learn the tensor low-rank structure alternatively for online updating. To capture the final tensors, ORLTM uses an average pooling operation on folded tensors in all modes. We also provide the analysis regarding computational complexity, memory cost, and convergence. Moreover, we extend ORLTM to the image alignment scenario by incorporating the geometrical transformations and linearizing the constraints. Extensive empirical studies on synthetic database and three practical vision tasks, including video background subtraction, image alignment, and visual tracking, have demonstrated the superiority of the proposed method.

Effective Streaming Low-Tubal-Rank Tensor Approximation via Frequent Directions

Tensor-Based Sketching Method for the Low-Rank Approximation of Data Streams

Low-Rank Tucker Approximation of a Tensor from Streaming Data

Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent

Efficient Algorithms for Low Tubal Rank Tensor Approximation with Applications to Image Compression, Super-Resolution and Deep Learning

Tracking Tensor Ring Decompositions of Streaming Tensors

Practical Sketching Algorithms for Low-Rank Tucker Approximation of Large Tensors

High-Dimensional Geometric Streaming for Nearly Low Rank Data

Near Optimal Frequent Directions for Sketching Dense and Sparse Matrices

Efficient Frequent Directions Algorithm for Sparse Matrices

Tensor Train Factorization with Spatio-temporal Smoothness for Streaming Low-rank Tensor Completion

Randomized Sampling Techniques Based Low-Tubal-rank Plus Sparse Tensor Recovery.

An Improved Frequent Directions Algorithm for Low-Rank Approximation via Block Krylov Iteration

Sketching Algorithms for Sparse Dictionary Learning: PTAS and Turnstile Streaming

Streaming Anomaly Detection Using Randomized Matrix Sketching

Online Robust Low-Rank Tensor Modeling for Streaming Data Analysis

An Efficient Two-Sided Sketching Method for Large-Scale Tensor Decomposition Based on Transformed Domains

Beyond streams and graphs: dynamic tensor analysis.

Fast and Low-Memory Compressive Sensing Algorithms for Low Tucker-Rank Tensor Approximation from Streamed Measurements

Approximating Element-Wise Functions of Matrix with Improved Streaming Randomized SVD

Streaming data recovery via Bayesian tensor train decomposition