Abstract:Tensor data (i.e., the data having multiple dimensions) are quickly growing in scale in many practical applications, which poses new challenges for data modeling and analysis approaches, such as high-order relations of large complexity, gross noise, and varying data scale. Existing low-rank data analysis methods, which are effective at analyzing matrix data, may fail in the regime of tensor data due to these challenges. A robust and scalable low-rank tensor modeling method is heavily desired. In this paper, we develop an online robust low-rank tensor modeling (ORLTM) method to address these challenges. The ORLTM method leverages the high-order correlations among all tensor modes to model an intrinsic low-rank structure of streaming tensor data online and can effectively analyze data residing in a mixture of multiple subspaces by virtue of dictionary learning. ORLTM consumes a very limited memory space that remains constant regardless of the increase of tensor data size, which facilitates processing tensor data at a large scale. More concretely, it models each mode unfolding of streaming tensor data using the bilinear formulation of tensor nuclear norms. With this reformulation, ORLTM employs a stochastic optimization algorithm to learn the tensor low-rank structure alternatively for online updating. To capture the final tensors, ORLTM uses an average pooling operation on folded tensors in all modes. We also provide the analysis regarding computational complexity, memory cost, and convergence. Moreover, we extend ORLTM to the image alignment scenario by incorporating the geometrical transformations and linearizing the constraints. Extensive empirical studies on synthetic database and three practical vision tasks, including video background subtraction, image alignment, and visual tracking, have demonstrated the superiority of the proposed method.

An algorithm for online tensor prediction

Online Tensor Inference

Online Tensor Learning: Computational and Statistical Trade-offs, Adaptivity and Optimal Regret

Efficient Online Prediction for High-Dimensional Time Series via Joint Tensor Tucker Decomposition

Online Tensor-Based Learning for Multi-Way Data

Online Prediction for Streaming Tensor Time Series

Near-Optimal Algorithms for Online Matrix Prediction

Online Robust Low-Rank Tensor Modeling for Streaming Data Analysis

Online Robust Low-Rank Tensor Learning.

Online nonnegative CP-dictionary learning for Markovian data

Tensor Decomposition for Signal Processing and Machine Learning

Sparse and Low-Rank High-Order Tensor Regression via Parallel Proximal Method

A Solution for Large Scale Nonlinear Regression with High Rank and Degree at Constant Memory Complexity via Latent Tensor Reconstruction

Faster Projection-free Online Learning

Tensor Fold-in Algorithms for Social Tagging Prediction.

A fast parallel tensor decomposition with optimal stochastic gradient descent: an application in structural damage identification

Provable Stochastic Algorithm for Large-Scale Fully-Connected Tensor Network Decomposition

Provable Tensor-Train Format Tensor Completion by Riemannian Optimization

An Online Tensor Robust PCA Algorithm for Sequential 2D Data

DeepTensor: Low-Rank Tensor Decomposition with Deep Network Priors

eOTD: An Efficient Online Tucker Decomposition for Higher Order Tensors