Abstract:Tensor data (i.e., the data having multiple dimensions) are quickly growing in scale in many practical applications, which poses new challenges for data modeling and analysis approaches, such as high-order relations of large complexity, gross noise, and varying data scale. Existing low-rank data analysis methods, which are effective at analyzing matrix data, may fail in the regime of tensor data due to these challenges. A robust and scalable low-rank tensor modeling method is heavily desired. In this paper, we develop an online robust low-rank tensor modeling (ORLTM) method to address these challenges. The ORLTM method leverages the high-order correlations among all tensor modes to model an intrinsic low-rank structure of streaming tensor data online and can effectively analyze data residing in a mixture of multiple subspaces by virtue of dictionary learning. ORLTM consumes a very limited memory space that remains constant regardless of the increase of tensor data size, which facilitates processing tensor data at a large scale. More concretely, it models each mode unfolding of streaming tensor data using the bilinear formulation of tensor nuclear norms. With this reformulation, ORLTM employs a stochastic optimization algorithm to learn the tensor low-rank structure alternatively for online updating. To capture the final tensors, ORLTM uses an average pooling operation on folded tensors in all modes. We also provide the analysis regarding computational complexity, memory cost, and convergence. Moreover, we extend ORLTM to the image alignment scenario by incorporating the geometrical transformations and linearizing the constraints. Extensive empirical studies on synthetic database and three practical vision tasks, including video background subtraction, image alignment, and visual tracking, have demonstrated the superiority of the proposed method.

Online regularized matrix regression with streaming data

Dynamic Structure Embedded Online Multiple-Output Regression for Streaming Data

Online updating mode learning for streaming datasets

Inference on High-dimensional Single-index Models with Streaming Data

Regularized Adaptive Huber Matrix Regression and Distributed Learning

Two-Stage Online Debiased Lasso Estimation and Inference for High-Dimensional Quantile Regression with Streaming Data

Dynamic Structure Embedded Online Multiple-Output Regression for Stream Data

Adaptive debiased SGD in high-dimensional GLMs with streaming data

Online Estimation with Rolling Validation: Adaptive Nonparametric Estimation with Streaming Data

Online Optimization for Large-Scale Max-Norm Regularization

Regularized Matrix Regression

Renewable estimation in expectile regression model with streaming data sets

MORStreaming: A Multioutput Regression System for Streaming Data

The linearized alternating direction method of multipliers for low-rank and fused LASSO matrix regression model

Change Point Detection with Neural Online Density-Ratio Estimator

Scalable inference in functional linear regression with streaming data

Safe subspace screening for the adaptive nuclear norm regularized trace regression

Two-step online estimation and inference for expected shortfall regression with streaming data

Communication-efficient Estimation of Quantile Matrix Regression for Massive Datasets

Online Robust Low-Rank Tensor Modeling for Streaming Data Analysis

Subspace Learning and Imputation for Streaming Big Data Matrices and Tensors