Abstract:Tensor data (i.e., the data having multiple dimensions) are quickly growing in scale in many practical applications, which poses new challenges for data modeling and analysis approaches, such as high-order relations of large complexity, gross noise, and varying data scale. Existing low-rank data analysis methods, which are effective at analyzing matrix data, may fail in the regime of tensor data due to these challenges. A robust and scalable low-rank tensor modeling method is heavily desired. In this paper, we develop an online robust low-rank tensor modeling (ORLTM) method to address these challenges. The ORLTM method leverages the high-order correlations among all tensor modes to model an intrinsic low-rank structure of streaming tensor data online and can effectively analyze data residing in a mixture of multiple subspaces by virtue of dictionary learning. ORLTM consumes a very limited memory space that remains constant regardless of the increase of tensor data size, which facilitates processing tensor data at a large scale. More concretely, it models each mode unfolding of streaming tensor data using the bilinear formulation of tensor nuclear norms. With this reformulation, ORLTM employs a stochastic optimization algorithm to learn the tensor low-rank structure alternatively for online updating. To capture the final tensors, ORLTM uses an average pooling operation on folded tensors in all modes. We also provide the analysis regarding computational complexity, memory cost, and convergence. Moreover, we extend ORLTM to the image alignment scenario by incorporating the geometrical transformations and linearizing the constraints. Extensive empirical studies on synthetic database and three practical vision tasks, including video background subtraction, image alignment, and visual tracking, have demonstrated the superiority of the proposed method.

Trace Norm Regularized Tensor Classification and Its Online Learning Approaches

Deep Multi-Task Learning via Generalized Tensor Trace Norm

Learning Linear and Nonlinear Low-Rank Structure in Multi-Task Learning

Audio Segment Classification Using Online Learning Based Tensor Representation Feature Discrimination

An algorithm for online tensor prediction

Online Tensor Inference

Tensor Robust Principal Component Analysis Via Non-Convex Low Rank Approximation

Sparse and Low-Rank High-Order Tensor Regression via Parallel Proximal Method

Low-Rank Tensor Learning by Generalized Nonconvex Regularization

Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization

Large Scale Multi-Class Classification with Truncated Nuclear Norm Regularization

Online Robust Low-Rank Tensor Modeling for Streaming Data Analysis

TensorTrace: an application to contract tensor networks

Active Multitask Learning with Trace Norm Regularization Based on Excess Risk

Online Tensor Learning: Computational and Statistical Trade-offs, Adaptivity and Optimal Regret

Mixed norm regularized models for low-rank tensor completion

Generalized Higher-Order Tensor Decomposition via Parallel ADMM

Online Optimization for Large-Scale Max-Norm Regularization

Trace Ratio Based Manifold Learning With Tensor Data

Revisiting Trace Norm Minimization for Tensor Tucker Completion: A Direct Multilinear Rank Learning Approach