Abstract:Recent technological advances have led to contemporary applications that demand real-time processing and analysis of sequentially arriving tensor data. Traditional offline learning, involving the storage and utilization of all data in each computational iteration, becomes impractical for high-dimensional tensor data due to its voluminous size. Furthermore, existing low-rank tensor methods lack the capability for statistical inference in an online fashion, which is essential for real-time predictions and informed decision-making. This paper addresses these challenges by introducing a novel online inference framework for low-rank tensor learning. Our approach employs Stochastic Gradient Descent (SGD) to enable efficient real-time data processing without extensive memory requirements, thereby significantly reducing computational demands. We establish a non-asymptotic convergence result for the online low-rank SGD estimator, nearly matches the minimax optimal rate of estimation error in offline models that store all historical data. Building upon this foundation, we propose a simple yet powerful online debiasing approach for sequential statistical inference in low-rank tensor learning. The entire online procedure, covering both estimation and inference, eliminates the need for data splitting or storing historical data, making it suitable for on-the-fly hypothesis testing. Given the sequential nature of our data collection, traditional analyses relying on offline methods and sample splitting are inadequate. In our analysis, we control the sum of constructed super-martingales to ensure estimates along the entire solution path remain within the benign region. Additionally, a novel spectral representation tool is employed to address statistical dependencies among iterative estimates, establishing the desired asymptotic normality.

Learning Separable Dictionaries for Sparse Tensor Representation: an Online Approach

Online Discriminative Dictionary Learning for Image Classification Based on Block-Coordinate Descent Method

Bayesian Dictionary Learning on Robust Tubal Transformed Tensor Factorization

Multi-Dictionary Tensor Decomposition

Sparse ISAR Imaging Exploiting Dictionary Learning

Dictionary Learning With Log-Regularizer For Sparse Representation

ODD: an Algorithm of Online Directional Dictionary Learning for Sparse Representation

Learning dictionary via subspace segmentation for sparse representation

Factorized Tensor Dictionary Learning for Visual Tensor Data Completion

Blockwise Coordinate Descent Schemes for Efficient and Effective Dictionary Learning.

First and Second Order Methods for Online Convolutional Dictionary Learning

Tensor low-rank sparse representation for tensor subspace learning

Tensor LISTA: Differentiable sparse representation learning for multi-dimensional tensor

Online Tensor Inference

Provable Online CP/PARAFAC Decomposition of a Structured Tensor via Dictionary Learning

Online Orthogonal Dictionary Learning Based on Frank-Wolfe Method

Via subspace segmentation for sparse representation

Online Convolutional Sparse Coding with Sample-Dependent Dictionary

Efficient Dictionary Learning with Sparseness-Enforcing Projections

Sparse Time-Frequency Decomposition by Dictionary Learning

Online nonnegative CP-dictionary learning for Markovian data