Abstract:Benefiting from global rank constraints, the low-rank representation (LRR) method has been shown to be an effective solution to subspace learning. However, the global mechanism also means that the LRR model is not suitable for handling large-scale data or dynamic data. For large-scale data, the LRR method suffers from high time complexity, and for dynamic data, it has to recompute a complex rank minimization for the entire data set whenever new samples are dynamically added, making it prohibitively expensive. Existing attempts to online LRR either take a stochastic approach or build the representation purely based on a small sample set and treat new input as out-of-sample data. The former often requires multiple runs for good performance and thus takes longer time to run, and the latter formulates online LRR as an out-of-sample classification problem and is less robust to noise. In this paper, a novel online LRR subspace learning method is proposed for both large-scale and dynamic data. The proposed algorithm is composed of two stages: static learning and dynamic updating. In the first stage, the subspace structure is learned from a small number of data samples. In the second stage, the intrinsic principal components of the entire data set are computed incrementally by utilizing the learned subspace structure, and the LRR matrix can also be incrementally solved by an efficient online singular value decomposition algorithm. The time complexity is reduced dramatically for large-scale data, and repeated computation is avoided for dynamic problems. We further perform theoretical analysis comparing the proposed online algorithm with the batch LRR method. Finally, experimental results on typical tasks of subspace recovery and subspace clustering show that the proposed algorithm performs comparably or better than batch methods, including the batch LRR, and significantly outperforms state-of-the-art online methods.

Non-convex Low-Rank Representation Combined with Rank-One Matrix Sum for Subspace Clustering

An Efficient Matrix Factorization Based Low-Rank Representation for Subspace Clustering

Robust Subspace Clustering With Low-Rank Structure Constraint

A Fast Generalized Low Rank Representation Framework Based on $l_{2,p}$ Norm Minimization for Subspace Clustering

Bilateral Fast Low-Rank Representation With Equivalent Transformation for Subspace Clustering

Low-rank representation with adaptive dictionary learning for subspace clustering

Fast Algorithm for Large-Scale Subspace Clustering by LRR

One-step Low-Rank Representation for Clustering

Constrained Low-Rank Representation for Robust Subspace Clustering.

A Novel Low Rank Representation Algorithm for Subspace Clustering

Subspace Clustering Via New Low-Rank Model with Discrete Group Structure Constraint

Low-rank Local Tangent Space Embedding for Subspace Clustering

C V ] 21 M ay 2 01 5 Symmetric low-rank representation for subspace clustering

Robust Semi-Supervised Subspace Clustering Via Non-Negative Low-Rank Representation

Subspace Clustering Using A Symmetric Low-Rank Representation

Subspace Clustering Based on Latent Low-Rank Representation with Transformed Schatten-1 Penalty Function

A Subspace Clustering Algorithm Based on Simultaneously Sparse and Low-Rank Representation

Robust Discriminant Low-Rank Representation for Subspace Clustering

Low-rank and Structured Sparse Subspace Clustering.

Hyper-Laplacian Regularized Nonconvex Low-Rank Representation for Multi-View Subspace Clustering

Online Low-Rank Representation Learning for Joint Multi-Subspace Recovery and Clustering