Abstract:Recently there is a line of research work proposing to employ Spectral Clustering (SC) to segment (group)\footnote{Throughout the paper, we use segmentation, clustering, and grouping, and their verb forms, interchangeably.} high-dimensional structural data such as those (approximately) lying on subspaces\footnote{We follow~\cite{liu2010robust} and use the term ``subspace'' to denote both linear subspaces and affine subspaces. There is a trivial conversion between linear subspaces and affine subspaces as mentioned therein.} or low-dimensional manifolds. By learning the affinity matrix in the form of sparse reconstruction, techniques proposed in this vein often considerably boost the performance in subspace settings where traditional SC can fail. Despite the success, there are fundamental problems that have been left unsolved: the spectrum property of the learned affinity matrix cannot be gauged in advance, and there is often one ugly symmetrization step that post-processes the affinity for SC input. Hence we advocate to enforce the symmetric positive semi definite constraint explicitly during learning (Low-Rank Representation with Positive Semi Definite constraint, or LRR-PSD), and show that factually it can be solved in an exquisite scheme efficiently instead of general-purpose SDP solvers that usually scale up poorly. We provide rigorous mathematical derivations to show that, in its canonical form, LRR-PSD is equivalent to the recently proposed Low-Rank Representation (LRR) scheme~\cite{liu2010robust}, and hence offer theoretic and practical insights to both LRR-PSD and LRR, inviting future research. As per the computational cost, our proposal is at most comparable to that of LRR, if not less. We validate our theoretic analysis and optimization scheme by experiments on both synthetic and real data sets.

Segmentary Group-Sparsity Self-Representation Learning and Spectral Clustering Via Double L21 Norm

Segmentary group-sparsity self-representation learning and spectral clustering via double L 21 norm

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

Robust Low-Rank Subspace Segmentation with Semidefinite Guarantees

Sparse and Low-Rank Regularized Deep Subspace Clustering

Learning a Self-Expressive Network for Subspace Clustering

A Group Norm Regularized Factorization Model for Subspace Segmentation

Elastic Deep Sparse Self-Representation Subspace Clustering Network

Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering

Spectral Regression: A Unified Approach for Sparse Subspace Learning

Data-Dependent Sparsity for Subspace Clustering.

Contrastive self-representation learning for data clustering

LRSR: Low-Rank-Sparse Representation for Subspace Clustering.

Adaptive Gaussian Regularization Constrained Sparse Subspace Clustering for Image Segmentation.

Robust Structured Sparse Subspace Clustering with Neighborhood Preserving Projection.

Subspace Clustering via Structured Sparse Relation Representation

Subspace clustering via joint l1,2 and l2,1 norms

Rank–sparsity Balanced Representation for Subspace Clustering

Dual Graph Regularized Latent Low-Rank Representation for Subspace Clustering.

Scaled Simplex Representation for Subspace Clustering

A Group Norm Regularized LRR Factorization Model for Spectral Clustering