Abstract:Recently there is a line of research work proposing to employ Spectral Clustering (SC) to segment (group)\footnote{Throughout the paper, we use segmentation, clustering, and grouping, and their verb forms, interchangeably.} high-dimensional structural data such as those (approximately) lying on subspaces\footnote{We follow~\cite{liu2010robust} and use the term ``subspace'' to denote both linear subspaces and affine subspaces. There is a trivial conversion between linear subspaces and affine subspaces as mentioned therein.} or low-dimensional manifolds. By learning the affinity matrix in the form of sparse reconstruction, techniques proposed in this vein often considerably boost the performance in subspace settings where traditional SC can fail. Despite the success, there are fundamental problems that have been left unsolved: the spectrum property of the learned affinity matrix cannot be gauged in advance, and there is often one ugly symmetrization step that post-processes the affinity for SC input. Hence we advocate to enforce the symmetric positive semi definite constraint explicitly during learning (Low-Rank Representation with Positive Semi Definite constraint, or LRR-PSD), and show that factually it can be solved in an exquisite scheme efficiently instead of general-purpose SDP solvers that usually scale up poorly. We provide rigorous mathematical derivations to show that, in its canonical form, LRR-PSD is equivalent to the recently proposed Low-Rank Representation (LRR) scheme~\cite{liu2010robust}, and hence offer theoretic and practical insights to both LRR-PSD and LRR, inviting future research. As per the computational cost, our proposal is at most comparable to that of LRR, if not less. We validate our theoretic analysis and optimization scheme by experiments on both synthetic and real data sets.

Towards Robust Arbitrarily Oriented Subspace Clustering

Synchronization-based Scalable Subspace Clustering of High-Dimensional Data.

Detection of Arbitrarily Oriented Synchronized Clusters in High-Dimensional Data

Robust Subspace Clustering Via Thresholding Ridge Regression

Robust Discriminant Subspace Clustering with Adaptive Local Structure Embedding.

Robust Recovery of Subspace Structures by Low-Rank Representation

A Sparse Framework for Robust Possibilistic K-Subspace Clustering

Robust High-Order Manifold Constrained Low Rank Representation for Subspace Clustering

Robust Structured Sparse Subspace Clustering with Neighborhood Preserving Projection.

Robust Low-Rank Subspace Segmentation with Semidefinite Guarantees

LRSR: Low-Rank-Sparse Representation for Subspace Clustering.

A New Sparse Subspace Clustering by Rotated Orthogonal Matching Pursuit

Robust Latent Low Rank Representation for Subspace Clustering

Structured block diagonal representation for subspace clustering

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

Robust Subspace Outlier Detection in High Dimensional Space

Robust Least Squares Regression for Subspace Clustering: A Multi-View Clustering Perspective

Robust Subspace Clustering by Logarithmic Hyperbolic Cosine Function

Robust Low-Rank Kernel Multi-View Subspace Clustering Based on the Schatten P-Norm and Correntropy

Robust Subspace Clustering via Smoothed Rank Approximation

Robust Semi-Supervised Subspace Clustering Via Non-Negative Low-Rank Representation