Abstract:Recently there is a line of research work proposing to employ Spectral Clustering (SC) to segment (group)\footnote{Throughout the paper, we use segmentation, clustering, and grouping, and their verb forms, interchangeably.} high-dimensional structural data such as those (approximately) lying on subspaces\footnote{We follow~\cite{liu2010robust} and use the term ``subspace'' to denote both linear subspaces and affine subspaces. There is a trivial conversion between linear subspaces and affine subspaces as mentioned therein.} or low-dimensional manifolds. By learning the affinity matrix in the form of sparse reconstruction, techniques proposed in this vein often considerably boost the performance in subspace settings where traditional SC can fail. Despite the success, there are fundamental problems that have been left unsolved: the spectrum property of the learned affinity matrix cannot be gauged in advance, and there is often one ugly symmetrization step that post-processes the affinity for SC input. Hence we advocate to enforce the symmetric positive semi definite constraint explicitly during learning (Low-Rank Representation with Positive Semi Definite constraint, or LRR-PSD), and show that factually it can be solved in an exquisite scheme efficiently instead of general-purpose SDP solvers that usually scale up poorly. We provide rigorous mathematical derivations to show that, in its canonical form, LRR-PSD is equivalent to the recently proposed Low-Rank Representation (LRR) scheme~\cite{liu2010robust}, and hence offer theoretic and practical insights to both LRR-PSD and LRR, inviting future research. As per the computational cost, our proposal is at most comparable to that of LRR, if not less. We validate our theoretic analysis and optimization scheme by experiments on both synthetic and real data sets.

Adaptive weight least square regression subspace segmentation

Robust visual tracking via weighted incremental subspace learning

Robust Iterative Algorithm of Weighted Least Squares Support Vector Machine and Its Application in Spectral Analysis

Robust Subspace Segmentation by Low-Rank Representation.

Correlation Adaptive Subspace Segmentation by Trace Lasso.

A fast region-based image segmentation based on least square method

Spectral Regression: A Unified Approach for Sparse Subspace Learning

Segmentary group-sparsity self-representation learning and spectral clustering via double L 21 norm

Robust Low-Rank Subspace Segmentation with Semidefinite Guarantees

Analysis and Improvement of Low Rank Representation for Subspace Segmentation

Weighted Subspace Fuzzy Clustering with Adaptive Projection

Efficient Subspace Segmentation Via Quadratic Programming

Subspace learning via Locally Constrained A-optimal nonnegative projection.

Robust Subspace Segmentation Via Nonconvex Low Rank Representation.

Fast Low-Rank Subspace Segmentation

Data-Dependent Sparsity for Subspace Clustering.

Weighted subspace anomaly detection in high-dimensional space

Adaptive Gaussian Regularization Constrained Sparse Subspace Clustering for Image Segmentation.

Spectral regression: a regression framework for efficient regularized subspace learning

Spectral Regression for Efficient Regularized Subspace Learning

Confidence level auto-weighting robust multi-view subspace clustering