Abstract:Sparsity-based subspace clustering algorithms have attracted significant attention thanks to their excellent performance in practical applications. A prominent example is the sparse subspace clustering (SSC) algorithm by Elhamifar and Vidal, which performs spectral clustering based on an adjacency matrix obtained by sparsely representing each data point in terms of all the other data points via the Lasso. When the number of data points is large or the dimension of the ambient space is high, the computational complexity of SSC quickly becomes prohibitive. Dyer et al. observed that SSC-orthogonal matching pursuit (OMP) obtained by replacing the Lasso by the greedy OMP algorithm results in significantly lower computational complexity, while often yielding comparable performance. The central goal of this paper is an analytical performance characterization of SSC-OMP for noisy data. Moreover, we introduce and analyze the SSC-matching pursuit (MP) algorithm, which employs MP in lieu of OMP. Both SSC-OMP and SSC-MP are proven to succeed even when the subspaces intersect and when the data points are contaminated by severe noise. The clustering conditions we obtain for SSC-OMP and SSC-MP are similar to those for SSC and for the thresholding-based subspace clustering (TSC) algorithm due to Heckel and Bölcskei. Analytical results in combination with numerical results indicate that both SSC-OMP and SSC-MP with a data-dependent stopping criterion automatically detect the dimensions of the subspaces underlying the data. Experiments on synthetic and on real data show that SSC-MP often matches or exceeds the performance of the computationally more expensive SSC-OMP algorithm. Moreover, SSC-MP compares very favorably to SSC, TSC, and the nearest subspace neighbor algorithm, both in terms of clustering performance and running time. In addition, we find that, in contrast to SSC-OMP, the performance of SSC-MP is very robust with respect to the choice of parameters in the stopping criteria.

A Two-Level Simultaneous Orthogonal Matching Pursuit Algorithm for Simultaneous Sparse Approximation Problems

Sparse Signals Recovery from Noisy Measurements by Orthogonal Matching Pursuit

Nonuniform Support Recovery from Noisy Random Measurements by Orthogonal Matching Pursuit.

Astronomical Image Denoising by Means of Improved Adaptive Backtracking-Based Matching Pursuit Algorithm

On Sparse Recovery Algorithms in Unions of Orthonormal Bases

Improved Sparse Representation Algorithm for Optical Coherence Tomography Images

A New Sparse Subspace Method for Wideband DOA Estimation

Two-dimensional multi-snapshot Newtonized orthogonal matching pursuit for DOA estimation

Iterative Orthogonal Matching Pursuit and Sparse Solution

Active Orthogonal Matching Pursuit for Sparse Subspace Clustering

Direction of Arrival Estimation by Matching Pursuit Algorithm With Subspace Information

Dynamic Orthogonal Matching Pursuit for Sparse Data Reconstruction

2D sparse signal recovery via 2D orthogonal matching pursuit

Stagewise Weak Orthogonal Matching Pursuit Algorithm Based on Adaptive Weak Threshold and Arithmetic Mean.

Noisy Subspace Clustering via Matching Pursuits

Restricted Connection Orthogonal Matching Pursuit For Sparse Subspace Clustering.

Iterative method for simultaneous sparse approximation

Orthogonal Matching Pursuit with Adaptive Restriction for Sparse Subspace Clustering

Sparse Subspace Clustering With One-Way Selective Orthogonal Matching Pursuit

Backtracking-Based Simultaneous Orthogonal Matching Pursuit for Sparse Unmixing of Hyperspectral Data

Fast OMP for Exact Recovery and Sparse Approximation