Abstract:Subspace clustering methods based on $\ell_1$, $\ell_2$ or nuclear norm regularization have become very popular due to their simplicity, theoretical guarantees and empirical success. However, the choice of the regularizer can greatly impact both theory and practice. For instance, $\ell_1$ regularization is guaranteed to give a subspace-preserving affinity (i.e., there are no connections between points from different subspaces) under broad conditions (e.g., arbitrary subspaces and corrupted data). However, it requires solving a large scale convex optimization problem. On the other hand, $\ell_2$ and nuclear norm regularization provide efficient closed form solutions, but require very strong assumptions to guarantee a subspace-preserving affinity, e.g., independent subspaces and uncorrupted data. In this paper we study a subspace clustering method based on orthogonal matching pursuit. We show that the method is both computationally efficient and guaranteed to give a subspace-preserving affinity under broad conditions. Experiments on synthetic data verify our theoretical analysis, and applications in handwritten digit and face clustering show that our approach achieves the best trade off between accuracy and efficiency.

Convex Matching Pursuit for Large-Scale Sparse Coding and Subset Selection.

Sparsity estimation based adaptive matching pursuit algorithm

Backtracking Matching Pursuit with Supplement Set of Arbitrary Size.

Adaptive Matching Pursuit with Constrained Total Least Squares

Adaptive matching pursuit for sparse signal recovery

Iterative Orthogonal Matching Pursuit and Sparse Solution

K-CPD: Learning of Overcomplete Dictionaries for Tensor Sparse Coding.

A Sparsity Preestimated Adaptive Matching Pursuit Algorithm

A Sparsity Adaptive Subspace Pursuit Algorithm for Compressive Sampling

Solving Large Scale Quadratic Constrained Basis Pursuit

Scalable Sparse Subspace Clustering by Orthogonal Matching Pursuit

Fast Low Rank Representation Based Spatial Pyramid Matching for Image Classification.

Improved Generalized Sparsity Adaptive Matching Pursuit Algorithm Based on Compressive Sensing

A gradient descent sparse adaptive matching pursuit algorithm based on compressive sensing

Linear spatial pyramid matching using sparse coding for image classification

A Two-Level Simultaneous Orthogonal Matching Pursuit Algorithm for Simultaneous Sparse Approximation Problems

Towards Discrete Solution: A Sparse Preserving Method for Correspondence Problem

Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis

Fast Sparsity Adaptive Multipath Matching Pursuit for Compressed Sensing Problems.

Revisiting Matching Pursuit: Beyond Approximate Submodularity

A Fast Convex Conjugated Algorithm for Sparse Recovery