Abstract:Under the framework of graph-based learning, the key to robust subspace clustering and subspace learning is to obtain a good similarity graph that eliminates the effects of errors and retains only connections between the data points from the same subspace (i.e., intrasubspace data points). Recent works achieve good performance by modeling errors into their objective functions to remove the errors from the inputs. However, these approaches face the limitations that the structure of errors should be known prior and a complex convex problem must be solved. In this paper, we present a novel method to eliminate the effects of the errors from the projection space (representation) rather than from the input space. We first prove that $\boldsymbol {\ell }_{\boldsymbol {1}}$ -, $\boldsymbol {\ell }_{\boldsymbol {2}}$ -, $\boldsymbol {\ell }_{\boldsymbol {\infty }}$ -, and nuclear-norm-based linear projection spaces share the property of intrasubspace projection dominance, i.e., the coefficients over intrasubspace data points are larger than those over intersubspace data points. Based on this property, we introduce a method to construct a sparse similarity graph, called L2-graph. The subspace clustering and subspace learning algorithms are developed upon L2-graph. We conduct comprehensive experiment on subspace learning, image clustering, and motion segmentation and consider several quantitative benchmarks classification/clustering accuracy, normalized mutual information, and running time. Results show that L2-graph outperforms many state-of-the-art methods in our experiments, including L1-graph, low rank representation (LRR), and latent LRR, least square regression, sparse subspace clustering, and locally linear representation.

Learning Errors of Linear Programming Support Vector Regression

Error Analysis for Vector-Valued Regularized Least-Squares Algorithm

Approximation Analysis of Learning Algorithms for Support Vector Regression and Quantile Regression

Learning Theory Viewpoint of Approximation by Positive Linear Operators

Generalization errors of Laplacian regularized least squares regression

Learning Theory Estimates for Coefficient-Based Regularized Regression

Covering number bounds of certain regularized linear function classes

Learning with Varying Insensitive Loss.

Optimal rate of the regularized regression learning algorithm

Learning Performance of Coefficient-Based Regularized Ranking

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering

Generalization error bound of semi-supervised learning with ℓ1 regularization in sum space.

Estimate of error bounds in the improved support vector regression

Learning rates for regularized least squares ranking algorithm

Linear support vector machine regression models under different criteria

Learning Rates of Least-Square Regularized Regression with Polynomial Kernels

Learning Rates of Regularized Regression on the Unit Sphere

Analysis of Regularized Learning for Linear-functional Data in Banach Spaces

Linear and Conic Programming Estimators in High-Dimensional Errors-in-variables Models

Some Sharp Error Bounds for Multivariate Linear Interpolation and Extrapolation