Abstract:Spectral clustering (SC) methods have been successfully applied to many real-world applications. The success of these SC methods is largely based on the manifold assumption, namely, that two nearby data points in the high-density region of a low-dimensional data manifold have the same cluster label. However, such an assumption might not always hold on high-dimensional data. When the data do not exhibit a clear low-dimensional manifold structure (e.g., high-dimensional and sparse data), the clustering performance of SC will be degraded and become even worse than K -means clustering. In this paper, motivated by the observation that the true cluster assignment matrix for high-dimensional data can be always embedded in a linear space spanned by the data, we propose the spectral embedded clustering (SEC) framework, in which a linearity regularization is explicitly added into the objective function of SC methods. More importantly, the proposed SEC framework can naturally deal with out-of-sample data. We also present a new Laplacian matrix constructed from a local regression of each pattern and incorporate it into our SEC framework to capture both local and global discriminative information for clustering. Comprehensive experiments on eight real-world high-dimensional datasets demonstrate the effectiveness and advantages of our SEC framework over existing SC methods and K-means-based clustering methods. Our SEC framework significantly outperforms SC using the Nyström algorithm on unseen data.

A Nyström Spectral Clustering Algorithm Based on Probability Incremental Sampling

Inverse-degree Sampling for Spectral Clustering

Parallel spectral clustering algorithm

A Spectral Clustering Image Segmentation Algorithm Based on Nyström Approximation

Discriminative Nonnegative Spectral Clustering with Out-of-Sample Extension

Spectral Clustering: An empirical study of Approximation Algorithms and its Application to the Attrition Problem

Eigenvalue-based Incremental Spectral Clustering

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

Spectral Embedded Clustering: A Framework for In-Sample and Out-of-Sample Spectral Clustering

Dynamic Spectral Clustering with Provable Approximation Guarantee

Efficient Uncertainty Minimization for Fuzzy Spectral Clustering

Spatial-temporal trajectory anomaly detection based on an improved spectral clustering algorithm

A Restarted Large-Scale Spectral Clustering with Self-Guiding and Block Diagonal Representation

A Robust Spectral Clustering Algorithm for Sub-Gaussian Mixture Models with Outliers

Improving the Modified Nyström Method Using Spectral Shifting

An Improved K-Means Clustering Algorithm Based on Spectral Method

Spectral clustering with linear embedding: A discrete clustering method for large-scale data

Large-scale Eigenvector Approximation Via Hilbert Space Embedding Nyström

Iterative Subsampling in Solution Path Clustering of Noisy Big Data

Adaptive Spectral Rotation via Joint Cluster and Pairwise Structure

Fast Spectral Clustering with Landmark-Based Subspace Iteration