Abstract:Spectral Clustering (SC) is an effective clustering method for its excellent performance in partitioning non-linearly distributed data. On the other hand, Ensemble Clustering (EC), a different clustering technology, can promote cluster quality by ensembling the results of base clusterings. In this work, we concentrate on an EC framework that utilizes SC as the base method. Nevertheless, SC suffers from scalability due to its high computational complexity in constructing the Laplacian graph and computing the corresponding eigendecomposition. In the past decades, many efforts have been made to it. However, SC suffers from the scalability issue in processing extensive data, especially in web-scale scenarios. Additionally, EC requires multiple clustering results as the ensemble bases, which further aggravates resource consumption. To address this issue, LiteWSEC, a simple yet efficient Lightweight Framework for Web-scale Spectral Ensemble Clustering, is proposed to cluster web-scale data with limited resource requirements. It adopts the Web-scale Spectral Clustering (WSC) as the base method, which has minimal space overhead without computing overall embedding explicitly. LiteWSEC is highly flexible in the memory requirement, which is adaptive to the available resource. It can partition web-scale data (e.g., $n = 8,000~k$) in an resource-limited host (e.g., memory is restricted to 1 GB). Experiments on real-world, large-scale, and web-scale datasets demonstrate both the efficiency and effectiveness of LiteWSEC over state-of-the-art SC and EC methods.

LSEC: Large-scale spectral ensemble clustering

Ultra-Scalable Spectral Clustering and Ensemble Clustering

Scalable Spectral Ensemble Clustering Via Building Representative Co-Association Matrix.

Spectral Ensemble Clustering Via Weighted K-Means: Theoretical and Practical Evidence

Large Scale Spectral Clustering Via Landmark-Based Sparse Representation

Bagging-based spectral clustering ensemble selection

' s personal copy Bagging-based spectral clustering ensemble selection

Large-Scale Spectral Clustering Based on Representative Points

Selective Ensemble Method Based on Spectral Clustering

Spectral clustering with linear embedding: A discrete clustering method for large-scale data

Cascaded cluster ensembles

LiteWSEC: A Lightweight Framework for Web-Scale Spectral Ensemble Clustering

Large Scale Sparse Clustering

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

Anchor-based Fast Spectral Ensemble Clustering

Large Scale Spectral Clustering Based On Fast Landmark Sampling

Tensorized Graph Learning for Spectral Ensemble Clustering

Large-Scale Multi-View Spectral Clustering Via Bipartite Graph

Ensemble selection with joint spectral clustering and structural sparsity

Projective Low-rank Subspace Clustering Via Learning Deep Encoder.

Spectral Aggregation for Clustering Ensemble