Abstract:Spectral clustering is one of the most popular clustering algorithms that has stood the test of time. It is simple to describe, can be implemented using standard linear algebra, and often finds better clusters than traditional clustering algorithms like $k$-means and $k$-centers. The foundational algorithm for two-way spectral clustering, by Shi and Malik, creates a geometric graph from data and finds a spectral cut of the graph. In modern machine learning, many data sets are modeled as a large number of points drawn from a probability density function. Little is known about when spectral clustering works in this setting -- and when it doesn't. Past researchers justified spectral clustering by appealing to the graph Cheeger inequality (which states that the spectral cut of a graph approximates the ``Normalized Cut''), but this justification is known to break down on large data sets. We provide theoretically-informed intuition about spectral clustering on large data sets drawn from probability densities, by proving when a continuous form of spectral clustering considered by past researchers (the unweighted spectral cut of a probability density) finds good clusters of the underlying density itself. Our work suggests that Shi-Malik spectral clustering works well on data drawn from mixtures of Laplace distributions, and works poorly on data drawn from certain other densities, such as a density we call the `square-root trough'. Our core theorem proves that weighted spectral cuts have low weighted isoperimetry for all probability densities. Our key tool is a new Cheeger-Buser inequality for all probability densities, including discontinuous ones.

Computation of Spectral Clustering Algorithm for Large-scale Data Set

A Novel Kernel Possibitistic Fuzzy C-Means Clustering Algorithm For Large Scale Data Sets

Fast spectral clustering of data using sequential matrix compression

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

Parallel spectral clustering algorithm

A Distributed Block Chebyshev-Davidson Algorithm for Parallel Spectral Clustering

Fast Spectral Clustering Learning with Hierarchical Bipartite Graph for Large-Scale Data

Spectral clustering with linear embedding: A discrete clustering method for large-scale data

Fast Large-Scale Spectral Clustering By Sequential Shrinkage Optimization

Large Scale Spectral Clustering Via Landmark-Based Sparse Representation

Spectral Clustering on Large Datasets: When Does it Work? Theory from Continuous Clustering and Density Cheeger-Buser

Scalable Spectral Clustering Using Random Binning Features

Parallel Eigenvalue Calculation Based On Multiple Shift-Invert Lanczos And Contour Integral Based Spectral Projection Method

A High Performance Implementation of Spectral Clustering on CPU-GPU Platforms

LSEC: Large-scale spectral ensemble clustering

Structured Graph Reconstruction for Scalable Clustering

Parallelization of Spectral Clustering Algorithm on Multi-Core Processors and GPGPU

Scalable Constrained Spectral Clustering

The geometry of kernelized spectral clustering

Superpixels for Large Dataset Subspace Clustering.