Abstract:This paper analyzes the statistical performance of a robust spectral clustering method for latent structure recovery in noisy data matrices. We consider eigenvector-based clustering applied to a matrix of nonparametric rank statistics that is derived entrywise from the raw, original data matrix. This approach is robust in the sense that, unlike traditional spectral clustering procedures, it can provably recover population-level latent block structure even when the observed data matrix includes heavy-tailed entries and has a heterogeneous variance profile. Our main theoretical contributions are threefold and hold under flexible data generating conditions. First, we establish that robust spectral clustering with rank statistics can consistently recover latent block structure, viewed as communities of nodes in a graph, in the sense that unobserved community memberships for all but a vanishing fraction of nodes are correctly recovered with high probability when the data matrix is large. Second, we refine the former result and further establish that, under certain conditions, the community membership of any individual, specified node of interest can be asymptotically exactly recovered with probability tending to one in the large-data limit. Third, we establish asymptotic normality results associated with the truncated eigenstructure of matrices whose entries are rank statistics, made possible by synthesizing contemporary entrywise matrix perturbation analysis with the classical nonparametric theory of so-called simple linear rank statistics. Collectively, these results demonstrate the statistical utility of rank-based data transformations when paired with spectral techniques for dimensionality reduction. Additionally, for a dataset of human connectomes, our approach yields parsimonious dimensionality reduction and improved recovery of ground-truth neuroanatomical cluster structure.

(Un)detectable cluster structure in sparse networks

Sparse clusterability: testing for cluster structure in high dimensions

Detectability of hierarchical communities in networks

Sifting out communities in large sparse networks

Detecting Planted Partition in Sparse Multi-Layer Networks

Detecting hidden spatial and spatio-temporal structures in glasses and complex physical systems by multiresolution network clustering

Network Cluster-Robust Inference

Exact Recovery and Bregman Hard Clustering of Node-Attributed Stochastic Block Model

Breaking the Small Cluster Barrier of Graph Clustering

Community Structure in Large Networks: Natural Cluster Sizes and the Absence of Large Well-Defined Clusters

On the Detectability of Node Grouping in Networks.

Missing and spurious interactions and the reconstruction of complex networks

Two models of sparse and clustered dynamic networks

Reconstructing Heterogeneous Networks via Compressive Sensing and Clustering

Cluster detection in networks using percolation

Optimal Change Point Detection and Localization in Sparse Dynamic Networks

Robust spectral clustering with rank statistics

Critical density for network reconstruction

Tensor Clustering with Planted Structures: Statistical Optimality and Computational Limits

Simultaneous Identification of Sparse Structures and Communities in Heterogeneous Graphical Models

Phase Transitions in Spectral Community Detection of Large Noisy Networks