Abstract:This paper studies a factor modeling-based approach for clustering high-dimensional data generated from a mixture of strongly correlated variables. Statistical modeling with correlated structures pervades modern applications in economics, finance, genomics, wireless sensing, etc., with factor modeling being one of the popular techniques for explaining the common dependence. Standard techniques for clustering high-dimensional data, e.g., naive spectral clustering, often fail to yield insightful results as their performances heavily depend on the mixture components having a weakly correlated structure. To address the clustering problem in the presence of a latent factor model, we propose the Factor Adjusted Spectral Clustering (FASC) algorithm, which uses an additional data denoising step via eliminating the factor component to cope with the data dependency. We prove this method achieves an exponentially low mislabeling rate, with respect to the signal to noise ratio under a general set of assumptions. Our assumption bridges many classical factor models in the literature, such as the pervasive factor model, the weak factor model, and the sparse factor model. The FASC algorithm is also computationally efficient, requiring only near-linear sample complexity with respect to the data dimension. We also show the applicability of the FASC algorithm with real data experiments and numerical studies, and establish that FASC provides significant results in many cases where traditional spectral clustering fails.

Overfitting Bayesian Mixtures of Factor Analyzers with an Unknown Number of Components

Clustering Multivariate Data using Factor Analytic Bayesian Mixtures with an Unknown Number of Components

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Model-based clustering based on sparse finite Gaussian mixtures

Finite Mixtures of Multivariate Poisson-Log Normal Factor Analyzers for Clustering Count Data

Infinite Mixtures of Infinite Factor Analysers

Unsupervised Classification with a Family of Parsimonious Contaminated Shifted Asymmetric Laplace Mixtures

Conditional mixture modeling and model-based clustering

Factor Adjusted Spectral Clustering for Mixture Models

Multimode process data modeling: A Dirichlet process mixture model based Bayesian robust factor analyzer approach

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

Bayesian Model for Factor Analysis Using Mixing Prior Distribution

Mixture Models With a Prior on the Number of Components

Bayesian mixture models (in)consistency for the number of clusters

Bayesian Statistical Inference for Factor Analysis Models with Clustered Data

Modeling Schizophrenic Behavior Using General Mixture Components.

Model-based clustering via mixtures of unrestricted skew normal factor analyzers with complete and incomplete data

A Bayesian approach for clustering and exact finite-sample model selection in longitudinal data mixtures

Evaluating mixture modeling for clustering: Recommendations and cautions.

Bayesian clustering of high-dimensional data via latent repulsive mixtures