Abstract:In experimental and observational sciences, detecting atypical, peculiar data from large sets of measurements has the potential of highlighting candidates of interesting new types of objects that deserve more detailed domain-specific followup study. However, measurement data is nearly never free of measurement errors. These errors can generate false outliers that are not truly interesting. Although many approaches exist for finding outliers, they have no means to tell to what extent the peculiarity is not simply due to measurement errors. To address this issue, we have developed a model-based approach to infer genuine outliers from multivariate data sets when measurement error information is available. This is based on a probabilistic mixture of hierarchical density models, in which parameter estimation is made feasible by a tree-structured variational expectation-maximization algorithm. Here, we further develop an algorithmic enhancement to address the scalability of this approach, in order to make it applicable to large data sets, via a K-dimensional-tree based partitioning of the variational posterior assignments. This creates a non-trivial tradeoff between a more detailed noise model to enhance the detection accuracy, and the coarsened posterior representation to obtain computational speedup. Hence, we conduct extensive experimental validation to study the accuracy/speed tradeoffs achievable in a variety of data conditions. We find that, at low-to-moderate error levels, a speedup factor that is at least linear in the number of data points can be achieved without significantly sacrificing the detection accuracy. The benefits of including measurement error information into the modeling is evident in all situations, and the gain roughly recovers the loss incurred by the speedup procedure in large error conditions. We analyze and discuss in detail the characteristics of our algorithm based on results obtained on appropriately designed synthetic data experiments, and we also demonstrate its working in a real application example.

Robust Clustering Based on Finite Mixtures t Distribution

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

A Comparative Study of Novel Robust Clustering Algorithms

Robust mixture clustering using Pearson type VII distribution

Robust modeling of mixture probabilistic principal component analysis and process monitoring application

The Infinite Student'S T-Mixture For Robust Modeling

Factor Analysis Latent Subspace Modeling and Robust Fuzzy Clustering Using $t$-Distributions

Robust Mixture Modeling Using The Pearson Type Vii Distribution

Competitive EM Algorithm for Finite Mixture Models

Gaussian Mixture Learning Via Robust Competitive Agglomeration

Model-based clustering based on sparse finite Gaussian mixtures

Robust Mixture Modeling with Pearson Type VII Distribution

Robust Fitting of Mixture Models using Weighted Complete Estimating Equations

Flexible Clustering with a Sparse Mixture of Generalized Hyperbolic Distributions

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

t distribution-based robust semiparametric mixture regression model

Robust Dirichlet Process mixtures.

A provable initialization and robust clustering method for general mixture models

Robust $K$-Means-type Clustering for Noisy Data

Conditional mixture modeling and model-based clustering

A Fast Algorithm for Robust Mixtures in the Presence of Measurement Errors.