Abstract:In experimental and observational sciences, detecting atypical, peculiar data from large sets of measurements has the potential of highlighting candidates of interesting new types of objects that deserve more detailed domain-specific followup study. However, measurement data is nearly never free of measurement errors. These errors can generate false outliers that are not truly interesting. Although many approaches exist for finding outliers, they have no means to tell to what extent the peculiarity is not simply due to measurement errors. To address this issue, we have developed a model-based approach to infer genuine outliers from multivariate data sets when measurement error information is available. This is based on a probabilistic mixture of hierarchical density models, in which parameter estimation is made feasible by a tree-structured variational expectation-maximization algorithm. Here, we further develop an algorithmic enhancement to address the scalability of this approach, in order to make it applicable to large data sets, via a K-dimensional-tree based partitioning of the variational posterior assignments. This creates a non-trivial tradeoff between a more detailed noise model to enhance the detection accuracy, and the coarsened posterior representation to obtain computational speedup. Hence, we conduct extensive experimental validation to study the accuracy/speed tradeoffs achievable in a variety of data conditions. We find that, at low-to-moderate error levels, a speedup factor that is at least linear in the number of data points can be achieved without significantly sacrificing the detection accuracy. The benefits of including measurement error information into the modeling is evident in all situations, and the gain roughly recovers the loss incurred by the speedup procedure in large error conditions. We analyze and discuss in detail the characteristics of our algorithm based on results obtained on appropriately designed synthetic data experiments, and we also demonstrate its working in a real application example.

Robust Fitting of Mixture Models using Weighted Complete Estimating Equations

Gaussian mixture density modeling and decomposition with weighted likelihood

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Robust modeling of mixture probabilistic principal component analysis and process monitoring application

Robust mixture modelling using multivariate

Robust multivariate mixture regression models with incomplete data

Robust mixture modelling using multivariate t-distribution with missing information

Robust Gaussian Mixture Modeling: A -Divergence Based Approach

Robust Clustering Based on Finite Mixtures t Distribution

On the Behavior of the Expectation-Maximization Algorithm for Mixture Models

Robust mixture regression modeling based on two-piece scale mixtures of normal distributions

Data-Driven Robust Chance Constrained Problems: A Mixture Model Approach

Regularized Maximum Likelihood Estimation and Feature Selection in Mixtures-of-Experts Models

An Improved Mixture Model of Gaussian Processes and Its Classification Expectation–Maximization Algorithm

Robust Mixtures in the Presence of Measurement Errors

Robust mixture of experts modeling using the $t$ distribution

Repulsive Mixture Models of Exponential Family PCA for Clustering

A Fast Algorithm for Robust Mixtures in the Presence of Measurement Errors.

Gaussian Mixture Learning Via Robust Competitive Agglomeration

A New Approach to Parameter Estimation of Mixture of Two Normal Distributions