Abstract:How can we detect outliers, both scattered and clustered, and also explicitly assign them to respective micro-clusters, without knowing apriori how many micro-clusters exist? How can we perform both tasks in-house, i.e., without any post-hoc processing, so that both detection and assignment can benefit simultaneously from each other? Presenting outliers in separate micro-clusters is informative to analysts in many real-world applications. However, a naïve solution based on post-hoc clustering of the outliers detected by any existing method suffers from two main drawbacks: (a) appropriate hyperparameter values are commonly unknown for clustering, and most algorithms struggle with clusters of varying shapes and densities; (b) detection and assignment cannot benefit from one another. In this paper, we propose <a class="link-external link-http" href="http://D.MCA" rel="external noopener nofollow">this http URL</a> to $\underline{D}$etect outliers with explicit $\underline{M}$icro-$\underline{C}$luster $\underline{A}$ssignment. Our method performs both detection and assignment iteratively, and in-house, by using a novel strategy that prunes entire micro-clusters out of the training set to improve the performance of the detection. It also benefits from a novel strategy that avoids clustered outliers to mask each other, which is a well-known problem in the literature. Also, <a class="link-external link-http" href="http://D.MCA" rel="external noopener nofollow">this http URL</a> is designed to be robust to a critical hyperparameter by employing a hyperensemble "warm up" phase. Experiments performed on 16 real-world and synthetic datasets demonstrate that <a class="link-external link-http" href="http://D.MCA" rel="external noopener nofollow">this http URL</a> outperforms 8 state-of-the-art competitors, especially on the explicit outlier micro-cluster assignment task.

Cluster analysis and outlier detection with missing data

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Multiple scaled contaminated normal distribution and its application in clustering

Robust multivariate mixture regression models with incomplete data

Clustering Three-Way Data with Outliers

Model-based Clustering with Missing Not At Random Data

D.MCA: Outlier Detection with Explicit Micro-Cluster Assignments

Finding Outliers in Gaussian Model-based Clustering

Outlier Detection with Cluster Catch Digraphs

Mixed Normal and Non‐Normal Data with Missing Values, Ignoring the Missing‐Data Mechanism

Unsupervised Learning of Dirichlet Process Mixture Models with Missing Data

Handling missing data in model-based clustering

Data-driven cluster analysis method: a novel outliers detection method in multivariate data

MCODE: Multivariate Conditional Outlier Detection

Flexible High-Dimensional Unsupervised Learning with Missing Data

Infinite mixtures of multivariate normal-inverse Gaussian distributions for clustering of skewed data

Gaussian Mixture Model Clustering with Incomplete Data

Model based clustering of multinomial count data

Clustering With Outlier Removal

Unsupervised Classification with a Family of Parsimonious Contaminated Shifted Asymmetric Laplace Mixtures