Abstract:Outlier detection is of vital importance for various fields and applications. Existing works mainly focus on identifying outliers from underlying datasets, while how to provide sense-making explanations is largely ignored. In this paper, we propose to visualize data points in a set of scatter plots on two-dimensional (2-D) feature spaces that can provide meaningful explanations about the outlying behavior of outliers. Data are typically multidimensional and the number of 2-D combinations could be huge. Also, outliers may have diverse characteristics, and thus the global scatter plots containing all of outliers may degrade the explanation effectiveness for those outliers having idiosyncratic abnormal 2-D spaces. To address this problem, we propose a new outlier explanation approach, called LP-Explain, which tries to identify the set of best Local Pictorial explanations (defined as the scatter plots in the 2-D space of the feature pairs) that can Explain the behavior for cluster of outliers. We first define an effective measure to quantify the similarity between outliers, and then cluster outliers into different groups based on their abnormal feature pairs. We then propose to weigh the importance of feature pairs within each cluster through a multi-task learning framework to select the set of top feature pairs that best explain various outlier clusters. By adjusting a user-defined parameter indicating the “localization level”, the proposed method can attain both global and local results for the explanation of the outliers. 2-D visual explanations can be plotted for the top-weighted feature pairs of each cluster. We conduct experiments on various public datasets, which show that the proposed approach can provide more meaningful explanations about the outlying behavior in a dataset.

Locally linear embedding method for high dimensional data outlier detection

Research of Detection of Outliers Based on Locally Linear Weighted Value

Efficient Outlier Detection for High-Dimensional Data

An Outlier Detection Method in High Dimensional Time Series Based on LLM

LLE dimensionality reduction based on kernel-induced distance measurement and its application in clustering with outliers

A Method for Measurement Data Modeling and High-Dimensional Outlier Detection Based on Large Dimensional Matrix

A High-Dimensional Outlier Detection Algorithm Base on Relevant Subspace.

LSOF - Novel Outlier Detection Approach Based on Local Structure.

Outlier Detection Using Local Density and Global Structure

LP-Explain: Local Pictorial Explanation for Outliers.

Outlier detection algorithm based on k-nearest neighbors-local outlier factor

Outliers detection algorithm based on nonlinear data transformation

Outlier Detection Using Structural Scores in a High-Dimensional Space.

Outlier detection for high dimensional data

An Outlier Detection Algorithm based on Local Density and Natural Neighbors

Locally Linear Embedding Preserving Local Neighborhood

The research of detection of outliers based on manifold learning

Local Dynamic Neighborhood Based Outlier Detection Approach and Its Framework for Large-Scale Datasets

Clustering-Based Locally Linear Embedding

Finding Centric Local Outliers in Categorical/numerical Spaces.

CELOF: Effective and fast memory efficient local outlier detection in high-dimensional data streams