Abstract:Unavoidable noise in real-world categorical data presents significant challenges to existing outlier detection methods because they normally fail to separate noisy values from outlying values. Feature subspace-based methods inevitably mix noisy values when retaining an entire feature because a feature may contain both outlying values and noisy values. Pattern-based methods are normally based on frequency and are easily misled by noisy values, resulting in many faulty patterns. This paper introduces a novel unsupervised framework termed OUVAS, and its parameter-free instantiation RHAC to explore a high-quality outlying value set for detecting outliers in noisy categorical data. Based on the observation that the relations between values reflect their essence, OUVAS investigates value similarities to cluster values into different groups and combines cluster-level analysis and value-level refinement to identify an outlying value set. RHAC instantiates OUVAS by three successive modules (i.e., the combination of Ochiai coefficient and LOUVAIN algorithm to cluster values, hierarchical value coupling learning to perform cluster-level analysis, and a threshold to divide fake and real outlying values in value-level refinement). We show that (i) RHAC-based outlier detector significantly outperforms five state-of-the-art outlier detection methods; (ii) Extended RHAC-based feature selection method successfully improves the performance of existing outlier detectors and performs better than two latest outlying feature selection methods.

Vibration-Based Outlier Detection on High Dimensional Data.

Data-driven Dimension Reduction for High-Dimensional Random Vibration Systems with Cubic Nonlinearity

Continuous Angle-based Outlier Detection on High-dimensional Data Streams.

Variational Autoencoder-Based Outlier Detection For High-Dimensional Data

An Outlier Detection Algorithm Based on Cross-Correlation Analysis for Time Series Dataset

Efficient Outlier Detection for High-Dimensional Data

Fluctuation-based Outlier Detection

SVM-OD: SVM Method to Detect Outliers

A Vibration Feature Extraction Method Based on Time-Domain Dimensional Parameters and Mahalanobis Distance

Angle-Based Outlier Detection Algorithm With More Stable Relationships

Robust Subspace Outlier Detection in High Dimensional Space

The Outlier Interval Detection Algorithms on Astronautical Time Series Data

Exploring a High-quality Outlying Feature Value Set for Noise-Resilient Outlier Detection in Categorical Data.

A Spectral Clustering Based Outlier Detection Technique.

A Novel Abnormal Data Detection Method Based on Dynamic Adaptive Local Outlier Factor for the Vibration Signals of Rotating Parts

Adaptive Cutoff Distance Based Density Peak Pivot for Metric Space Outlier Detection

A Novel Outlier Detection Method for Multivariate Data

Improved Method for Noise Detection by DBSCAN and Angle Based Outlier Factor in High Dimensional Datasets

Outlier Detection Based on Eigenspace Subtracting

A Parametric and Non-Parametric Approach for High-Accurate Outlier Detection.

Markov Boundary-Based Outlier Mining