Abstract:How to tackle high dimensionality of data effectively and efficiently is still a challenging issue in machine learning. Identifying anomalous objects from given data has a broad range of real-world applications. Although many classical outlier detection or ranking algorithms have been witnessed during the past years, the high-dimensional problem, as well as the size of neighborhood, in outlier detection have not yet attracted sufficient attention. The former may trigger the distance concentration problem that the distances of observations in high-dimensional space tend to be indiscernible, whereas the latter requires appropriate values for parameters, making models high complex and more sensitive. To partially circumvent these problems, especially the high dimensionality, we introduce a concept called local projection score (LPS) to represent deviation degree of an observation to its neighbors. The LPS is obtained from the neighborhood information by the technique of low-rank approximation. The observation with high LPS is a promising candidate of outlier in high probability. Based on this notion, we propose an efficient and effective outlier detection algorithm, which is also robust to the parameter k of k nearest neighbors. Extensive evaluation experiments conducted on twelve public real-world data sets with five popular outlier detection algorithms show that the performance of the proposed method is competitive and promising.

Outliers Detection Based on Kernel Function-Principle Component Dimension Reduction

The PP Principal Component Based on Kernel and its Application in Clustering with Outliers

Outliers detection algorithm based on nonlinear data transformation

LLE dimensionality reduction based on kernel-induced distance measurement and its application in clustering with outliers

A High-Dimensional Outlier Detection Algorithm Base on Relevant Subspace.

The research of detection of outliers based on manifold learning

A Method for Measurement Data Modeling and High-Dimensional Outlier Detection Based on Large Dimensional Matrix

Research of Detection of Outliers Based on Locally Linear Weighted Value

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Efficient Outlier Detection for High-Dimensional Data

Outlier Mining Based on Principal Component Estimation

An Exceptional Reduction Algorithm for Outliers Analyzing in High-Dimension Space

Robust and Sparse Kernel PCA and Its Outlier Map

An Infinite Dimensional Analysis of Kernel Principal Components

Outlier detection for high dimensional data

An effective and efficient algorithm for high-dimensional outlier detection

Impact of Dimensionality Reduction on Outlier Detection: an Empirical Study

Nonlinear data reconstruction by robust kernel principal component analysis

Locally linear embedding method for high dimensional data outlier detection

Outlier Detection Based on Eigenspace Subtracting

An Outlier Detection Algorithm Based on a Soft Hyper-Sphere for High Dimension Nonlin-Ear Data