Abstract:Outlier detection is a statistical procedure that aims to find suspicious events or items that are different from the normal form of a dataset. It has drawn considerable interest in the field of data mining and machine learning. Outlier detection is important in many applications, including fraud detection in credit card transactions and network intrusion detection. There are two general types of outlier detection: global and local. Global outliers fall outside the normal range for an entire dataset, whereas local outliers may fall within the normal range for the entire dataset, but outside the normal range for the surrounding data points. This paper addresses local outlier detection. The best-known technique for local outlier detection is the Local Outlier Factor (LOF), a density-based technique. There are many LOF algorithms for a static data environment; however, these algorithms cannot be applied directly to data streams, which are an important type of big data. In general, local outlier detection algorithms for data streams are still deficient and better algorithms need to be developed that can effectively analyze the high velocity of data streams to detect local outliers. This paper presents a literature review of local outlier detection algorithms in static and stream environments, with an emphasis on LOF algorithms. It collects and categorizes existing local outlier detection algorithms and analyzes their characteristics. Furthermore, the paper discusses the advantages and limitations of those algorithms and proposes several promising directions for developing improved local outlier detection methods for data streams.

Local Correlation Detection with Linearity Enhancement in Streaming Data

Filcorr: Filtered And Lagged Correlation On Streaming Time Series

Static and Streaming Discovery of Maximal Linear Representation Between Time Series

Correlated Anomaly Detection from Large Streaming Data

Efficient Evaluation of Composite Correlations for Streaming Time Series

The Normalized Kld Coefficient and Its Application in Detection of Correlation and Synchronization from Multivariable Series

A Probabilistic Approach to Detect Local Dependencies in Streams.

Continually Evaluating Similarity-Based Pattern Queries on a Streaming Time Series

SCD-CA: Stable Concept Drift Learning Based on Correlation Alignment for Streaming Data Forecasting.

Online Multi-label Streaming Feature Selection with Label Correlation

A Novel Fault Diagnosis Approach Based on Correlation Analysis and Improved Two-Stream Neural Networks

RLC: ranking lag correlations with flexible sliding windows in data streams

Online nonparametric monitoring for asynchronous processes with serial correlation

Correlation Joins over Time Series Data Streams Utilizing Complementary Dimension Reduction and Transformation

Efficient Detection of Discords for Time Series Stream

Space-Efficient Tracking Of Network-Wide Flow Correlations

Exploring Inter-Frame Correlation Analysis and Wavelet-Domain Modeling for Real-Time Caption Detection in Streaming Video

Detecting Distributed Network Traffic Anomaly with Network-Wide Correlation Analysis

A Review of Local Outlier Factor Algorithms for Outlier Detection in Big Data Streams

CARE: Finding Local Linear Correlations in High Dimensional Data

NLC: Search Correlated Window Pairs on Long Time Series