Abstract:Outlier detection in data streams is considered a significant task in data mining that targets the discovery of elements in an unprecedented data arrival rate. The fast arrival of data demands fast computation within the shortest period, and with minimal memory usage. Detecting distance-based outliers in such a scenario are more complicated. Existing techniques such as the two best-known methods - Micro-Cluster Outlier Detection (MCOD) and Thresh_LEAP have presented some solutions to these challenges. However, the combination of the strength of both techniques can be a lot more improvement to the individual methods proposed. Therefore, in this paper, we propose a method called Micro-Cluster with Minimal Probing (MCMP), which is a hybrid approach of the combination of the strength of MCOD and Thresh_LEAP. We offer a new distance-based outlier detection technique to minimize the computational cost in detecting distance-based outliers effectively. The proposed MCMP technique is comprised of two approaches. Firstly, we adopt micro-clusters to mitigate the range query search. Then, to deal with the objects outside the microclusters, we propose the concept of differentiating between strong and trivial inliers. The proposed method improves the computational speed and memory consumption, while simultaneously maintaining the outlier detection accuracy. Our experiments are conducted on both real-world and synthetic data sets. We varied the window size (w), neighbor count threshold (k) and distance threshold (R), and observed that our method outperforms the state-of-the-art methods in both CPU time and memory consumption in the majority of the datasets.

Outlier Detection of Time Series with a Novel Hybrid Method in Cloud Computing

An Outlier Detection Technique Based on Spectral Clustering

A Spectral Clustering Based Outlier Detection Technique.

An Outlier Detection Algorithm Based on Cross-Correlation Analysis for Time Series Dataset

MSD-Kmeans: A Novel Algorithm for Efficient Detection of Global and Local Outliers

MSD-Kmeans: A Hybrid Algorithm for Efficient Detection of Global and Local Outliers

Mining Outlier Data in Mobile Internet-Based Large Real-Time Databases.

A Mobile Edge–cloud Collaboration Outlier Detection Framework in Wireless Sensor Networks

A New Outlier Detection Method Based on Machine Learning

A Hybrid Distance-Based Outlier Detection Approach

A Hybrid Outlier Detection Method for Health Care Big Data

Spectral clustering algorithm with application to outlier detection

An Efficient Algorithm for Distributed Outlier Detection in Large Multi-Dimensional Datasets

Outliers Mining in Time Series Data Sets

An Outlier Detection Algorithm Based on Probability Density Clustering

A Survey of Outlier Detection Methodologies and Their Applications

Efficient and Robust KPI Outlier Detection for Large-Scale Datacenters

An Effective Minimal Probing Approach with Micro-Cluster for Distance-Based Outlier Detection in Data Streams.

A Hybrid Business Outlier Detection Algorithm Basing on Creative Computing Methods

A Novel Spatial Outlier Detection Algorithm Based On Mahalanobis Distance

Outlier Mining In Real-Time Measurement Data Of Sensor Based On Data Mining Technique