Abstract:Outlier detection plays an important role in the pre-treatment of sequential datasets to obtain pure valuable data. This paper proposes an outlier detection scheme for dynamical sequential datasets. First, the conception of forward outlier factor(FOF) and backward outlier factor(BOF) are employed to measure an object's similarity shared with its sequentially adjacent objects. The object that shows no similarity with its sequential neighbors is labeled as suspicious outliers, which will be treated subsequently to judge whether it is really an outlier in the dataset. Second, the sequentially adjacent suspicious outliers are defined as suspicious outlier series(SOS), then the expected path representing the ideal transition path through the suspicious outliers in the SOS and the measured path representing the real path through all the objects in the SOS are employed, and the ratio of the length of the expected path to that of the measured path indicates whether there exist outliers in the SOS. Third, in the case that there exist outliers in the SOS, if there are N suspicious outliers in the SOS, then 2(N) - 2 remaining path will be generated by removing k(0 < k < N) suspicious outliers and sequentially connecting the remaining ones. The dynamical sequential outlier factor(DSOF) is employed to represent the ratio of the length of measured path of the considered remaining path to the that of the the expected path of the corresponding SOS, and the degree of the objects removed in a remaining path being outliers is indicated by the DSOF. The proposed outlier detection scheme is conducted from a dynamical perspective, and breaks the tight relation between being an outlier and being not similar with adjacent objects. Experiments are conducted to evaluate the effectiveness of the proposed scheme, and the experimental results verify that the proposed scheme has higher detection quality for sequential dataset. In addition, the proposed outlier detection scheme is not dependent on the size of dataset and needs no prior information about the distribution of the data.

FCI-Outlier: An Efficient Frequent Closed Itemset-Based Outlier Detecting Approach on Data Stream

Gc-Tree: A Fast Online Algorithm For Mining Frequent Closed Itemsets

Approximate mining of global closed frequent itemsets over data streams

An efficient approach for outlier detection from uncertain data streams based on maximal frequent patterns

Mining Noise-Tolerant Frequent Closed Itemsets in Very Large Database.

UWFP-Outlier: an efficient frequent-pattern-based outlier detection method for uncertain weighted data streams

Finding Frequent Closed Itemsets in Sliding Window in Linear Time.

Attribute outlier detection over data streams

The Application of a Double CUSUM Algorithm in Industrial Data Stream Anomaly Detection

MWFP-outlier: Maximal weighted frequent-pattern-based approach for detecting outliers from uncertain weighted data streams

CELOF: Effective and fast memory efficient local outlier detection in high-dimensional data streams

Real-time distance-based outlier detection in data streams

Fairness-aware Outlier Ensemble

Cube-based Incremental Outlier Detection for Streaming Computing

Outlier detection for incomplete real-valued data via information entropy and class-consistent technology

An Outlier Detection Scheme for Dynamical Sequential Datasets.

Continuous Angle-based Outlier Detection on High-dimensional Data Streams.

A Review of Local Outlier Factor Algorithms for Outlier Detection in Big Data Streams

Efficient Algorithm for Mining of Frequent Itemsets over Uncertain Data Streams

Robust High-dimensional Bioinformatics Data Streams Mining by ODR-ioVFDT

A Fast Outlier Detection Method for Big Data.