Abstract:The nature of modern data is increasingly real-time, making outlier detection crucial in any data-related field, such as finance for fraud detection and healthcare for monitoring patient vitals. Traditional outlier detection methods, such as the Local Outlier Factor (LOF) algorithm, struggle with real-time data due to the need for extensive recalculations with each new data point, limiting their application in real-time environments. While the Incremental LOF (ILOF) algorithm has been developed to tackle the challenges of online anomaly detection, it remains computationally expensive when processing large streams of data points, and its detection performance may degrade after a certain threshold of points have streamed in. In this paper, we propose a novel approach to enhance the efficiency of LOF algorithms for online anomaly detection, named the Efficient Incremental LOF (EILOF) algorithm. The EILOF algorithm only computes the LOF scores of new points without altering the LOF scores of existing data points. Although exact LOF scores have not yet been computed for the existing points in the new algorithm, datasets often contain noise, and minor deviations in LOF score calculations do not necessarily degrade detection performance. In fact, such deviations can sometimes enhance outlier detection. We systematically tested this approach on both simulated and real-world datasets, demonstrating that EILOF outperforms ILOF as the volume of streaming data increases across various scenarios. The EILOF algorithm not only significantly reduces computational costs, but also systematically improves detection accuracy when the number of additional points increases compared to the ILOF algorithm.

Incremental Local Evolutionary Outlier Detection for Dynamic Social Networks.

IncLOF:An Incremental Algorithm for Mining Local Outliers in Dynamic Environment

A Scalable Algorithm for Detecting Community Outliers in Social Networks.

Fast Community Discovery and Its Evolution Tracking in Time-Evolving Social Networks

Dynamic Community Detection Method Based On An Improved Evolutionary Matrix

An Algorithm for Mining Top K Influential Community Based Evolutionary Outliers in Temporal Dataset

Dynamic Network Embeddings for Network Evolution Analysis.

Detecting and Assessing Anomalous Evolutionary Behaviors of Nodes in Evolving Social Networks

Detecting Influential Nodes Incrementally and Evolutionarily in Online Social Networks

On the Shoulders of Giants: Incremental Influence Maximization in Evolving Social Networks

Dynamic Community Detection Algorithm Based On Incremental Identification

Robust Transition Estimation for Community Evolution and Evolutionary Outlier Detection

Local Dynamic Neighborhood Based Outlier Detection Approach and Its Framework for Large-Scale Datasets

Dynamic Laplace: Efficient Centrality Measure for Weighted or Unweighted Evolving Networks

Modeling the Local and Global Evolution Pattern of Community Structures for Dynamic Networks Analysis

IC: Incremental algorithm for community identification in dynamic social networks

Evolutionary Community Discovery in Dynamic Networks Based on Leader Nodes.

Detecting the evolving community structure in dynamic social networks

Efficient Incremental Dynamic Link Prediction Algorithms in Social Network

An Efficient Outlier Detection Algorithm for Data Streaming

A Novel Framework for Analyzing Overlapping Community Evolution in Dynamic Social Networks.