AD 2 S: Adaptive anomaly detection on sporadic data streams
Fengrui Liu,Yang Wang,Zhenyu Li,Hongtao Guan,Gaogang Xie
DOI: https://doi.org/10.1016/j.comcom.2023.06.027
IF: 5.047
2023-09-01
Computer Communications
Abstract:With the widespread use of Internet applications, ensuring the quality and reliability of online services has become increasingly important. Therefore, anomaly detection methods play a critical role in identifying potential anomalies in the data streams of infrastructure systems and service applications. However, most of known detection methods have an underlying assumption that the data streams are continuous. In practice, we learn that many real-world data streams can be sporadic. It incurs particular challenges for the task of anomaly detection, for which the common preprocessing of downsampling on sporadic data can omit potential anomalies and delay alarms. In this paper, we propose an ensemble learning-based anomaly detection method on sporadic data streams named AD 2 S . It consists of two modules: a monitor module to continuously and adaptively determine the measure windows for observations, and a detection module that utilizes an isolation partition strategy to estimate the anomaly degree of each incoming observation. Based on experimental results on eight synthetic and public real-world datasets, our method outperforms other state-of-the-art methods with an average AUC score of 0.923. Additionally, our analysis demonstrates that the proposed method has constant amortized time and space complexity, enabling once detection within an average of 9.9 ms and maximum memory usage of 26.14 KB. The code of AD 2 S is open-sourced for further research.
computer science, information systems,telecommunications,engineering, electrical & electronic