Abstract:Detection of anomalies in streaming time series data has become an important research topic due to the wide range of possible applications, including the detection of extreme weather conditions, malicious attacks on protected facilities, monitoring unauthorised gas and oil leaks, illegal pipeline connections, power cable faults, and water and other environmental pollution. Rapid detection of abnormal conditions and identifying these critical events is essential to protect lives and assets. Therefore, developing appropriate systems and detection methods is an urgent task. Anomaly detection in streaming data is challenging due to its large volume and high speed, presence of noise, and non-stationarity of the signal (or ‘concept drift’). The latter significantly complicates the identification of differences between new ‘typical’ behaviour and abnormal events. Solving this problem requires the algorithm for processing such data to learn and adapt to changing conditions. The paper proposes a modification of the algorithm for detecting anomalies in time series. This algorithm provides early detection of abnormal series in a massive collection of non-stationary streaming time series data. Anomalies are observations that are highly improbable given the previous time series values. The proposed approach is based on the primary detection of the predictive limit for the typical system behaviour using the theory of extreme values, followed by checking for the abnormality of the following series using the sliding window technique. The time series parameters are used as input data and compared by density distribution to detect any significant changes in the distribution of the characteristics. It allows the decision-making model to automatically adapt to the changing environment according to detected changes. Since anomalies are, by definition, exceptions to the typical behaviour of a system, most of the available stored data should reflect that typical behaviour of the system in question. It is unnecessary to have representative samples of all possible types of the standard behaviour of a given system for the algorithm to work well. The basic idea is to have a warm-up data set to obtain initial values for the decision model parameters. It makes it possible to determine if there is any significant difference between the last typical behaviour and the new typical behaviour. The proposed algorithm demonstrates its performance under conditions of noisy non-stationary data in several time series classes. Keywords: concept drift, extreme value theory, multivariate time series, outlier detection.

Automatic Detection of Anomalies in Post-Processed Data Applied to UTC Time Transfer Links

AnomalyCD: A Benchmark for Earth Anomaly Change Detection with High-Resolution and Time-Series Observations

The Application of a Double CUSUM Algorithm in Industrial Data Stream Anomaly Detection

Online Detection of Time-Variant Oscillations Based on Improved ITD

A Novel Method for Anomaly Detection and Correction of GNSS Time Series

Multiscale water quality contamination events detection based on sensitive time scales reconstruction

Benchmarking Anomaly Detection Methods: Insights From the UCR Time Series Anomaly Archive

Hybrid Model of Natural Time Series with Neural Network Component and Adaptive Nonlinear Scheme: Application for Anomaly Detection

Anomaly Detection Models for IoT Time Series Data

Low-count Time Series Anomaly Detection

Anomaly Detection on Seasonal Metrics via Robust Time Series Decomposition

Anomaly Detection in Spatio-Temporal Data: Theory and Application

ADAPTATION OF THE ALGORITHM FOR DETECTING ANOMALIES IN TIME SERIES FOR NON-STATIONARY STREAMING DATA

Detection of anomalies and Data Drift in a time-series dismissal prediction system

The Weak Frequency Anomaly Detection Method of Atomic Clocks Based on Kalman Filter and Extrapolation-Accumulation

Local Evaluation of Time Series Anomaly Detection Algorithms

Warped Time Series Anomaly Detection

A framework for automated anomaly detection in high frequency water-quality data from in situ sensors

An Evaluation of Real-time Adaptive Sampling Change Point Detection Algorithm using KCUSUM

Python Software Tool for Diagnostics of the Global Navigation Satellite System Station (PS-NETM)–Reviewing the New Global Navigation Satellite System Time Series Analysis Tool

Unsupervised Anomaly Detection in Spatio‐Temporal Stream Network Sensor Data