Unsupervised Industrial Internet Time Series Anomaly Detection Based on Reinforcement Learning

Zhe Dong,Yaqing Huang,Junpeng He
DOI: https://doi.org/10.1145/3665348.3665401
2024-05-10
Abstract:With the popularization of big data and Internet of things technology, the amount of time series data is exploding, which makes anomaly detection in time series particularly important. Anomaly detection aims to find those data points or behaviors that do not conform to regular patterns. This study proposes an innovative unsupervised time series anomaly detection algorithm that is able to dynamically learn and adapt to anomalies in real-time data streams by combining reinforcement learning, spectral residual (SR), and variational encoder (VAE) techniques. We use a two-layer long short-term memory (LSTM) model and a self-attention network to build a reinforcement learning agent that is able to integrate temporal information of time series data to optimize policies. In addition, we propose a novel unsupervised reinforcement learning model by combining SR and VAE as the reward function. Experimental results show that our proposed algorithm outperforms the other four methods on two public datasets and one real-world dataset.
Engineering,Computer Science
What problem does this paper attempt to address?