Abstract:Anomaly detection on time series data is increasingly common across various industrial domains that monitor metrics in order to prevent potential accidents and economic losses. However, a scarcity of labeled data and ambiguous definitions of anomalies can complicate these efforts. Recent unsupervised machine learning methods have made remarkable progress in tackling this problem using either single-timestamp predictions or time series reconstructions. While traditionally considered separately, these methods are not mutually exclusive and can offer complementary perspectives on anomaly detection. This paper first highlights the successes and limitations of prediction-based and reconstruction-based methods with visualized time series signals and anomaly scores. We then propose AER (Auto-encoder with Regression), a joint model that combines a vanilla auto-encoder and an LSTM regressor to incorporate the successes and address the limitations of each method. Our model can produce bi-directional predictions while simultaneously reconstructing the original time series by optimizing a joint objective function. Furthermore, we propose several ways of combining the prediction and reconstruction errors through a series of ablation studies. Finally, we compare the performance of the AER architecture against two prediction-based methods and three reconstruction-based methods on 12 well-known univariate time series datasets from NASA, Yahoo, Numenta, and UCR. The results show that AER has the highest averaged F1 score across all datasets (a 23.5% improvement compared to ARIMA) while retaining a runtime similar to its vanilla auto-encoder and regressor components. Our model is available in Orion, an open-source benchmarking tool for time series anomaly detection.

Anomaly Scoring for Prediction-Based Anomaly Detection in Time Series

Anomaly Detection Algorithm Based on Electric Equipment

An Enhancing Timeseries Anomaly Detection Using LSTM and Bi-LSTM Architectures

Nominality Score Conditioned Time Series Anomaly Detection by Point/Sequential Reconstruction

LSTM-based Anomaly Detection for Non-linear Dynamical System

Time Series Anomaly Detection Based on CEEMDAN and LSTM.

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

An Anomaly Detection Method Based on Learning of "Scores Sequence".

HybridAD: A Hybrid Model-Driven Anomaly Detection Approach for Multivariate Time Series

Pattern-Based Time-Series Risk Scoring for Anomaly Detection and Alert Filtering -- A Predictive Maintenance Case Study

A Novel Deep Learning Approach for Anomaly Detection of Time Series Data

Anomaly Prediction: A Novel Approach with Explicit Delay and Horizon

F-SE-LSTM: A Time Series Anomaly Detection Method with Frequency Domain Information

An Evaluation of Anomaly Detection and Diagnosis in Multivariate Time Series

Towards an Awareness of Time Series Anomaly Detection Models' Adversarial Vulnerability

AER: Auto-Encoder with Regression for Time Series Anomaly Detection

Precursor-of-Anomaly Detection for Irregular Time Series

An LSTM-Based Predictive Monitoring Method for Data with Time-varying Variability

Towards Unbiased Evaluation of Time-series Anomaly Detector

CNN and LSTM based Encoder-Decoder for Anomaly Detection in Multivariate Time Series