Abstract:With the rapid development of industry, the risks factories face are increasing. Therefore, the anomaly detection algorithms deployed in factories need to have high accuracy, and they need to be able to promptly discover and locate the specific equipment causing the anomaly to restore the regular operation of the abnormal equipment. However, the neural network models currently deployed in factories cannot effectively capture both temporal features within dimensions and relationship features between dimensions; some algorithms that consider both types of features lack interpretability. Therefore, we propose a high-precision, interpretable anomaly detection algorithm based on variational autoencoder (VAE). We use a multi-scale local weight-sharing convolutional neural network structure to fully extract the temporal features within each dimension of the multi-dimensional time series. Then, we model the features from various aspects through multiple attention heads, extracting the relationship features between dimensions. We map the attention output results to the latent space distribution of the VAE and propose an optimization method to improve the reconstruction performance of the VAE, detecting anomalies through reconstruction errors. Regarding anomaly interpretability, we utilize the VAE probability distribution characteristics, decompose the obtained joint probability density into conditional probabilities on each dimension, and calculate the anomaly score, which provides helpful value for technicians. Experimental results show that our algorithm performed best in terms of F1 score and AUC value. The AUC value for anomaly detection is 0.982, and the F1 score is 0.905, which is 4% higher than the best-performing baseline algorithm, Transformer with a Discriminator for Anomaly Detection (TDAD). It also provides accurate anomaly interpretation capability.

Unsupervised Anomaly Detection Using Variational Auto-Encoder based Feature Extraction

Robust and Unsupervised KPI Anomaly Detection Based on Highly Sensitive Conditional Variational Auto-Encoders.

VESC: a new variational autoencoder based model for anomaly detection

The Study on Multivariate Time Series Anomaly Detection Via Convolutional Variational Autoencoder

Unsupervised Anomaly Detection in Multivariate Time Series Through Transformer-based Variational Autoencoder

Unsupervised anomaly video detection via a double-flow ConvLSTM variational autoencoder

Unsupervised Anomaly Detection by Autoencoder with Feature Decomposition.

Variational Auto Encoder Fused with Gaussian Process for Unsupervised Anomaly Detection

Disentangled Anomaly Detection for Multivariate Time Series

Learning Sparse Representation With Variational Auto-Encoder for Anomaly Detection.

Time Series Anomaly Detection with Variational Autoencoders

Self-Supervised Variational Graph Autoencoder for System-Level Anomaly Detection

Unsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications.

Multi-Channel Multi-Scale Convolution Attention Variational Autoencoder (MCA-VAE): An Interpretable Anomaly Detection Algorithm Based on Variational Autoencoder

Multi-mode non-Gaussian variational autoencoder network with missing sources for anomaly detection of complex electromechanical equipment

Unsupervised Machine Anomaly Detection Using Autoencoder and Temporal Convolutional Network.

A Latent Feature Autoencoder Via Adversarial Training for Unsupervised Anomaly Detection

SVD-AE: an Asymmetric Autoencoder with SVD Regularization for Multivariate Time Series Anomaly Detection

Unsupervised Anomaly Detection with Local-Sensitive VQVAE and Global-Sensitive Transformers

Variational Autoencoder for Anomaly Detection: A Comparative Study

Deep Semi-supervised Anomaly Detection Using VQ-VAE