Abstract:Image anomaly detection problems aim to determine whether an image is abnormal, and to detect anomalous areas. These methods are actively used in various fields such as manufacturing, medical care, and intelligent information. Encoder-decoder structures have been widely used in the field of anomaly detection because they can easily learn normal patterns in an unsupervised learning environment and calculate a score to identify abnormalities through a reconstruction error indicating the difference between input and reconstructed images. Therefore, current image anomaly detection methods have commonly used convolutional encoder-decoders to extract normal information through the local features of images. However, they are limited in that only local features of the image can be utilized when constructing a normal representation owing to the characteristics of convolution operations using a filter of fixed size. Therefore, we propose a vision transformer-based encoder-decoder model, named AnoViT, designed to reflect normal information by additionally learning the global relationship between image patches, which is capable of both image anomaly detection and localization. While existing vision transformers perform image classification using only a class token, the proposed approach constructs a feature map that maintains the existing location information of individual patches by using the embeddings of all patches passed through multiple self-attention layers. Subsequently, the feature map, which has been transformed into three dimensions, is used to perform decoding. This design preserves the spatial information sufficiently by excluding the fully-connected layer, which extracts latent vectors in existing convolution-based encoder-decoders. The proposed AnoViT model performed better than the convolution-based model on three benchmark datasets. In MVTecAD, which is a representative benchmark dataset for anomaly localization, it showed improved results on 10 out of 15 clas- es compared with the baseline. Furthermore, the proposed method showed good performance regardless of the class and type of the anomalous area when localization results were evaluated qualitatively.

RaViT-AE: Unsupervised Anomaly Detection for Intelligent Cultural Heritage Monitoring Using Region-Attentive ViT Autoencoder

Robust and Unsupervised KPI Anomaly Detection Based on Highly Sensitive Conditional Variational Auto-Encoders.

AnoViT: Unsupervised Anomaly Detection and Localization With Vision Transformer-Based Encoder-Decoder

ViV-Ano: Anomaly Detection and Localization Combining Vision Transformer and Variational Autoencoder in the Manufacturing Process

Patch-wise Auto-Encoder for Visual Anomaly Detection

Self-Supervision-Augmented Deep Autoencoder for Unsupervised Visual Anomaly Detection

Hyperspectral Anomaly Detection with Auto-Encoder and Independent Target

An Unsupervised Method for Industrial Image Anomaly Detection with Vision Transformer-Based Autoencoder

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

Enhancing Video Anomaly Detection Using a Transformer Spatiotemporal Attention Unsupervised Framework for Large Datasets

Video Anomaly Detection Based on Adaptive Multiple Auto-Encoders.

Memory-augmented Adversarial Autoencoders for Multivariate Time-series Anomaly Detection with Deep Reconstruction and Prediction

VESC: a new variational autoencoder based model for anomaly detection

Attention-based residual autoencoder for video anomaly detection

Recurrent auto-encoder with multi-resolution ensemble and predictive coding for multivariate time-series anomaly detection

Anomaly Detection for Agricultural Vehicles Using Autoencoders

Generate anomalies from normal: a partial pseudo-anomaly augmented approach for video anomaly detection

A-VAE: Attention based Variational Autoencoder for Traffic Video Anomaly Detection

Semi-supervised visual anomaly detection based on convolutional autoencoder and transfer learning

Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach