Abstract:Anomaly detection is an area of video analysis and plays an increasing role in ensuring safety, preventing risks, and guaranteeing quick response in intelligent surveillance systems. It has become a popular research topic and has piqued the interest of researchers in different communities, such as computer vision, machine learning, remote sensing, and data mining, in recent years. This promotes novel mobile systems where drones are equipped with cameras to help people find better and more efficient solutions to automatically detect anomalies (e.g., car accidents, traffic congestion, street fighting) in traffic surveillance videos. However, anomaly detection methods are still rarely studied and developed in the remote sensing community due to anomalous events rarely occurring in real life, along with the high similarities between the objects of interest with small sizes, multi-scale objects, complex backgrounds of great variations, and high overlap between objects. Therefore, in order to fully exploit the spatio-temporal information for anomaly detection in traffic surveillance circumstances, we propose a future frame prediction network based on transformer architectures to detect abnormal events from drone videography in an unsupervised way. Our model treats consecutive video frames from an input clip and feeds features to a transformer encoder to capture spatial and temporal representations from the sequence. Then, it leverages a decoder to predict the next frame. Furthermore, an event with high reconstruction error is identified as an anomaly in the test phase. Thoroughly empirical studies demonstrate that our method achieves superior performance on the UIT-ADrone dataset and largely outperforms the state-of-the-art anomaly methods on the Drone-Anomaly dataset in aerial surveillance. The source code is available online at https://github.com/Tungufm/ASTT.

UTRAD: Anomaly detection and localization with U-Transformer

ITran: A novel transformer-based approach for industrial anomaly detection and localization

Mixed Transformer U-Net for Medical Image Segmentation

ADTR: Anomaly Detection Transformer with Feature Reconstruction

Multiresolution feature guidance based transformer for anomaly detection

DMU-TransNet: Dense multi-scale U-shape transformer network for anomaly detection

Hierarchical Vector Quantized Transformer for Multi-class Unsupervised Anomaly Detection

ViTALnet: Anomaly on Industrial Textured Surfaces With Hybrid Transformer

TUT: Template-Augmented U-Net Transformer for Unsupervised Anomaly Detection

Enhancing Video Anomaly Detection Using a Transformer Spatiotemporal Attention Unsupervised Framework for Large Datasets

MSTAD: A masked subspace-like transformer for multi-class anomaly detection

A Diffusion-Based Framework for Multi-Class Anomaly Detection

TransAnomaly: Video Anomaly Detection Using Video Vision Transformer

TCF-Trans: Temporal Context Fusion Transformer for Anomaly Detection in Time Series

A two-stage adversarial Transformer based approach for multivariate industrial time series anomaly detection

A Transformer Architecture based mutual attention for Image Anomaly Detection

Dinomaly: The Less Is More Philosophy in Multi-Class Unsupervised Anomaly Detection

Transformer-based Spatio-Temporal Unsupervised Traffic Anomaly Detection in Aerial Videos

CVTGAD: Simplified Transformer with Cross-View Attention for Unsupervised Graph-level Anomaly Detection

Anomaly detection in surveillance videos using Transformer with margin learning

RDAD: A reconstructive and discriminative anomaly detection model based on transformer