Explainable Anomaly Detection in Images and Videos: A Survey

Yizhou Wang,Dongliang Guo,Sheng Li,Octavia Camps,Yun Fu

2024-04-10

Abstract:Anomaly detection and localization of visual data, including images and videos, are of great significance in both machine learning academia and applied real-world scenarios. Despite the rapid development of visual anomaly detection techniques in recent years, the interpretations of these black-box models and reasonable explanations of why anomalies can be distinguished out are scarce. This paper provides the first survey concentrated on explainable visual anomaly detection methods. We first introduce the basic background of image-level and video-level anomaly detection. Then, as the main content of this survey, a comprehensive and exhaustive literature review of explainable anomaly detection methods for both images and videos is presented. Next, we analyze why some explainable anomaly detection methods can be applied to both images and videos and why others can be only applied to one modality. Additionally, we provide summaries of current 2D visual anomaly detection datasets and evaluation metrics. Finally, we discuss several promising future directions and open problems to explore the explainability of 2D visual anomaly detection. The related resource collection is given at

Machine Learning,Artificial Intelligence

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is **to improve the interpretability of anomaly detection in images and videos**. Although existing visual anomaly detection techniques have achieved rapid development, most of these models are black - box models and lack effective explanations for the detection results. This is a major obstacle in fields that require high transparency and trustworthiness, such as medical image analysis. Therefore, this review article focuses on summarizing and analyzing existing interpretable visual anomaly detection methods, aiming to provide a systematic method to understand how these models identify and distinguish abnormal data and explore future research directions.

Specifically, the main contributions of the paper include:
1. **Collecting and summarizing interpretable methods in 2D anomaly detection tasks**, and proposing a classification system for these methods.
2. **Thoroughly comparing these methods**, outlining their strengths and weaknesses, and proposing some potential directions to address the shortcomings of existing methods.
3. **Filling the gaps in current review literature**, that is, briefly introducing the entire anomaly detection task but ignoring the particularities of interpretable methods in 2D anomaly detection tasks.

Through these contributions, this paper provides readers with a comprehensive understanding of various interpretable 2D anomaly detection methods, helping them find the interpretable anomaly detection technology that best suits their needs or research interests.