Attention Fusion Reverse Distillation for Multi-Lighting Image Anomaly Detection

Yiheng Zhang,Yunkang Cao,Tianhang Zhang,Weiming Shen
2024-06-07
Abstract:This study targets Multi-Lighting Image Anomaly Detection (MLIAD), where multiple lighting conditions are utilized to enhance imaging quality and anomaly detection performance. While numerous image anomaly detection methods have been proposed, they lack the capacity to handle multiple inputs for a single sample, like multi-lighting images in MLIAD. Hence, this study proposes Attention Fusion Reverse Distillation (AFRD) to handle multiple inputs in MLIAD. For this purpose, AFRD utilizes a pre-trained teacher network to extract features from multiple inputs. Then these features are aggregated into fused features through an attention module. Subsequently, a corresponding student net-work is utilized to regress the attention fused features. The regression errors are denoted as anomaly scores during inference. Experiments on Eyecandies demonstrates that AFRD achieves superior MLIAD performance than other MLIAD alternatives, also highlighting the benefit of using multiple lighting conditions for anomaly detection.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the challenge of Multi - Lighting Image Anomaly Detection (MLIAD). Specifically, most of the existing image anomaly detection methods can only handle inputs under a single lighting condition and lack the ability to handle multi - lighting conditions. However, in practical applications, the complexity of the object surface and the unpredictability of anomalies make it difficult for a single lighting condition to capture all types of anomalies. Therefore, the paper proposes a new method - Attention Fusion Reverse Distillation (AFRD) - to address the problem of image anomaly detection under multi - lighting conditions. ### Specific description of the problem 1. **Importance of multi - lighting conditions**: - In industrial production, lighting conditions have an important impact on image quality, and anomaly detection depends on high - quality images. - Under different lighting conditions, some anomalies may be more obvious, while they are not obvious under other lighting conditions. Therefore, a single lighting condition is not sufficient to comprehensively capture anomalies. 2. **Limitations of existing methods**: - Most of the existing image anomaly detection methods only consider a single lighting condition and cannot effectively handle inputs under multi - lighting conditions. - These methods perform well under controlled lighting conditions, but their accuracy will decrease when facing the complexity and variability of multi - lighting conditions. 3. **Research objectives**: - Propose a method that can effectively fuse multi - lighting information to improve the accuracy and robustness of anomaly detection. - Emphasize the advantages of multi - lighting conditions in anomaly detection and verify their effectiveness through experiments. ### Overview of the solution To solve the above problems, the paper proposes the AFRD method, whose main features include: - **Pretrained teacher network**: Use a pretrained teacher network to extract features from images under multiple lighting conditions. - **Attention fusion module**: Weighted - fuse the features under multiple lighting conditions through the attention mechanism, emphasizing the most relevant features. - **Student decoder**: Use a student decoder to regress the fused features and calculate the anomaly score. - **Reverse distillation paradigm**: Through the reverse distillation framework, make the student network learn the knowledge of the teacher network, thereby improving the performance of anomaly detection. ### Experimental results The paper verifies the effectiveness of the AFRD method through experiments on the Eyecandies dataset. The results show that AFRD outperforms the existing single - lighting methods in the anomaly detection performance under multi - lighting conditions, achieving an AUROC score of 0.861, which proves the advantages of multi - lighting fusion and the effectiveness of the attention mechanism. In summary, this paper aims to improve the accuracy and robustness of anomaly detection by introducing an image anomaly detection method under multi - lighting conditions to adapt to the complex lighting conditions in practical application scenarios.