Abstract:Due to the diversity and scarcity of defective samples, anomaly detection is usually taken as one of the main solutions of defect detection in intelligent manufacturing industry. Unsupervised anomaly detection usually faces two main challenges: (1) Without effective knowledge transferring, diversity and scarcity of defect samples led to model's training difficulties, especially for deep CNN model; (2) Large scale variations of defects led to the lack of generalization ability for typical CNN models with single or a few scale represented features. In this work, we propose a simple yet powerful unsupervised anomaly detection method by: i) The teacher and student networks are introduced to train deep CNN-based detection networks. With a powerful deep pre- trained neural network as teacher, and one proposed combined- distance based loss function, a student network with the same architecture is developed to learn teacher's knowledge, and the defective regions are recognized by the larger feature distances compared with the normal regions; ii) Multi-scale feature distillation is developed to against the scale variations. Unlike most knowledge distillation methods that only distill feature output by the last layer, we distill the features on different levels of feature maps output by the intermediate layers, and develop one combined-distance and Gaussian Kernel based receptive field up-sampling mechanism, to generate high resolution anomaly heatmap. Evaluation of the widely used MVTec anomaly detection dataset shows that our method is competitive to the state-of-the-art methods with over 10 times inference speed increase: from 2.8fps@256 × 256 to 33.2fps; The experiments on other two anomaly detection datasets, ShanghaiTech Campus dataset (STC) and Magnetic Tile Defects dataset (MTD), are also given to verify the generalization of the proposed work.

Partial Distillation of Deep Feature for Unsupervised Image Anomaly Detection and Segmentation.

Unsupervised Image Anomaly Detection and Segmentation Based on Pretrained Feature Mapping

Pull & Push: Leveraging Differential Knowledge Distillation for Efficient Unsupervised Anomaly Detection and Localization

Enhanced Reverse Distillation Guided Segmentation Network for Anomaly Detection

Masked feature reconstruction distillation for unsupervised anomaly detection

DFR: Deep Feature Reconstruction for Unsupervised Anomaly Segmentation

Unsupervised Anomaly Detection via Normal Feature-Enhanced Reverse Teacher–Student Distillation

Dual-Modeling Decouple Distillation for Unsupervised Anomaly Detection

Multi-Channel Knowledge Distillation Via Efficient Feature Fusion Module for Anomaly Segmentation

Dual-Branch Knowledge Distillation Via Residual Features Aggregation Module for Anomaly Segmentation

ADPS: Asymmetric Distillation Postsegmentation for Image Anomaly Detection

A Diffusion-Based Framework for Multi-Class Anomaly Detection

ADPS: Asymmetric Distillation Post-Segmentation for Image Anomaly Detection

Multi-Scale Feature Distillation for Anomaly Detection

Informative knowledge distillation for image anomaly segmentation

Unsupervised Anomaly Segmentation Via Multilevel Image Reconstruction and Adaptive Attention-Level Transition

Exploiting the Sparse Characteristics in Probabilistic Feature Space for Hyperspectral Anomaly Detection

Unsupervised Anomaly Detection for Surface Defects with Dual-Siamese Network

Deep Feature Contrasting for Industrial Image Anomaly Segmentation

Unsupervised anomaly detection and localization via bidirectional knowledge distillation

MIMRD: an Enhanced Masked Image Modeling Reverse Distillation for Anomaly Detection