Abstract:Recently, much attention has been paid to segmenting subtle unknown defect regions by knowledge distillation in an unsupervised setting. Most previous studies concentrated on guiding the student network to learn the same representations on the normality, neglecting the different behaviors of the abnormality. This leads to a high probability of false detection of subtle defects. To address such an issue, we propose to push representations on abnormal areas of the teacher and student network as far as possible while pulling representations on normal areas as close as possible. Based on this idea, we design an efficient teacher-student model for anomaly detection and localization, which maximizes pixel-wise discrepancies for anomalous regions approximated by data augmentation and simultaneously minimizes discrepancies for pixel-wise normal regions between these two networks. The explicit differential knowledge distillation enlarges the margin between normal representations and abnormal ones in favour of discriminating them. Then, the appropriate small student network is not only efficient, but more importantly, helps inhibit the generalization ability of anomalous patterns when learning normal patterns, facilitating the precise decision boundary. The experimental results on the MVTec AD, Fashion-MNIST, and CIFAR-10 datasets demonstrate that our proposed method achieves better performance than current state-of-the-art (SOTA) approaches. Especially, For the MVTec AD dataset with high resolution images, we achieve 98.1 AUROC% and 93.6 AUPRO% in anomaly localization, outperforming knowledge distillation based SOTA methods by 1.1 AUROC% and 1.5 AUPRO% with a lightweight model.

MTHM: Self-Supervised Multitask Anomaly Detection with Hard Example Mining

Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection

Efficient Anomaly Detection Using Self-Supervised Multi-Cue Tasks

Self-Paced Hard Task-Example Mining for Few-Shot Classification

A Diffusion-Based Framework for Multi-Class Anomaly Detection

Self-Attention Memory-Augmented Wavelet-CNN for Anomaly Detection

Pull & Push: Leveraging Differential Knowledge Distillation for Efficient Unsupervised Anomaly Detection and Localization

Reconstruction-based Multi-Normal Prototypes Learning for Weakly Supervised Anomaly Detection

Self-Supervised Anomaly Detection from Anomalous Training Data via Iterative Latent Token Masking

Hard-normal Example-aware Template Mutual Matching for Industrial Anomaly Detection

Self-Supervised Masking for Unsupervised Anomaly Detection and Localization

ALMRR: Anomaly Localization Mamba on Industrial Textured Surface with Feature Reconstruction and Refinement

A Novel MAE-Based Self-Supervised Anomaly Detection and Localization Method

Attention-Guided Perturbation for Unsupervised Image Anomaly Detection

Self-Supervised Learning for Industrial Image Anomaly Detection by Simulating Anomalous Samples

Self-Supervised Multi-Scale Cropping and Simple Masked Attentive Predicting for Lung CT-Scan Anomaly Detection

Self-Supervised Learning for Anomaly Detection With Dynamic Local Augmentation

Unsupervised Anomaly Detection in MR Images using Multi-Contrast Information

Confidence-Aware and Self-Supervised Image Anomaly Localisation

Focus Your Distribution: Coarse-to-Fine Non-Contrastive Learning for Anomaly Detection and Localization

MSTAD: A masked subspace-like transformer for multi-class anomaly detection