Abstract:Due to the diversity and scarcity of defective samples, anomaly detection is usually taken as one of the main solutions of defect detection in intelligent manufacturing industry. Unsupervised anomaly detection usually faces two main challenges: (1) Without effective knowledge transferring, diversity and scarcity of defect samples led to model's training difficulties, especially for deep CNN model; (2) Large scale variations of defects led to the lack of generalization ability for typical CNN models with single or a few scale represented features. In this work, we propose a simple yet powerful unsupervised anomaly detection method by: i) The teacher and student networks are introduced to train deep CNN-based detection networks. With a powerful deep pre- trained neural network as teacher, and one proposed combined- distance based loss function, a student network with the same architecture is developed to learn teacher's knowledge, and the defective regions are recognized by the larger feature distances compared with the normal regions; ii) Multi-scale feature distillation is developed to against the scale variations. Unlike most knowledge distillation methods that only distill feature output by the last layer, we distill the features on different levels of feature maps output by the intermediate layers, and develop one combined-distance and Gaussian Kernel based receptive field up-sampling mechanism, to generate high resolution anomaly heatmap. Evaluation of the widely used MVTec anomaly detection dataset shows that our method is competitive to the state-of-the-art methods with over 10 times inference speed increase: from 2.8fps@256 × 256 to 33.2fps; The experiments on other two anomaly detection datasets, ShanghaiTech Campus dataset (STC) and Magnetic Tile Defects dataset (MTD), are also given to verify the generalization of the proposed work.

Multi-scale feature reconstruction network for industrial anomaly detection

Multi-feature Reconstruction Network using Crossed-mask Restoration for Unsupervised Industrial Anomaly Detection

A Diffusion-Based Framework for Multi-Class Anomaly Detection

Multi-Scale Feature Distillation for Anomaly Detection

Unsupervised Industrial Anomaly Detection via Pattern Generative and Contrastive Networks

MSDG: Multi-Scale Dynamic Graph Neural Network for Industrial Time Series Anomaly Detection

NN2ViT: Neural Networks and Vision Transformers based approach for Visual Anomaly Detection in Industrial Images

Multi-Channel Knowledge Distillation Via Efficient Feature Fusion Module for Anomaly Segmentation

Unsupervised Anomaly Detection for Surface Defects with Dual-Siamese Network

Masked Swin Transformer Unet for Industrial Anomaly Detection

An Unsupervised Method for Industrial Image Anomaly Detection with Vision Transformer-Based Autoencoder

Industrial Product Surface Anomaly Detection with Realistic Synthetic Anomalies Based on Defect Map Prediction

Revisiting Deep Feature Reconstruction for Logical and Structural Industrial Anomaly Detection

Memory-Enhanced Spatial-Temporal Encoding Framework for Industrial Anomaly Detection System

Mixed Noise-Guided Mutual Constraint Framework for Unsupervised Anomaly Detection in Smart Industries

MSTAD: A masked subspace-like transformer for multi-class anomaly detection

A robust multi-scale feature extraction framework with dual memory module for multivariate time series anomaly detection

Real-Time Deep Anomaly Detection Framework for Multivariate Time-Series Data in Industrial IoT

Industrial surface defect detection by multi-scale Inpainting-GAN

A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Data

Dual-Branch Reconstruction Network for Industrial Anomaly Detection with RGB-D Data