Abstract:In the industrial scenario, anomaly detection could locate but cannot classify anomalies. To complete their capability, we study to automatically discover and recognize visual classes of industrial anomalies. In terms of multi-class anomaly classification, previous methods cluster anomalies represented by frozen pre-trained models but often fail due to poor discrimination. Novel class discovery (NCD) has the potential to tackle this. However, it struggles with non-prominent and semantically weak anomalies that challenge network learning focus. To address these, we introduce AnomalyNCD, a multi-class anomaly classification framework compatible with existing anomaly detection methods. This framework learns anomaly-specific features and classifies anomalies in a self-supervised manner. Initially, a technique called Main Element Binarization (MEBin) is first designed, which segments primary anomaly regions into masks to alleviate the impact of incorrect detections on learning. Subsequently, we employ mask-guided contrastive representation learning to improve feature discrimination, which focuses network attention on isolated anomalous regions and reduces the confusion of erroneous inputs through re-corrected pseudo labels. Finally, to enable flexible classification at both region and image levels during inference, we develop a region merging strategy that determines the overall image category based on the classified anomaly regions. Our method outperforms the state-of-the-art works on the MVTec AD and MTD datasets. Compared with the current methods, AnomalyNCD combined with zero-shot anomaly detection method achieves a 10.8% $F_1$ gain, 8.8% NMI gain, and 9.5% ARI gain on MVTec AD, 12.8% $F_1$ gain, 5.7% NMI gain, and 10.8% ARI gain on MTD. The source code is available at <a class="link-external link-https" href="https://github.com/HUST-SLOW/AnomalyNCD" rel="external noopener nofollow">this https URL</a>.

Anomaly Detection Framework for Unmanned Vending Machines

A Diffusion-Based Framework for Multi-Class Anomaly Detection

Uni-3DAD: GAN-Inversion Aided Universal 3D Anomaly Detection on Model-free Products

AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

Distributed Online One-Class Support Vector Machine for Anomaly Detection over Networks

UniVAD: A Training-free Unified Model for Few-shot Visual Anomaly Detection

A Hybrid Algorithm Incorporating Vector Quantization and One-Class Support Vector Machine for Industrial Anomaly Detection

A Unified Model for Multi-class Anomaly Detection

Mixed Noise-Guided Mutual Constraint Framework for Unsupervised Anomaly Detection in Smart Industries

A Design of Smart Unmanned Vending Machine for New Retail Based on Binocular Camera and Machine Vision

FD-UAD: Unsupervised Anomaly Detection Platform Based on Defect Autonomous Imaging and Enhancement

Toward New Retail: A Benchmark Dataset for Smart Unmanned Vending Machines

Multiview Deep Anomaly Detection: A Systematic Exploration

A Real-Time Application for the Analysis of Multi-Purpose Vending Machines with Machine Learning

BP-YOLO: A Real-Time Product Detection and Shopping Behaviors Recognition Model for Intelligent Unmanned Vending Machine

MSTAD: A masked subspace-like transformer for multi-class anomaly detection

Self-Attention Memory-Augmented Wavelet-CNN for Anomaly Detection

Video anomaly detection based on scene classification

DMAD: Dual Memory Bank for Real-World Anomaly Detection

Open-Vocabulary Video Anomaly Detection

ADAGENT: Anomaly Detection Agent with Multimodal Large Models in Adverse Environments