Abstract:In the industrial scenario, anomaly detection could locate but cannot classify anomalies. To complete their capability, we study to automatically discover and recognize visual classes of industrial anomalies. In terms of multi-class anomaly classification, previous methods cluster anomalies represented by frozen pre-trained models but often fail due to poor discrimination. Novel class discovery (NCD) has the potential to tackle this. However, it struggles with non-prominent and semantically weak anomalies that challenge network learning focus. To address these, we introduce AnomalyNCD, a multi-class anomaly classification framework compatible with existing anomaly detection methods. This framework learns anomaly-specific features and classifies anomalies in a self-supervised manner. Initially, a technique called Main Element Binarization (MEBin) is first designed, which segments primary anomaly regions into masks to alleviate the impact of incorrect detections on learning. Subsequently, we employ mask-guided contrastive representation learning to improve feature discrimination, which focuses network attention on isolated anomalous regions and reduces the confusion of erroneous inputs through re-corrected pseudo labels. Finally, to enable flexible classification at both region and image levels during inference, we develop a region merging strategy that determines the overall image category based on the classified anomaly regions. Our method outperforms the state-of-the-art works on the MVTec AD and MTD datasets. Compared with the current methods, AnomalyNCD combined with zero-shot anomaly detection method achieves a 10.8% $F_1$ gain, 8.8% NMI gain, and 9.5% ARI gain on MVTec AD, 12.8% $F_1$ gain, 5.7% NMI gain, and 10.8% ARI gain on MTD. The source code is available at <a class="link-external link-https" href="https://github.com/HUST-SLOW/AnomalyNCD" rel="external noopener nofollow">this https URL</a>.

Novel Class Discovery for Long-tailed Recognition

Class-relation Knowledge Distillation for Novel Class Discovery

Debiased Novel Category Discovering and Localization

Generalized Categories Discovery for Long-tailed Recognition

Open-world Semi-supervised Novel Class Discovery

Novel Class Discovery in Chest X-rays Via Paired Images and Text

Dual-level Adaptive Self-Labeling for Novel Class Discovery in Point Cloud Segmentation

Continual Novel Class Discovery via Feature Enhancement and Adaptation

A Practical Approach to Novel Class Discovery in Tabular Data

Novel Class Discovery for Ultra-Fine-Grained Visual Categorization

Learning Prototype Classifiers for Long-Tailed Recognition

Long-Tailed Anomaly Detection with Learnable Class Names

AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

Discover Novel Unknown Signal Classes in Open Scenarios With Multi-Representation Discriminant Network

Prototype-based Classifier Learning for Long-Tailed Visual Recognition

SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail

Decoupling Representation and Classifier for Long-Tailed Recognition

Semantic-Guided Novel Category Discovery

Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discovery

Self-Cooperation Knowledge Distillation for Novel Class Discovery