Abstract:One of the most challenges for anomaly detection (AD) is how to learn one unified and generalizable model to adapt to multi-class especially cross-class settings: the model is trained with normal samples from seen classes with the objective to detect anomalies from both seen and unseen classes. In this work, we propose a novel Proposal Masked Anomaly Detection (PMAD) approach for such challenging multi- and cross-class anomaly detection. The proposed PMAD can be adapted to seen and unseen classes by two key designs: MAE-based patch-level reconstruction and prototype-guided proposal masking. First, motivated by MAE (Masked AutoEncoder), we develop a patch-level reconstruction model rather than the image-level reconstruction adopted in most AD methods for this reason: the masked patches in unseen classes can be reconstructed well by using the visible patches and the adaptive reconstruction capability of MAE. Moreover, we improve MAE by ViT encoder-decoder architecture, combinational masking, and visual tokens as reconstruction objectives to make it more suitable for anomaly detection. Second, we develop a two-stage anomaly detection manner during inference. In the proposal masking stage, the prototype-guided proposal masking module is utilized to generate proposals for suspicious anomalies as much as possible, then masked patches can be generated from the proposal regions. By masking most likely anomalous patches, the “shortcut reconstruction” issue (i.e., anomalous regions can be well reconstructed) can be mostly avoided. In the reconstruction stage, these masked patches are then reconstructed by the trained patch-level reconstruction model to determine if they are anomalies. Extensive experiments show that the proposed PMAD can outperform current state-of-the-art models significantly under the multi- and especially cross-class settings. Code will be publicly available at https://github.com/xcyao00/PMAD.

Toward Multi-class Anomaly Detection: Exploring Class-aware Unified Model against Inter-class Interference

A Unified Model for Multi-class Anomaly Detection

MoEAD: A Parameter-efficient Model for Multi-class Anomaly Detection

Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection

A Diffusion-Based Framework for Multi-Class Anomaly Detection

Revitalizing Reconstruction Models for Multi-class Anomaly Detection via Class-Aware Contrastive Learning

AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

MSTAD: A masked subspace-like transformer for multi-class anomaly detection

DMAD: Dual Memory Bank for Real-World Anomaly Detection

Dinomaly: The Less Is More Philosophy in Multi-Class Unsupervised Anomaly Detection

Absolute-Unified Multi-Class Anomaly Detection via Class-Agnostic Distribution Alignment

Enhancing Multi-Class Anomaly Detection via Diffusion Refinement with Dual Conditioning

Hierarchical Vector Quantized Transformer for Multi-class Unsupervised Anomaly Detection

Pull & Push: Leveraging Differential Knowledge Distillation for Efficient Unsupervised Anomaly Detection and Localization

One-for-All: Proposal Masked Cross-Class Anomaly Detection

Hierarchical Gaussian Mixture Normalizing Flow Modeling for Unified Anomaly Detection

Learning Unified Reference Representation for Unsupervised Multi-class Anomaly Detection

MLAD: A Unified Model for Multi-system Log Anomaly Detection

Structural Teacher-Student Normality Learning for Multi-Class Anomaly Detection and Localization

DTAAD: Dual Tcn-Attention Networks for Anomaly Detection in Multivariate Time Series Data

Robust Anomaly Detection from Partially Observed Anomalies with Augmented Classes