A Prototype-Based Neural Network for Image Anomaly Detection and Localization

Chao Huang,Zhao Kang,Hong Wu
DOI: https://doi.org/10.1007/s11063-024-11466-7
IF: 2.565
2024-05-10
Neural Processing Letters
Abstract:Image anomaly detection and localization perform not only image-level anomaly classification but also locate pixel-level anomaly regions. Recently, it has received much research attention due to its wide application in various fields. This paper proposes ProtoAD, a prototype-based neural network for image anomaly detection and localization. First, the patch features of normal images are extracted by a deep network pre-trained on nature images. Then, the prototypes of the normal patch features are learned by non-parametric clustering. Finally, we construct an image anomaly localization network (ProtoAD) by appending the feature extraction network with L 2 feature normalization, a convolutional layer, a channel max-pooling, and a subtraction operation. We use the prototypes as the kernels of the convolutional layer; therefore, our neural network does not need a training phase and can conduct anomaly detection and localization in an end-to-end manner. Extensive experiments on two challenging industrial anomaly detection datasets, MVTec AD and BTAD, demonstrate that ProtoAD achieves competitive performance compared to the state-of-the-art methods with a higher inference speed. The code and pre-trained models are publicly available at https://github.com/98chao/ProtoAD.
computer science, artificial intelligence
What problem does this paper attempt to address?