Abstract:Deep neural networks have recently achieved promising performance in the vein recognition task and have shown an increasing application trend, however, they are prone to adversarial perturbation attacks by adding imperceptible perturbations to the input, resulting in making incorrect recognition. To address this issue, we propose a novel defense model named MsMemoryGAN, which aims to filter the perturbations from adversarial samples before recognition. First, we design a multi-scale autoencoder to achieve high-quality reconstruction and two memory modules to learn the detailed patterns of normal samples at different scales. Second, we investigate a learnable metric in the memory module to retrieve the most relevant memory items to reconstruct the input image. Finally, the perceptional loss is combined with the pixel loss to further enhance the quality of the reconstructed image. During the training phase, the MsMemoryGAN learns to reconstruct the input by merely using fewer prototypical elements of the normal patterns recorded in the memory. At the testing stage, given an adversarial sample, the MsMemoryGAN retrieves its most relevant normal patterns in memory for the reconstruction. Perturbations in the adversarial sample are usually not reconstructed well, resulting in purifying the input from adversarial perturbations. We have conducted extensive experiments on two public vein datasets under different adversarial attack methods to evaluate the performance of the proposed approach. The experimental results show that our approach removes a wide variety of adversarial perturbations, allowing vein classifiers to achieve the highest recognition accuracy.

Multi-View Generative Adversarial Network and Its Application in Pearl Classification

Automatic Pearl Classification Machine Based on a Multistream Convolutional Neural Network.

Multi-View Analysis Dictionary Learning for Image Classification.

MASG-GAN: A multi-view attention superpixel-guided generative adversarial network for efficient and simultaneous histopathology image segmentation and classification

Multi-View Graph Embedding Learning for Image Co-Segmentation and Co-Localization

Automatic Shape Grading of Pearl Using Machine Vision Based Measurement

Multi-class GAN for generating multi-class images in object recognition

Multi-class Generative Adversarial Nets for Semi-supervised Image Classification

Generative Essential Graph Convolutional Network for Multi-View Semi-Supervised Classification

PDC: Pearl Detection with a Counter Based on Deep Learning

Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network

Multi-directional guidance network for fine-grained visual classification

A Co-Attention Method Based on Generative Adversarial Networks for Multi-view Images

A Novel Generative Adversarial Network for Underwater Image Enhancement

MsMemoryGAN: A Multi-scale Memory GAN for Palm-vein Adversarial Purification

Multi-Domain Rapid Enhancement Networks for Underwater Images

Image Processing Using Multi-Code GAN Prior

Triple Generative Adversarial Networks.

Product Title Refinement via Multi-Modal Generative Adversarial Learning

GenView: Enhancing View Quality with Pretrained Generative Model for Self-Supervised Learning

Towards Robust GAN-generated Image Detection: a Multi-view Completion Representation