Abstract:Deep learning has unequivocally emerged as the backbone of simple to highly sensitive systems demanding artificial intelligence across diverse domains. For instance, foundation models based on deep neural networks (DNNs) can play a crucial role in the design of security-sensitive systems, such as facial recognition systems (FRS). Despite achieving exceptional accuracy and human-like performance, DNNs tend to be severely sensitive to adversarial attacks. While DNNs are deemed irreplaceable in the artificial intelligence domain, the vulnerability of DNNs against adversarial examples can be detrimental to sensitive systems robustness. The paper presents a pilot study introducing an attack-defense framework aimed at enhancing the robustness of FRS against evasion attacks. Our generative adversarial network (GAN) based attack successfully deceives FRS, demonstrating that they are not only vulnerable against synthetic images visibly comparable to real user images (i.e., best-match scenarios) but also to partially constructed user images (i.e., average-match scenarios). Based on our analysis, we propose a novel solution that extends the visual prompt engineering (VPE) concept for detecting synthetic images to secure downstream tasks in FRS. The VPE detection module achieves an accuracy of 97.92% in the average-match scenario and 87.08% in the best-match scenario on our generated dataset. Furthermore, we use the Trueface postsocial dataset to validate the efficacy of the detection module obtaining an accuracy of 91.96%. Our experimental evaluation shows that VPE can effectively tackle the GAN attacks from average-match to best-match scenarios, thus enhancing the overall robustness of a security-sensitive system against evasion attacks.

Minimum Assumption Reconstruction Attacks: Rise of Security and Privacy Threats Against Face Recognition.

The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networks

Adversarial Attacks Against Face Recognition: A Comprehensive Study

Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfer

Rethinking the Vulnerabilities of Face Recognition Systems:From a Practical Perspective

Inference Attacks Against Face Recognition Model without Classification Layers

Efficient and High-Quality Black-Box Face Reconstruction Attack.

Discrete Point-wise Attack is Not Enough: Generalized Manifold Adversarial Attack for Face Recognition

3D-Aware Adversarial Makeup Generation for Facial Privacy Protection

Attribute-Guided Encryption with Facial Texture Masking

Face Reconstruction Transfer Attack as Out-of-Distribution Generalization

Adversarial Attacks on Face Recognition Systems

Comprehensive Vulnerability Evaluation of Face Recognition Systems to Template Inversion Attacks Via 3D Face Reconstruction

Visual Prompt Engineering for Enhancing Facial Recognition Systems Robustness Against Evasion Attacks

Transferable Adversarial Facial Images for Privacy Protection

Adversarial Patch Attacks on Deep-Learning-Based Face Recognition Systems Using Generative Adversarial Networks

Resurrecting Trust in Facial Recognition: Mitigating Backdoor Attacks in Face Recognition to Prevent Potential Privacy Breaches

Fuzzy Commitments Offer Insufficient Protection to Biometric Templates Produced by Deep Learning

Attacks on State-of-the-Art Face Recognition using Attentional Adversarial Attack Generative Network