Abstract:Face recognition pipelines have been widely deployed in various mission-critical systems in trust, equitable and responsible AI applications. However, the emergence of adversarial attacks has threatened the security of the entire recognition pipeline. Despite the sheer number of attack methods proposed for crafting adversarial examples in both digital and physical forms, it is never an easy task to assess the real threat level of different attacks and obtain useful insight into the key risks confronted by face recognition systems. Traditional attacks view imperceptibility as the most important measurement to keep perturbations stealthy, while we suspect that industry professionals may possess a different opinion. In this paper, we delve into measuring the threat brought about by adversarial attacks from the perspectives of the industry and the applications of face recognition. In contrast to widely studied sophisticated attacks in the field, we propose an effective yet easy-to-launch physical adversarial attack, named AdvColor, against black-box face recognition pipelines in the physical world. AdvColor fools models in the recognition pipeline via directly supplying printed photos of human faces to the system under adversarial illuminations. Experimental results show that physical AdvColor examples can achieve a fooling rate of more than 96% against the anti-spoofing model and an overall attack success rate of 88% against the face recognition pipeline. We also conduct a survey on the threats of prevailing adversarial attacks, including AdvColor, to understand the gap between the machine-measured and human-assessed threat levels of different forms of adversarial attacks. The survey results surprisingly indicate that, compared to deliberately launched imperceptible attacks, perceptible but accessible attacks pose more lethal threats to real-world commercial systems of face recognition.

LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognition

Low-Mid Adversarial Perturbation against Unauthorized Face Recognition System

Adversarial Attacks Against Face Recognition: A Comprehensive Study

Toward Face Biometric De-identification using Adversarial Examples

On adversarial patches: real-world attack on ArcFace-100 face recognition system

Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systems

Fawkes: Protecting Privacy against Unauthorized Deep Learning Models

Adversarial Attacks on Face Recognition Systems

Transferable Adversarial Facial Images for Privacy Protection

ReFace: Real-time Adversarial Attacks on Face Recognition Systems

Adversarial Robust Safeguard for Evading Deep Facial Manipulation

Adversarial Threats to DeepFake Detection: A Practical Perspective

ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification

Hiding Faces in Plain Sight: Disrupting AI Face Synthesis with Adversarial Perturbations

Exploiting vulnerabilities of deep neural networks for privacy protection

Imperceptible Physical Attack against Face Recognition Systems via LED Illumination Modulation

Adv-Makeup: A New Imperceptible and Transferable Attack on Face Recognition

Rethinking the Vulnerabilities of Face Recognition Systems:From a Practical Perspective

Leveraging Universal Adversarial Perturbation and Frequency Band Filters Against Face Recognition

DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protection