Abstract:Face recognition pipelines have been widely deployed in various mission-critical systems in trust, equitable and responsible AI applications. However, the emergence of adversarial attacks has threatened the security of the entire recognition pipeline. Despite the sheer number of attack methods proposed for crafting adversarial examples in both digital and physical forms, it is never an easy task to assess the real threat level of different attacks and obtain useful insight into the key risks confronted by face recognition systems. Traditional attacks view imperceptibility as the most important measurement to keep perturbations stealthy, while we suspect that industry professionals may possess a different opinion. In this paper, we delve into measuring the threat brought about by adversarial attacks from the perspectives of the industry and the applications of face recognition. In contrast to widely studied sophisticated attacks in the field, we propose an effective yet easy-to-launch physical adversarial attack, named AdvColor, against black-box face recognition pipelines in the physical world. AdvColor fools models in the recognition pipeline via directly supplying printed photos of human faces to the system under adversarial illuminations. Experimental results show that physical AdvColor examples can achieve a fooling rate of more than 96% against the anti-spoofing model and an overall attack success rate of 88% against the face recognition pipeline. We also conduct a survey on the threats of prevailing adversarial attacks, including AdvColor, to understand the gap between the machine-measured and human-assessed threat levels of different forms of adversarial attacks. The survey results surprisingly indicate that, compared to deliberately launched imperceptible attacks, perceptible but accessible attacks pose more lethal threats to real-world commercial systems of face recognition.

Adversarial Attacks for Optical Flow-Based Action Recognition Classifiers

Adversarial Computer Vision Via Acoustic Manipulation of Camera Sensors

Understanding the Robustness of Skeleton-based Action Recognition under Adversarial Attack

A Review of Adversarial Attacks in Computer Vision

Attack on Scene Flow using Point Clouds

Imperceptible Adversarial Attack with Multigranular Spatiotemporal Attention for Video Action Recognition

State-of-the-art optical-based physical adversarial attacks for deep learning computer vision systems

Imperceptible Adversarial Attack with Multi-granular Spatio-temporal Attention for Video Action Recognition

DualFlow: Generating imperceptible adversarial examples by flow field and normalize flow-based model

Temporal-Distributed Backdoor Attack Against Video Based Action Recognition

Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systems

Perception Improvement for Free: Exploring Imperceptible Black-box Adversarial Attacks on Image Classification

Adversarial Attacks Against Face Recognition: A Comprehensive Study

Adversarial Attacks on Convolutional Neural Networks in Facial Recognition Domain

Adversarial Attacks in Computer Vision: a Survey

Adversarial Imaging Pipelines

Deep adversarial attack on target detection systems

Adversarial Examples Detection Beyond Image Space.

Adversarial Color Film: Effective Physical-World Attack to DNNs