Abstract:Deep learning-based face recognition (FR) systems pose significant privacy risks by tracking users without their consent. While adversarial attacks can protect privacy, they often produce visible artifacts compromising user experience. To mitigate this issue, recent facial privacy protection approaches advocate embedding adversarial noise into the natural looking makeup styles. However, these methods require training on large-scale makeup datasets that are not always readily available. In addition, these approaches also suffer from dataset bias. For instance, training on makeup data that predominantly contains female faces could compromise protection efficacy for male faces. To handle these issues, we propose a test-time optimization approach that solely optimizes an untrained neural network to transfer makeup style from a reference to a source image in an adversarial manner. We introduce two key modules: a correspondence module that aligns regions between reference and source images in latent space, and a decoder with conditional makeup layers. The untrained decoder, optimized via carefully designed structural and makeup consistency losses, generates a protected image that resembles the source but incorporates adversarial makeup to deceive FR models. As our approach does not rely on training with makeup face datasets, it avoids potential male/female dataset biases while providing effective protection. We further extend the proposed approach to videos by leveraging on temporal correlations. Experiments on benchmark datasets demonstrate superior performance in face verification and identification tasks and effectiveness against commercial FR systems. Our code and models will be available at <a class="link-external link-https" href="https://github.com/fahadshamshad/deep-facial-privacy-prior" rel="external noopener nofollow">this https URL</a>

Makeup-robust face verification

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Makeup Removal for Face Verification Based Upon Contrastive Learning

Towards Mask-robust Face Recognition.

Cosmetic-Aware Makeup Cleanser

Anti-Makeup: Learning A Bi-Level Adversarial Network for Makeup-Invariant Face Verification

A robust feature extraction algorithm based on class-Modular Image Principal Component Analysis for face verification

FM2u-Net: Face Morphological Multi-Branch Network for Makeup-Invariant Face Verification

Robust 3D Face Recognition by Local Shape Difference Boosting

Makeup Prior Models for 3D Facial Makeup Estimation and Applications

Detection of Makeup Presentation Attacks based on Deep Face Representations

Deep Learning Models for Automatic Makeup Detection

BeautyBank: Encoding Facial Makeup in Latent Space

Makeup Extraction of 3D Representation via Illumination-Aware Image Decomposition

Reference-conditional Makeup-aware Discrimination for Face Image Beautification

MakeupDiffuse: a double image-controlled diffusion model for exquisite makeup transfer

High Fidelity Makeup Via 2D and 3D Identity Preservation Net

A Fine Rendering High-Resolution Makeup Transfer network via inversion-editing strategy

Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors

xCos: An Explainable Cosine Metric for Face Verification Task

BeautyREC: Robust, Efficient, and Content-preserving Makeup Transfer