Abstract:A novel algorithm for face obfuscation, called Forbes, which aims to obfuscate facial appearance recognizable by humans but preserve the identity and attributes decipherable by machines, is proposed in this paper. Forbes first applies multiple obfuscating transformations with random parameters to an image to remove the identity information distinguishable by humans. Then, it optimizes the parameters to make the transformed image decipherable by machines based on the backpropagation refinement scheme. Finally, it renders an obfuscated image by applying the transformations with the optimized parameters. Experimental results on various datasets demonstrate that Forbes achieves both human indecipherability and machine decipherability excellently. The source codes are available at <a class="link-external link-https" href="https://github.com/mcljtkim/Forbes" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: on the premise of protecting privacy, how to perform face obfuscation on face images so that the processed face images are unidentifiable in terms of identity and attributes for human observers, but the identity and attribute information can still be parsed by machine - learning models. Specifically, the paper proposes a new algorithm, Forbes, aiming to achieve the following two goals: 1. **Human Indecipherability (HI)**: Ensure that the obfuscated face images are unidentifiable in terms of identity and attributes for human observers. 2. **Machine Decipherability (MD)**: Ensure that the obfuscated face images still retain sufficient information so that deep - learning models can correctly parse the identity and attributes. To achieve these two goals, the Forbes algorithm proceeds through the following steps: 1. **Multi - parameter transformation**: First, apply multiple obfuscation transformations with random parameters to the input image to remove human - recognizable identity information. 2. **Parameter optimization**: Then optimize the parameters of these transformations based on the Backpropagation Refinement Scheme (BRS) so that the transformed image can be parsed by machines. 3. **Generate obfuscated image**: Finally, re - apply the transformations using the optimized parameters to generate the final obfuscated image. Experimental results show that the Forbes algorithm can well achieve both HI and MD on various datasets. ### Key Formulas - **Definition of energy functions**: - For the energy function \(E_U\) of uniform parameters: \[ E_U=\sum_{\theta_i\in\Theta_i\subset\Theta_U}\max\{\lambda_i - |\theta_i|, 0\} \] - For the energy function \(E_C\) of color parameters: \[ E_C=\sum_{\theta_i\in\Theta_i\subset\Theta_C}\max\left([\theta_i > 1](\lambda_i-\theta_i),[\theta_i < 1](\theta_i-\frac{1}{\lambda_i})\right) \] - For the energy function \(E_D\) of distance: \[ E_D = \|F(I_{out}(\Theta)) - F(I_{in})\|_2 \] - For the energy function \(E_S\) of cosine similarity: \[ E_S = 1-\frac{F(I_{out}(\Theta))^T F(I_{in})}{\|F(I_{out}(\Theta))\|\|F(I_{in})\|} \] - **Total energy function**: \[ E = E_U+E_C+E_D+E_S \] By minimizing this total energy function, the Forbes algorithm can maximize human indecipherability while maintaining machine decipherability.

Forbes: Face Obfuscation Rendering via Backpropagation Refinement Scheme

Transferable Facial Privacy Protection Against Blind Face Restoration Via Domain-Consistent Adversarial Obfuscation

A Study of Face Obfuscation in ImageNet

Defeating Image Obfuscation with Deep Learning

PRO-Face C: Privacy-Preserving Recognition of Obfuscated Face via Feature Compensation

Fairness Properties of Face Recognition and Obfuscation Systems

Obfuscation of images via differential privacy: From facial images to general images

Attribute-preserving Face Dataset Anonymization via Latent Code Optimization

DeepObfuscator - Obfuscating Intermediate Representations with Privacy-Preserving Adversarial Learning on Smartphones.

InfoScrub: Towards Attribute Privacy by Targeted Obfuscation

Training with the Invisibles: Obfuscating Images to Share Safely for Learning Visual Recognition Models

Face Anonymization Made Simple

Face De-Morphing Based on Diffusion Autoencoders

Evading Forensic Classifiers with Attribute-Conditioned Adversarial Faces

Face De-Identification Using Face Caricature

DeepObfuscator: Obfuscating Intermediate Representations with Privacy-Preserving Adversarial Learning on Smartphones

High Resolution Face Privacy-Enhancing Method Based on Latent Optimization with Identity-Preserving Facial Masking

Transferable Adversarial Facial Images for Privacy Protection

G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors