Abstract:In the meta-universe scenario, with the development of personalized social networks, interactive behaviors such as uploading and sharing personal and family photographs are becoming increasingly widespread. Consequently, the risk of being searched or leaking personal financial information increases. A possible solution is to use anonymized face images instead of real images in the public situations. Most of the existing face anonymization methods attempt to replace a large portion of the face image to modify identity information. However, the resulted faces are often not similar enough to the original faces as seen with the naked eyes. To maintain visual coherence as much as possible while avoiding recognition by face recognition systems, we propose to detect part of the face that is most relevant to the identity based on saliency analysis. Furthermore, we preserve the identification of irrelevant face features by re-injecting them into the regenerated face. The proposed model consists of three stages. Firstly, we employ a dynamic identity perception network to detect the identity-relevant facial region and generate a masked face with removed identity. Secondly, we apply feature selection and preservation network that extracts basic semantic attributes from the original face and also extracts multilevel identity-irrelevant face features from the masked face, and then fuses them into conditional feature vectors for face regeneration. Finally, a pre-trained StyleGAN2 generator is applied to obtain a high-quality identity-obscured face image. The experimental results show that the proposed method can obtain more realistic anonymized face images that retain most of the original facial attributes, while it can deceive face recognition system to protect privacy in the modern digital economy and entertainment scenarios.

Effective De-identification Generative Adversarial Network for Face Anonymization

A3GAN: Attribute-Aware Anonymization Networks for Face De-identification

Semantic-aware Deidentification Generative Adversarial Networks for Identity Anonymization

Unnoticeable Synthetic Face Replacement for Image Privacy Protection.

DeepPrivacy: A Generative Adversarial Network for Face Anonymization

A Hybrid Model for Natural Face De-Identiation with Adjustable Privacy

G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors

Privacy-Protective-GAN for Privacy Preserving Face De-Identification

Generating De-identification facial images based on the attention models and adversarial examples

Privacy preservation through facial de-identification with simultaneous emotion preservation

Face De-identification: State-of-the-art Methods and Comparative Studies

k-Same-Siamese-GAN: k-Same Algorithm with Generative Adversarial Network for Facial Image De-identification with Hyperparameter Tuning and Mixed Precision Training

High similarity controllable face anonymization based on dynamic identity perception

Privacy preservation for image data: A GAN‐based method

FICGAN: Facial Identity Controllable GAN for De-identification

De-identification without losing faces

Private‐encoder: Enforcing Privacy in Latent Space for Human Face Images

EPD-Net: A GAN-based Architecture for Face De-identification from Images

CFA-Net: Controllable Face Anonymization Network with Identity Representation Manipulation

Anonymization of Face Images with Contrastive Learning