Abstract:In the meta-universe scenario, with the development of personalized social networks, interactive behaviors such as uploading and sharing personal and family photographs are becoming increasingly widespread. Consequently, the risk of being searched or leaking personal financial information increases. A possible solution is to use anonymized face images instead of real images in the public situations. Most of the existing face anonymization methods attempt to replace a large portion of the face image to modify identity information. However, the resulted faces are often not similar enough to the original faces as seen with the naked eyes. To maintain visual coherence as much as possible while avoiding recognition by face recognition systems, we propose to detect part of the face that is most relevant to the identity based on saliency analysis. Furthermore, we preserve the identification of irrelevant face features by re-injecting them into the regenerated face. The proposed model consists of three stages. Firstly, we employ a dynamic identity perception network to detect the identity-relevant facial region and generate a masked face with removed identity. Secondly, we apply feature selection and preservation network that extracts basic semantic attributes from the original face and also extracts multilevel identity-irrelevant face features from the masked face, and then fuses them into conditional feature vectors for face regeneration. Finally, a pre-trained StyleGAN2 generator is applied to obtain a high-quality identity-obscured face image. The experimental results show that the proposed method can obtain more realistic anonymized face images that retain most of the original facial attributes, while it can deceive face recognition system to protect privacy in the modern digital economy and entertainment scenarios.

High Resolution Face Privacy-Enhancing Method Based on Latent Optimization with Identity-Preserving Facial Masking

Towards Mask-robust Face Recognition.

Privacy-Protected Facial Expression Recognition Augmented by High-Resolution Facial Images.

Identity-Preserving Face Anonymization Via Adaptively Facial Attributes Obfuscation.

PRO-Face C: Privacy-Preserving Recognition of Obfuscated Face via Feature Compensation

FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders

Privacy-Enhancing Face Obfuscation Guided by Semantic-Aware Attribution Maps.

Once-for-all: Efficient Visual Face Privacy Protection Via Person-specific Veils

Private Face Image Generation Method Based on Deidentification in Low Light

Privacy-Preserving Face Recognition Method Based on Randomization and Local Feature Learning

ErasableMask: A Robust and Erasable Privacy Protection Scheme against Black-box Face Recognition Models

High similarity controllable face anonymization based on dynamic identity perception

Privacy preservation for image data: A GAN‐based method

Super-resolving blurry face images with identity preservation

Private‐encoder: Enforcing Privacy in Latent Space for Human Face Images

Seeing is not Believing: An Identity Hider for Human Vision Privacy Protection

Privacy-preserving Adversarial Facial Features

Latent Representation Reorganization for Face Privacy Protection

PRO-Face: A Generic Framework for Privacy-preserving Recognizable Obfuscation of Face Images

Transferable Adversarial Facial Images for Privacy Protection

Invertible mask network for face privacy preservation