Abstract:In this paper, we focus on protecting the facial privacy for people under the surveillance scenarios, by changing some visual appearances of the faces while keeping them recognizable by the current face recognition systems. This is a challenging problem because we need to retain the most important structures of the captured facial images, while modify the salient facial regions to protect personal privacy. To address this problem, we introduce a novel individual face protection model, which can camouflage the face appearance from the perspective of human visual perception and preserve the identity features of faces used for face authentication. To that end, we develop an encoder-decoder network architecture which can separately disentangle the facial feature representation into an appearance code and an identification code. Specifically, we first randomly divide the input face image into two groups, the source and target sets, where the identity and appearance codes can be correspondingly extracted. Then, we recombine the identity and appearance codes to synthesize a new face, which has the same identity as the source subject. Finally, the synthesized faces are employed to replace the original face to protect the individual privacy. Note that our model is end-to-end with a multi-task loss function, which can better preserve the identity and stabilize the training process. Experiments conducted on Cross-Age Celebrity dataset demonstrate the effectiveness of our model and validate our superiority in terms of visual quality and scalability.

Face De-Morphing Based on Diffusion Autoencoders

Feature Interaction-Based Face De-Morphing Factor Prediction for Restoring Accomplice's Facial Image

Facial Demorphing via Identity Preserving Image Decomposition

Facial De-morphing: Extracting Component Faces from a Single Morph

SDeMorph: Towards Better Facial De-morphing from Single Morph

Leveraging Diffusion For Strong and High Quality Face Morphing Attacks

DFS-Net: StyleGAN2-based dual feature separation for face De-Morphing

LDFaceNet: Latent Diffusion-based Network for High-Fidelity Deepfake Generation

Identity-Consistent Video De-identification Via Diffusion Autoencoders

LADIMO: Face Morph Generation through Biometric Template Inversion with Latent Diffusion

Differential Morphed Face Detection Using Deep Siamese Networks

Unveiling the Two-Faced Truth: Disentangling Morphed Identities for Face Morphing Detection

Adv-Diffusion: Imperceptible Adversarial Face Identity Attack via Latent Diffusion Model

A Systematical Solution for Face De-identification

TetraLoss: Improving the Robustness of Face Recognition against Morphing Attacks

Reinforced Disentanglement for Face Swapping Without Skip Connection

Hierarchical Generative Network for Face Morphing Attacks

A Light Autoencoder Networks for Face Swapping.

Learning Disentangled Representations for Identity Preserving Surveillance Face Camouflage

Secure Dual Network for Reversible Facial Image Anonymization Through the Latent Space Manipulation

Information Adversarial Disentanglement for Face Swapping.