Abstract:Person-agnostic face swapping has gained significant attention in recent years, as it offers the potential to enhance various real-world applications by combining high fidelity and identity consistency. However, conventional face swapping methods often rely on intricate adjustments of different loss functions, leading to instability during both the training and inference stages. In this work, we propose a simple yet effective framework named StableSwap with a reversible autoencoder to modify the face in a shared latent space. Our approach capitalizes on the information-rich image latent codes to tackle the challenges of complex editing tasks, utilizing the abundant details present in both the source and target faces. To ensure an expressive and robust latent space, we employ a latent alignment approach with perceptual and adversarial losses to optimize the autoencoder. Additionally, we devise a multi-stage identity injection module that samples multiple features with different facial priors and incorporates them to guide the latent image manipulation. By leveraging attention-based blocks, we fuse these futures and update the latent code in a mask-conditioned manner. Both quantitative and qualitative results on the mainstream benchmarks demonstrate that our StableSwap generates competitive identity-consistent swapped faces compared with state-of-the-art methods. Our method outperforms previous approaches in terms of ID Retrieval (98.68) and FID (2.49), while also exhibiting enhanced stability during model training. Beyond this, our model achieves region-controllable face swapping with the capability to perform more fine-grained operations in latent space.

StableSwap: Stable Face Swapping in a Shared and Controllable Latent Space

FaceSwapNet: Landmark Guided Many-to-Many Face Reenactment

Region-Aware Face Swapping

ReliableSwap: Boosting General Face Swapping Via Reliable Supervision

Designing One Unified Framework for High-Fidelity Face Reenactment and Swapping

SimSwap: An Efficient Framework For High Fidelity Face Swapping

DiffSwap: High-Fidelity and Controllable Face Swapping Via 3D-Aware Masked Diffusion

SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Space

Face Swapping with Adaptive Exploration-Fusion Mechanism and Dual En-Decoing Tactic

Reinforced Disentanglement for Face Swapping Without Skip Connection

ControlFace: Feature Disentangling for Controllable Face Swapping.

Face Swapping Via Reverse Contrastive Learning and Explicit Identity-Attribute Disentanglement

StyleSwap: Style-Based Generator Empowers Robust Face Swapping

High-Fidelity Face Swapping with Style Blending

FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping

StyleIPSB: Identity-Preserving Semantic Basis of StyleGAN for High Fidelity Face Swapping

Identity-Preserving Face Swapping via Dual Surrogate Generative Models

SimSwap++: Towards Faster and High-Quality Identity Swapping

End-to-end Face-swapping via Adaptive Latent Representation Learning

3D-Aware Face Swapping

Learning Disentangled Representation for One-shot Progressive Face Swapping