Abstract:The rapid advancement of photorealistic generators has reached a critical juncture where the discrepancy between authentic and manipulated images is increasingly indistinguishable. Thus, benchmarking and advancing techniques detecting digital manipulation become an urgent issue. Although there have been a number of publicly available face forgery datasets, the forgery faces are mostly generated using GAN-based synthesis technology, which does not involve the most recent technologies like diffusion. The diversity and quality of images generated by diffusion models have been significantly improved and thus a much more challenging face forgery dataset shall be used to evaluate SOTA forgery detection literature. In this paper, we propose a large-scale, diverse, and fine-grained high-fidelity dataset, namely GenFace, to facilitate the advancement of deepfake detection, which contains a large number of forgery faces generated by advanced generators such as the diffusion-based model and more detailed labels about the manipulation approaches and adopted generators. In addition to evaluating SOTA approaches on our benchmark, we design an innovative Cross Appearance-Edge Learning (CAEL) detector to capture multi-grained appearance and edge global representations, and detect discriminative and general forgery traces. Moreover, we devise an Appearance-Edge Cross-Attention (AECA) module to explore the various integrations across two domains. Extensive experiment results and visualizations show that our detection model outperforms the state of the arts on different settings like cross-generator, cross-forgery, and cross-dataset evaluations. Code and datasets will be available at https://github.com/Jenine-321/GenFace.

Facke: a Survey on Generative Models for Face Swapping

FaceSwapNet: Landmark Guided Many-to-Many Face Reenactment

Region-Aware Face Swapping

Multimodal-driven Talking Face Generation, Face Swapping, Diffusion Model

Realistic Face Reenactment Via Self-Supervised Disentangling of Identity and Pose

FSGAN: Subject Agnostic Face Swapping and Reenactment

Deep Face-Swap Model Combining Attention Mechanism and CycleGAN

FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment

Identity-Preserving Face Swapping via Dual Surrogate Generative Models

Face Transformer: Towards High Fidelity and Accurate Face Swapping

GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning

Fine-Grained Face Swapping via Regional GAN Inversion

Face manipulated deepfake generation and recognition approaches: a survey

FSNet: An Identity-Aware Generative Model for Image-based Face Swapping

Deepfake Generation and Detection: A Benchmark and Survey

High-resolution Face Swapping via Latent Semantics Disentanglement

FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping

E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversion

High-Fidelity Face Swapping with Style Blending

Face Swap via Diffusion Model