Manipulation-Invariant Fingerprints for Cross-Dataset Deepfake Detection.

Zuoyan Li,Wenyuan Yang,Ruixin Liu,Yuesheng Zhu

DOI: https://doi.org/10.1007/978-3-030-92273-3_15

2021-01-01

Abstract:Most of the current deepfake detection methods make efforts to learn the classifiers on the manipulated face dataset forged by a single manipulation method. However, these classifiers lack the generalization capacity to other kinds of manipulated face images, limiting their applications in real-world scenarios. In this paper, we find common detectable fingerprints for face images manipulated by different forgery methods through mapping images into a fingerprint space. Such fingerprints are called manipulation-invariant fingerprints, which would allow a classifier to generalize to face datasets forged by other methods. Therefore, a mask drop regularized unsupervised domain adaptation (MDRUDA) method is proposed for cross-dataset deepfake detection through building up the manipulation-invariant fingerprints. Specifically, a feature generator and a discriminator are trained adversarially to align the fingerprint distributions from face images forged by different methods, building up the manipulation-fingerprints that could train a more generalized classifier. We impose a mask drop regularization on the discriminator and the classifier to enrich the fingerprint space and further boost generalization ability. Experiments on public deepfake datasets show that our approach can gain significantly better generalization capability in cross-datasets scenarios, compared with prior works.