Deepfake Detection Via Fine-Grained Classification and Global-Local Information Fusion.

Tonghui Li,Yuanfang Guo,Yunhong Wang
DOI: https://doi.org/10.1007/978-981-99-8537-1_25
2024-01-01
Abstract:In response to the increasing amount of deepfake content on the internet, a large number of deepfake detection methods have been recently developed. To our best knowledge, existing methods simply perform binary classification, i.e., they simply consider the deepfake images generated from different forgery methods as a single category. Unfortunately, different deepfake forgery methods usually generate deepfake images with different artifacts/appearances. Under such circumstance, a simple binary classification mechanism may limit the learning ability of the detection models, i.e., they may ignore certain forgery traces. Therefore, we propose a novel deepfake detection method via fine-grained classification and global-local information fusion. Specifically, we improve the binary classification task with a fine-grained classification mechanism, such that the deepfake detection model can learn more precise features for fake images from different forgery methods. Besides, we construct a global-local information fusion architecture to emphasize the important information in certain local regions and fuse them with global semantic information. In addition, we design a global center loss, which makes the real images features more cohesive and enlarge the distance between real and fake images features, to further enhance the generalization ability of the detection model. Extensive experiments demonstrate the effectiveness and superiority of our method.
What problem does this paper attempt to address?