Adaptive Frequency Learning in Two-branch Face Forgery Detection

Neng Wang,Yang Bai,Kun Yu,Yong Jiang,Shu-tao Xia,Yan Wang
DOI: https://doi.org/10.48550/arxiv.2203.14315
2022-01-01
Abstract: Face forgery has attracted increasing attention in recent applications of computer vision. Existing detection techniques using the two-branch framework benefit a lot from a frequency perspective, yet are restricted by their fixed frequency decomposition and transform. In this paper, we propose to Adaptively learn Frequency information in the two-branch Detection framework, dubbed AFD. To be specific, we automatically learn decomposition in the frequency domain by introducing heterogeneity constraints, and propose an attention-based module to adaptively incorporate frequency features into spatial clues. Then we liberate our network from the fixed frequency transforms, and achieve better performance with our data- and task-dependent transform layers. Extensive experiments show that AFD generally outperforms.
What problem does this paper attempt to address?