Image Tampering Detection with Frequency-Aware Attention and Multi-View Fusion

Xu,Junxin Chen,Wenrui Lv,Wei Wang,Yushu Zhang

DOI: https://doi.org/10.1109/tai.2024.3486671

2024-01-01

IEEE Transactions on Artificial Intelligence

Abstract:Manipulated images are flooding our daily lives, which poses a threat to social security. Recently, many studies have focused on image tampering detection. However, they have poor performance on independent validation due to differences in image scenes and tampering methods. The key question is how to design a network that is able to adaptively enhance the tampering information and suppress the generalization features during training. To this end, we propose a dual-branch network with a frequency adaptation paradigm and a feature fusion module for robust tampering image detection. First, this paradigm is designed to adaptively highlight tampering features through frequency conversion and learnable weight. Second, a feature fusion module is developed to filter redundant features and dynamically fuse two-branch features. Experiments on eight typical datasets demonstrate that our model has advantages over state-of-the-art algorithms, and our paradigm can well empower semantic segmentation networks for tampering detection.