Multi-domain Probability Estimation Network for Forgery Detection over Online Social Network Shared Images

Jiaxin Chen,Xin Liao,Zhenxing Qian,Zheng Qin
DOI: https://doi.org/10.1109/icme57554.2024.10687645
2024-01-01
Abstract:Fake images spread on online social networks can lead to public misconceptions, causing potential harm to politics, economics and social culture. Researching the authenticity of digital images is of great significance. Almost all online social networks perform multiple lossy operations on uploaded images, which will change the forgery traces and degrade the forgery detection performance of existing forensic methods. Therefore, forgery detection for images transmitted on online social networks has become a severe challenge. To solve this problem, we propose a multi-domain probability estimation network (PRest-Net). Specifically, considering that the wavelet coefficient of useful information is larger than that of lossy noise, and the image residual processing can highlight the edge texture, we design a multi-domain probability estimation method based on feature coupling and selective search to mine forgery traces in the spatial, residual, and wavelet domains. As a result, the lossy noise introduced by transmission on online social networks can be suppressed and the most differentiated regional information can be captured. Furthermore, a forgery detector based on low-level and high-level feature learning is proposed to adaptively capture rich operation clues and local edge differences between tampered and real areas, achieving fine-grained tampered region prediction. Extensive experiments show that the proposed PRest-Net outperforms existing state-of-the-art forgery detectors and is robust to online social network transmission.
What problem does this paper attempt to address?