Abstract:With the rapid development of image editing techniques, forensic analysis to detect malicious image manipulation has become an important research topic. The current image manipulation detection and localization methods can accommodate diverse forms of tampering. However, their approach to handling various tampering detection types is limited to a uniform regression pathway. This approach fails to recognize the unique characteristics of copy-move tampering, which is significantly different from other tampering types. Employing a generic detection methodology indiscriminately poses the risk of confusing the training regression trajectory of the deep learning models. To mitigate this challenge, this paper introduces a novel framework featuring a dual-decoding branch structure specifically designed to augment features pertinent to copy-move tampering types. Moreover, it facilitates the detection of tampered regions, irrespective of the tampering type, within the main branch. To achieve this goal, we first introduce a contrastive augmentation module in the encoder, which maximizes the feature space distance between the manipulation regions and pristine regions. Next, we design a parallel attention module to extract more diverse multiscale features. Moreover, we introduce a constrained shifted-window dual attention module to extract tampering noise features. In the decoder, we design a dual-decoding branch to capture both the homologous and tampering features, and we employ contrastive learning to minimize the feature space distance of the homologous regions for copy-move manipulation detection. Finally, we design a category normalization loss function to balance the model’s attention across each category. Extensive experiments demonstrate that the proposed approach achieves state-of-the-art performance on various benchmark datasets.

Noise and Edge Based Dual Branch Image Manipulation Detection.

Image Manipulation Detection by Multiple Tampering Traces and Edge Artifact Enhancement

Dual-decoding Branch Contrastive Augmentation for Image Manipulation Localization

Multi-scale Context-Aware and Boundary-Guided Image Manipulation Detection Method

EAN: Edge-Aware Network for Image Manipulation Localization

High Frequency Component Enhancement Network for Image Manipulation Detection

Enhanced Features in Image Manipulation Detection

A Parallel Attention Mechanism for Image Manipulation Detection and Localization

Image Manipulation Detection by Multi-View Multi-Scale Supervision

Developing an Image Manipulation Detection Algorithm Based on Edge Detection and Faster R-CNN

Contrastive Learning Based Multi-task Network for Image Manipulation Detection

Learning Rich Features for Image Manipulation Detection

Progressive Mask Transformer With Edge Enhancement for Image Manipulation Localization

Towards Effective Image Manipulation Detection with Proposal Contrastive Learning

CDS-Net: Cooperative dual-stream network for image manipulation detection

Image Manipulation Localization Using Attentional Cross-Domain CNN Features

Toward Effective Image Manipulation Detection with Proposal Contrastive Learning

Exploring weakly-supervised image manipulation localization with tampering Edge-based class activation map

Learning Hierarchical Graph Representation for Image Manipulation Detection

Multiple Manipulation Detection in Images Using Frequency Domain Features in 3D-CNN

On the Effectiveness of Image Manipulation Detection in the Age of Social Media