Abstract:Image forgery detection aims to detect and locate forged regions in an image. Most existing forgery detection algorithms formulate classification problems to classify pixels into forged or pristine. However, the definition of forged and pristine pixels is only relative within one single image, e.g., a forged region in image A is actually a pristine one in its source image B (splicing forgery). Such a relative definition has been severely overlooked by existing methods, which unnecessarily mix forged (pristine) regions across different images into the same category. To resolve this dilemma, we propose the FOrensic ContrAstive cLustering (FOCAL) method, a novel, simple yet very effective paradigm based on contrastive learning and unsupervised clustering for the image forgery detection. Specifically, FOCAL 1) utilizes pixel-level contrastive learning to supervise the high-level forensic feature extraction in an image-by-image manner, explicitly reflecting the above relative definition; 2) employs an on-the-fly unsupervised clustering algorithm (instead of a trained one) to cluster the learned features into forged/pristine categories, further suppressing the cross-image influence from training data; and 3) allows to further boost the detection performance via simple feature-level concatenation without the need of retraining. Extensive experimental results over six public testing datasets demonstrate that our proposed FOCAL significantly outperforms the state-of-the-art competing algorithms by big margins: +24.3% on Coverage, +18.6% on Columbia, +17.5% on FF++, +14.2% on MISD, +13.5% on CASIA and +10.3% on NIST in terms of IoU. The paradigm of FOCAL could bring fresh insights and serve as a novel benchmark for the image forgery detection task. The code is available at <a class="link-external link-https" href="https://github.com/HighwayWu/FOCAL" rel="external noopener nofollow">this https URL</a>.

Exploring multi-scale forgery clues for stereo super-resolution image forgery localization

End-to-end Image Splicing Localization Based on Multi-Scale Features and Residual Refinement Module

Learning Accurate and Enriched Features for Stereo Image Super-Resolution

Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localization

Image Forgery Localization via Guided Noise and Multi-Scale Feature Aggregation

Multi-scale Parallax Attention for Stereo Image Super-Resolution

SLRID: A Robust Image Tampering Localization Framework for Extremely Scaled Forgery Images

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Cross-attention based two-branch networks for document image forgery localization in the Metaverse

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

PRNU-based Image Forgery Localization with Deep Multi-scale Fusion

Multi-Level Feature Fusion Network for Lightweight Stereo Image Super-Resolution

A flow-based multi-scale learning network for single image stochastic super-resolution

Cross-MPI: Cross-scale Stereo for Image Super-Resolution using Multiplane Images

Multi-Stage Edge-Guided Stereo Feature Interaction Network for Stereoscopic Image Super-Resolution

Rethinking Image Forgery Detection via Contrastive Learning and Unsupervised Clustering

Hierarchical Fine-Grained Image Forgery Detection and Localization

DIffSteISR: Harnessing Diffusion Prior for Superior Real-world Stereo Image Super-Resolution

Single Image Super-Resolution with Multiscale Similarity Learning.

Multilevel Feature Exploration Network for Image Superresolution

Document images forgery localization using a two‐stream network