Abstract:In recent years, the widespread dissemination of tampered text images on the Internet constitutes an important threat to the security of text images.However, the corresponding tampered text detection (TTD) methods have not been sufficiently explored.The TTD task aims to locate all text regions in an image while judging whether the text regions have been tampered with according to the authenticity of the texture.Thus, different from the general text detection task, TTD task further needs to perceive the fine-grained information for real-world and tampered text classification.TTD task has two main challenges.One the one hand, due to the high similarity in texture between real-world texts and tampered texts, TTD methods that only learn from RGB domain features have limited capability to distinguish these two-category texts well.On the other hand, as the different detecting difficulty exists in real-world texts and tampered texts, the network cannot well balance the learning process of the two-category texts, resulting in the imbalance detection performance between real-world and tampered texts.Compared with RGB domain features, the discontinuity of text texture in frequency domain can help the network to identify the authenticity of text instances.Accordingly, a new TTD method based on RGB and frequency information relationship modeling was proposed.The features in the RGB and frequency domains were extracted by independent feature extractors respectively.Thus, the identification ability of tampered texture can be enhanced by introducing frequency information during the texture perception.Then, a global RGB-frequency relationship module (GRM) was introduced to model the texture authenticity relationship between different text instances.GRM referred to the RGB-frequency features of other text instances in the same image to assist in judging the authenticity of the current text instance, which solved the problem of imbalanced detection performance.Furthermore, a new TTD dataset (Tampered-SROIE) was proposed to evaluate the effectiveness of proposed method, which contains 986 images (626 training images and 360 test images).By evaluating on the Tampered-SROIE, the proposed method obtains 95.97% and 96.80% in F-measure for real-world and tampered texts respectively and reduces the imbalanced detection accuracy by 1.13%.The proposed method will give new insights to the TTD community from the perspective of network structure and detection strategy.Tampered-SROIE also provides an evaluation benchmark for future TTD methods.

EMF-Net: An edge-guided multi-feature fusion network for text manipulation detection

Detecting Image Tampering Using Feature Fusion

Image Tampering Detection Method Based on Multi-Feature Fusion

Image Manipulation Detection by Multiple Tampering Traces and Edge Artifact Enhancement

DMFF-Net: Double-stream multilevel feature fusion network for image forgery localization

Image Manipulation Localization Using Multi-Scale Feature Fusion and Adaptive Edge Supervision

HDF-Net: Capturing Homogeny Difference Features to Localize the Tampered Image

AEGLR-Net: Attention Enhanced Global-Local Refined Network for Accurate Detection of Car Body Surface Defects

Toward real text manipulation detection: New dataset and new solution

A Dual-channel Augmented Attentive Dense-convolutional Network for power image splicing tamper detection

Effective Image Tampering Localization with Multi-Scale ConvNeXt Feature Fusion

EMRA-Net: A Pixel-Wise Network Fusing Local and Global Features for Tiny and Low-Contrast Surface Defect Detection

FETNet: Feature Erasing and Transferring Network for Scene Text Removal

Double-branch forgery image detection based on multi-scale feature fusion

Developing an Image Manipulation Detection Algorithm Based on Edge Detection and Faster R-CNN

ET: Edge-Enhanced Transformer for Image Splicing Detection

Research on video face forgery detection model based on multiple feature fusion network

STFE-Net: A multi-stage approach to enhance statistical texture feature for defect detection on metal surfaces

High Frequency Component Enhancement Network for Image Manipulation Detection

Tampered Text Detection Via RGB and Frequency Relationship Modeling