Abstract:With the continuous advancement of deep learning, research in scene text detection has evolved significantly. However, complex backgrounds and various text forms complicate the task of detecting text from images. CNN is a deep learning algorithm that automatically extracts features through convolution operation. In the task of scene text detection, it can capture local text features in images, but it lacks global attributes. In recent years, inspired by the application of transformers in the field of computer vision, it can capture the global information of images and describe them intuitively. Therefore, this paper proposes scene text detection based on dual perspective CNN-transformer. The channel enhanced self-attention module (CESAM) and spatial enhanced self-attention module (SESAM) proposed in this paper are integrated into the traditional ResNet backbone network. This integration effectively facilitates the learning of global contextual information and positional relationships of text, thereby alleviating the challenge of detecting small target text. Furthermore, this paper introduces a feature decoder designed to refine the effective text information within the feature map and enhance the perception of detailed information. Experiments show that the method proposed in this paper significantly improves the robustness of the model for different types of text detection. Compared to the baseline, it achieves performance improvements of 2.51% (83.81 vs. 81.3) on the Total-Text dataset, 1.87% (86.07 vs. 84.2) on the ICDAR 2015 dataset, and 3.63% (86.72 vs. 83.09) on the MSRA-TD500 dataset, while also demonstrating better visual effects.

A Text-Specific Domain Adaptive Network for Scene Text Detection in the Wild.

A Multi-scale Domain Adaptive Framework for Scene Text Detection

Text Enhancement Network for Cross-Domain Scene Text Detection

Domain Adaptive Multigranularity Proposal Network for Text Detection under Extreme Traffic Scenes.

Domain Adaptive Scene Text Detection via Subcategorization

A Cost-Efficient Framework for Scene Text Detection in the Wild

Self-Training for Domain Adaptive Scene Text Detection

Sequence-To-Sequence Domain Adaptation Network For Robust Text Image Recognition

Two-layer Federated Learning for Scene Text Detection

Text-Attentional Convolutional Neural Network for Scene Text Detection

Text-Attentional Convolutional Neural Networks for Scene Text Detection

AdaDNNs: Adaptive Ensemble of Deep Neural Networks for Scene Text Recognition.

FDTA: Fully Convolutional Scene Text Detection with Text Attention.

Explore Faster Localization Learning For Scene Text Detection

DSRN: A Deep Scale Relationship Network for Scene Text Detection.

RFRN: A Recurrent Feature Refinement Network for Accurate and Efficient Scene Text Detection

A Multi-Scale Natural Scene Text Detection Method Based on Attention Feature Extraction and Cascade Feature Fusion

Domain Adaptive Faster R-CNN for Object Detection in the Wild

Scene Text Detection Based on Dual-branch Multi-resolution Feature-aware Enhancement Network

Scene Text Detection with Text Statistical Characteristics and Deep Neural Network.

DPNet: Scene text detection based on dual perspective CNN-transformer