Abstract:With the continuous advancement of deep learning, research in scene text detection has evolved significantly. However, complex backgrounds and various text forms complicate the task of detecting text from images. CNN is a deep learning algorithm that automatically extracts features through convolution operation. In the task of scene text detection, it can capture local text features in images, but it lacks global attributes. In recent years, inspired by the application of transformers in the field of computer vision, it can capture the global information of images and describe them intuitively. Therefore, this paper proposes scene text detection based on dual perspective CNN-transformer. The channel enhanced self-attention module (CESAM) and spatial enhanced self-attention module (SESAM) proposed in this paper are integrated into the traditional ResNet backbone network. This integration effectively facilitates the learning of global contextual information and positional relationships of text, thereby alleviating the challenge of detecting small target text. Furthermore, this paper introduces a feature decoder designed to refine the effective text information within the feature map and enhance the perception of detailed information. Experiments show that the method proposed in this paper significantly improves the robustness of the model for different types of text detection. Compared to the baseline, it achieves performance improvements of 2.51% (83.81 vs. 81.3) on the Total-Text dataset, 1.87% (86.07 vs. 84.2) on the ICDAR 2015 dataset, and 3.63% (86.72 vs. 83.09) on the MSRA-TD500 dataset, while also demonstrating better visual effects.

Deep Metric Learning For Scene Text Detection

Deep Neural Network with Attention Model for Scene Text Recognition.

A Unified Deep Neural Network For Scene Text Detection

Enhancing Remote Sensing Image Retrieval with Triplet Deep Metric Learning Network

A Direct Regression Scene Text Detector with Position-Sensitive Segmentation

Deep Matching Prior Network: Toward Tighter Multi-oriented Text Detection

A Text-Context-Aware CNN Network for Multi-oriented and Multi-language Scene Text Detection.

Deep learning approaches to scene text detection: a comprehensive review

Text-Attentional Convolutional Neural Networks for Scene Text Detection

DPNet: Scene text detection based on dual perspective CNN-transformer

I3CL: Intra- and Inter-Instance Collaborative Learning for Arbitrary-Shaped Scene Text Detection

Class-specific discriminative metric learning for scene recognition

When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs

Application Analysis of Image Enhancement Method in Deep Learning Image Recognition Scene

DeepText: A Unified Framework for Text Proposal Generation and Text Detection in Natural Images

Text-Attentional Convolutional Neural Network for Scene Text Detection

MorphText: Deep Morphology Regularized Arbitrary-shape Scene Text Detection

Weakly Supervised Scene Parsing with Point-Based Distance Metric Learning.

Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

Scene Text Detection Using Superpixel-Based Stroke Feature Transform and Deep Learning Based Region Classification