Abstract:There is a growing interest in scene text detection for arbitrary shapes. The effectiveness of text detection has also evolved from horizontal text detection to the ability to perform text detection in multiple directions and arbitrary shapes. However, scene text detection is still a challenging task due to significant differences in size and aspect ratio and diversity in shape, as well as orientation, coarse annotations, and other factors. Regression-based methods are inspired by object detection and have limitations in fitting the edges of arbitrarily shaped text due to the characteristics of their methods. Segmentation-based methods, on the other hand, perform prediction at the pixel level and thus can fit arbitrarily shaped text better. However, the inaccuracy of image text annotations and the distribution characteristics of text pixels, which contain a large number of background pixels and misclassified pixels, degrades the performance of segmentation-based text detection methods to some extent. Usually, considering whether a pixel belongs to a text region is highly dependent on the strength of the semantic information it has and the position of the pixel in the text area. Based on the above two points, we propose an innovative and robust method for scene text detection combining position and semantic information. First, we add position information to the images using a position encoding module (PosEM) to help the model learn the implicit feature relationships associated with the position. Second, we use the semantic enhancement module (SEM) to enhance the model's focus on the semantic information in the image during feature extraction. Then, to minimize the effect of noise due to inaccurate image text annotations and the distribution characteristics of text pixels, we convert the detection results into a probability map that can more reasonably represent the text distribution. Finally, we reconstruct and filter the text instances using a post-processing algorithm to reduce false positives. The experimental results show that our model improves significantly on the Total-Text, MSRA-TD500, and CTW1500 datasets, outperforming most previous advanced algorithms.

CVTD: A Robust Car-Mounted Video Text Detector

Scene Text Detection and Recognition System for Visually Impaired People in Real World

Character-Level Street View Text Spotting Based on Deep Multisegmentation Network for Smarter Autonomous Driving

TextDCT: Arbitrary-Shaped Text Detection Via Discrete Cosine Transform Mask.

Real-time End-to-End Video Text Spotter with Contrastive Representation Learning

Towards Robust Video Text Detection with Spatio-Temporal Attention Modeling and Text Cues Fusion

A Robust and Effective Text Detector Supervised by Contrastive Learning

CentripetalText: an Efficient Text Instance Representation for Scene Text Detection

A Text Detection System for Natural Scenes with Convolutional Feature Learning and Cascaded Classification

Real-Time Text Detection with Similar Mask in Traffic, Industrial, and Natural Scenes

End-to-end video text detection with online tracking

FAST: Faster Arbitrarily-Shaped Text Detector with Minimalist Kernel Representation

A new method for detection and prediction of occluded text in natural scene images

VimTS: A Unified Video and Image Text Spotter for Enhancing the Cross-domain Generalization

2D-CTC for Scene Text Recognition

Text Detection in Scene Images Based on Exhaustive Segmentation

CvT-ASSD: Convolutional vision-Transformer Based Attentive Single Shot MultiBox Detector

Automatic video superimposed text detection based on Nonsubsampled Contourlet Transform

CRNet: A Center-aware Representation for Detecting Text of Arbitrary Shapes

A Robust Method: Arbitrary Shape Text Detection Combining Semantic and Position Information

Seeing Text in the Dark: Algorithm and Benchmark