Abstract:There is a growing interest in scene text detection for arbitrary shapes. The effectiveness of text detection has also evolved from horizontal text detection to the ability to perform text detection in multiple directions and arbitrary shapes. However, scene text detection is still a challenging task due to significant differences in size and aspect ratio and diversity in shape, as well as orientation, coarse annotations, and other factors. Regression-based methods are inspired by object detection and have limitations in fitting the edges of arbitrarily shaped text due to the characteristics of their methods. Segmentation-based methods, on the other hand, perform prediction at the pixel level and thus can fit arbitrarily shaped text better. However, the inaccuracy of image text annotations and the distribution characteristics of text pixels, which contain a large number of background pixels and misclassified pixels, degrades the performance of segmentation-based text detection methods to some extent. Usually, considering whether a pixel belongs to a text region is highly dependent on the strength of the semantic information it has and the position of the pixel in the text area. Based on the above two points, we propose an innovative and robust method for scene text detection combining position and semantic information. First, we add position information to the images using a position encoding module (PosEM) to help the model learn the implicit feature relationships associated with the position. Second, we use the semantic enhancement module (SEM) to enhance the model's focus on the semantic information in the image during feature extraction. Then, to minimize the effect of noise due to inaccurate image text annotations and the distribution characteristics of text pixels, we convert the detection results into a probability map that can more reasonably represent the text distribution. Finally, we reconstruct and filter the text instances using a post-processing algorithm to reduce false positives. The experimental results show that our model improves significantly on the Total-Text, MSRA-TD500, and CTW1500 datasets, outperforming most previous advanced algorithms.

Boilerplate Detection via Semantic Classification of TextBlocks

Predicting Semantically Linkable Knowledge In Developer Online Forums Via Convolutional Neural Network

CNN Based Page Object Detection in Document Images

Hierarchical Semantic Model for Objectionable Web Text Content Detection

Multi-Task Neural Sequence Labeling for Zero-Shot Cross-Language Boilerplate Removal

Semorph: A Morphology Semantic Enhanced Pre-trained Model for Chinese Spam Text Detection.

Web Objectionable Text Content Detection Using Topic Modeling Technique.

Deep Neural Network for Semantic-based Text Recognition in Images

Text Classification Using Hybrid Machine Learning Algorithms on Big Data

Detecting Incongruity Between News Headline and Body Text via a Deep Hierarchical Encoder

A Robust Method: Arbitrary Shape Text Detection Combining Semantic and Position Information

TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Model

Semantic Html Page Segmentation Using Type Analysis

Mast Kalandar at SemEval-2024 Task 8: On the Trail of Textual Origins: RoBERTa-BiLSTM Approach to Detect AI-Generated Text

A multi-semantic passing framework for semi-supervised long text classification

Semantic Hilbert Space for Text Representation Learning

Data2Text Studio: Automated Text Generation from Structured Data.

Semi-Bagging Based Deep Neural Architecture to Extract Text from High Entropy Images

Text Classification Via Learning Semantic Dependency and Association

Automated Static Warning Identification via Path-based Semantic Representation

Deep Learning-based approaches for automatic detection of shell nouns and evaluation on WikiText-2