Abstract:Scene text detection is a fundamental research work in the field of image processing and has extensive application value. Segmentation-based methods have time-consuming feature processing, while post-processing algorithms are excellent. Real-time semantic segmentation methods use lightweight backbone networks for feature extraction and aggregation but lack effective post-processing methods. The pure convolutional network improves model performance by changing key components. Combining the advantages of three types of methods, we propose a Pure Convolutional Bilateral Segmentation Network (PCBSNet) for real-time natural scene text detection. First, we constructed a bilateral feature extraction backbone network to significantly improve detection speed. The low extraction detail branch captures spatial information, while the efficient semantic extraction branch accurately captures semantic features through a series of micro designs. Second, we built an efficient attention aggregation module to guide the efficient and adaptive aggregation of features from the two branches. The fused feature map undergoes feature enhancement to obtain more accurate and reliable feature representation. Finally, we used differentiable binarization post-processing to construct text instance boundaries. To evaluate the effectiveness of the proposed model, we compared it with mainstream lightweight models on three datasets: ICDAR2015, MSRA-TD500, and CTW1500. The F-measure scores were 82.9%, 82.8%, and 78.9%, respectively, and the FPS were 59.1, 94.3, and 75.5 frames per second. We also conducted extensive ablation experiments on the ICDAR2015 dataset to validate the rationality of the proposed improvements. The obtained results indicate that the proposed model significantly improves inference speed while enhancing accuracy and demonstrates good competitiveness compared to other advanced detection methods. However, when faced with curved text, the detection performance of PCBSNet needs to be improved.

Scene Text Detection with Feature Pyramid Network and Linking Segments

Scene Text Detection with Supervised Pyramid Context Network

Towards Accurate Scene Text Detection with Bidirectional Feature Pyramid Network

SAFPN: a Full Semantic Feature Pyramid Network for Object Detection

A Direct Regression Scene Text Detector with Position-Sensitive Segmentation

Adaptive Segmentation Network for Scene Text Detection

Learning Pixel Affinity Pyramid for Arbitrary-Shaped Text Detection

Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

Attention-based Feature Decomposition-Reconstruction Network for Scene Text Detection

A Multi-Scale Natural Scene Text Detection Method Based on Attention Feature Extraction and Cascade Feature Fusion

Using of Attention for Scene Text Detection

Real-Time Scene Text Detection With Differentiable Binarization and Adaptive Scale Fusion

Efficient Scene Text Detection with Textual Attention Tower

Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Network

High-speed Scene Text Detection with Attention and Multi-scale Label Generation

Pyrboxes: an Efficient Multi-Scale Scene Text Detector with Feature Pyramids

CentripetalText: an Efficient Text Instance Representation for Scene Text Detection

OPMP: An Omnidirectional Pyramid Mask Proposal Network for Arbitrary-Shape Scene Text Detection

Scene Text Detection Based on Two-Branch Feature Extraction

TEXT DETECTION IN NATURAL SCENE IMAGES BY HIERARCHICAL LOCALIZATION AND GROWING OF TEXTUAL COMPONENTS

PCBSNet: A Pure Convolutional Bilateral Segmentation Network for Real-Time Natural Scene Text Detection