Abstract:Scene text detection is a fundamental research work in the field of image processing and has extensive application value. Segmentation-based methods have time-consuming feature processing, while post-processing algorithms are excellent. Real-time semantic segmentation methods use lightweight backbone networks for feature extraction and aggregation but lack effective post-processing methods. The pure convolutional network improves model performance by changing key components. Combining the advantages of three types of methods, we propose a Pure Convolutional Bilateral Segmentation Network (PCBSNet) for real-time natural scene text detection. First, we constructed a bilateral feature extraction backbone network to significantly improve detection speed. The low extraction detail branch captures spatial information, while the efficient semantic extraction branch accurately captures semantic features through a series of micro designs. Second, we built an efficient attention aggregation module to guide the efficient and adaptive aggregation of features from the two branches. The fused feature map undergoes feature enhancement to obtain more accurate and reliable feature representation. Finally, we used differentiable binarization post-processing to construct text instance boundaries. To evaluate the effectiveness of the proposed model, we compared it with mainstream lightweight models on three datasets: ICDAR2015, MSRA-TD500, and CTW1500. The F-measure scores were 82.9%, 82.8%, and 78.9%, respectively, and the FPS were 59.1, 94.3, and 75.5 frames per second. We also conducted extensive ablation experiments on the ICDAR2015 dataset to validate the rationality of the proposed improvements. The obtained results indicate that the proposed model significantly improves inference speed while enhancing accuracy and demonstrates good competitiveness compared to other advanced detection methods. However, when faced with curved text, the detection performance of PCBSNet needs to be improved.

Braille Detection Model Based on Foreground Attention and Semantic Learning

Hierarchical Braille Layout Detection Model Based on Semantic Assistance

Braille Recognition Using Deep Learning

Optical Braille Recognition Using Object Detection CNN

A Joint Object Detection and Semantic Segmentation Model with Cross-Attention and Inner-Attention Mechanisms

Semantic-Aware Alignment Network for Cross-Resolution Change Detection

DSC-Net: Enhancing Blind Road Semantic Segmentation with Visual Sensor Using a Dual-Branch Swin-CNN Architecture

Real-World Semantic Grasp Detection Based on Attention Mechanism

Effective Optical Braille Recognition Based On Two-Stage Learning For Double-Sided Braille Image

Fly-LeNet: A deep learning-based framework for converting multilingual braille images

BrailleReader : Braille Character Recognition Using Wearable Motion Sensor

AB-LSTM: Attention-based Bidirectional LSTM Model for Scene Text Detection

Attend and Guide (AG-Net): A Keypoints-driven Attention-based Deep Network for Image Recognition

SGBANet: Semantic GAN and Balanced Attention Network for Arbitrarily Oriented Scene Text Recognition

PCBSNet: A Pure Convolutional Bilateral Segmentation Network for Real-Time Natural Scene Text Detection

Braille-to-Speech Generator: Audio Generation Based on Joint Fine-Tuning of CLIP and Fastspeech2

A Multi-Modal Foundation Model to Assist People with Blindness and Low Vision in Environmental Interaction

Vision-Braille: An End-to-End Tool for Chinese Braille Image-to-Text Translation

Attention Based Network for Remote Sensing Scene Classification.

Improving Braille-Chinese translation with jointly trained and pre-trained language models

Pixel-Anchor: A Fast Oriented Scene Text Detector with Combined Networks