Abstract:Abstract Detecting text within medical images presents a formidable challenge in the domain of computer vision due to the intricate nature of textual backgrounds, the dense text concentration, and the possible existence of extreme aspect ratios. This paper introduces an effective and precise text detection system tailored to address these challenges. The system incorporates an optimized segmentation module, a trainable post-processing method, and leverages a vision-language pre-training model (oCLIP). Specifically, our segmentation head integrates three essential components: the Feature Pyramid Network (FPN) module, which combines a residual structure and channel attention mechanism; the Efficient Feature Enhancement Module (EFEM); and the Multi-Scale Feature Fusion with RSEConv (MSFM-RSE), designed specifically for multi-scale feature fusion based on RSEConv. By introducing a residual structure and channel attention mechanism into the FPN module, the convolutional layers are replaced with RSEConv layers that employ a channel attention mechanism, further augmenting the representational capacity of the feature maps. The EFEM, designed as a cascaded U-shaped module, incorporates a spatial attention mechanism to introduce multi-level information, thereby enhancing segmentation performance. Subsequently, the MSFM-RSE adeptly amalgamates features from various depths and scales of the EFEM to generate comprehensive final features tailored for segmentation purposes. Additionally, a post-processing module employs a differentiable binarization strategy, allowing the segmentation network to dynamically determine the binarization threshold. Building on the system’s improvement, we introduce a vision-language pre-training model that undergoes extensive training on various visual language understanding tasks. This pre-trained model acquires detailed visual and semantic representations, further reinforcing both the accuracy and robustness in text detection when integrated with the segmentation module. The performance of our proposed model was evaluated through experiments on medical text image datasets, demonstrating excellent results. Multiple benchmark experiments validate its superior performance in comparison to existing methods. Code is available at: https://github.com/csworkcode/VLDBNet .

Uyghur Text Matching in Graphic Images for Biomedical Semantic Analysis.

Detecting Uyghur Text in Complex Background Images with Convolutional Neural Network

Robust and Parallel Uyghur Text Localization in Complex Background Images

A Fast Uyghur Text Detector for Complex Background Images

A method for text line detection in natural images

Scene Uyghur Text Detection Based on Fine-Grained Feature Representation

Hierarchical Gumbel Attention Network for Text-based Person Search

Uyghur, Chinese and English Multilingual Document Recognition

Text Matching As Image Recognition

Chinese Text Detection and Location for Images in Multimedia Messaging Service

Enhancing medical text detection with vision-language pre-training and efficient segmentation

Text correlation measurement method and system based on fine-grained matching signal

RNN Based Uyghur Text Line Recognition and Its Training Strategy

An End-to-End Image-Text Matching Approach Considering Semantic Uncertainty

Word Level Script Recognition for Uighur Document Mixed with English Script.

Text Filtering through Multi-Pattern Matching: A Case Study of Wu–Manber–Uy on the Language of Uyghur

A Novel Method Based on Character Segmentation for Slant Chinese Screen-render Text Detection and Recognition

A model of integrating convolution and BiGRU dual-channel mechanism for Chinese medical text classifications

Design and implementation of prototype system for online handwritten Uyghur character recognition

Effective Uyghur Language Text Detection in Complex Background Images for Traffic Prompt Identification.

A Deep Semantic Alignment Network for the Cross-Modal Image-Text Retrieval in Remote Sensing