Abstract:Natural scene text detection is a significant challenge in computer vision, with tremendous potential applications in multilingual, diverse, and complex text scenarios. We propose a multilingual text detection model to address the issues of low accuracy and high difficulty in detecting multilingual text in natural scenes. In response to the challenges posed by multilingual text images with multiple character sets and various font styles, we introduce the SFM Swin Transformer feature extraction network to enhance the model's robustness in detecting characters and fonts across different languages. Dealing with the considerable variation in text scales and complex arrangements in natural scene text images, we present the AS-HRFPN feature fusion network by incorporating an Adaptive Spatial Feature Fusion module and a Spatial Pyramid Pooling module. The feature fusion network improvements enhance the model's ability to detect text sizes and orientations. Addressing diverse backgrounds and font variations in multilingual scene text images is a challenge for existing methods. Limited local receptive fields hinder detection performance. To overcome this, we propose a Global Semantic Segmentation Branch, extracting and preserving global features for more effective text detection, aligning with the need for comprehensive information. In this study, we collected and built a real-world multilingual natural scene text image dataset and conducted comprehensive experiments and analyses. The experimental results demonstrate that the proposed algorithm achieves an F-measure of 85.02\%, which is 4.71\% higher than the baseline model. We also conducted extensive cross-dataset validation on MSRA-TD500, ICDAR2017MLT, and ICDAR2015 datasets to verify the generality of our approach. The code and dataset can be found at <a class="link-external link-https" href="https://github.com/wangmelon/CEMLT" rel="external noopener nofollow">this https URL</a>.

Multi-lingual scene text detection and language identification

Mlts: A Multi-Language Scene Text Spotter

A Text-Context-Aware CNN Network for Multi-oriented and Multi-language Scene Text Detection.

Offline Extraction of Indic Regional Language from Natural Scene Image using Text Segmentation and Deep Convolutional Sequence

Scene Text Detection via Holistic, Multi-Channel Prediction

Robust Scene Text Detection for Multi-script Languages Using Deep Learning.

A New Language-Independent Deep CNN for Scene Text Detection and Style Transfer in Social Media Images

Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

Text detection and script identification in natural scene images using deep learning

An end-to-end model for multi-view scene text recognition

Deep Neural Network with Attention Model for Scene Text Recognition.

Research on Multilingual Natural Scene Text Detection Algorithm

Scene text detection using structured information and an end-to-end trainable generative adversarial networks

MOST: A Multi-Oriented Scene Text Detector with Localization Refinement

Script Independent Approach for Multi-Oriented Text Detection in Scene Image

MEAN: Multi - Element Attention Network for Scene Text Recognition

Multi-Script-Oriented Text Detection and Recognition in Video/Scene/Born Digital Images

A new method for detection and prediction of occluded text in natural scene images

Scene Text Detection with Fully Convolutional Neural Networks

ICDAR2019 Robust Reading Challenge on Multi-lingual Scene Text Detection and Recognition -- RRC-MLT-2019

An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition