Abstract:Script identification is an essential preliminary step in multilingual OCR systems. This paper focuses primarily on tackling the challenging problem of script identification in scene text images, which are usually characterized by low image quality, diverse text styles, and complex backgrounds. Furthermore, script identification becomes a fine-grained classification problem when some scripts share common characters. To address this issue, we propose a novel end-to-end CNN comprising two streams for extracting distinct types of features, namely, visual features and spatial features. In the visual stream, we introduce an enhanced Squeeze-and-Excitation (SE) channel attention mechanism to emphasize valuable features and suppress irrelevant ones. The enhanced SE is composed of squeeze and excitation steps. The squeeze step employs adaptive average pooling for information aggregation. Two 1x1 convolutional layers are used to derive channel weights in the excitation step. In the spatial stream, we perform efficient analysis of the spatial dependencies within the text lines based on LSTM. Finally, we propose an adaptive fusion approach that combines probability vectors from the two streams. Instead of being fixed, the weight assigned to each probability vector is learned during network training. To validate our proposed method, we conduct extensive tests on four publicly available datasets, viz. MLe2e, RRC-MLT2017, SIW-13, and CVSI-2015. Our proposed method achieves accuracies of , , , and on these four datasets, respectively, which compare favorably with state-of-the-art methods. The two streams have demonstrated complementarity. Moreover, ablation experiments have been conducted to verify the effectiveness of each component in the proposed method.

Robust Scene Text Detection for Multi-script Languages Using Deep Learning.

Scene Text Detection and Recognition System for Visually Impaired People in Real World

Text detection and script identification in natural scene images using deep learning

Residual attention-based multi-scale script identification in scene text images

Robust Text Detection in Natural Scene Images

Multi-Script-Oriented Text Detection and Recognition in Video/Scene/Born Digital Images

Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

Mlts: A Multi-Language Scene Text Spotter

Scene Text Detection with Fully Convolutional Neural Networks

Script Independent Approach for Multi-Oriented Text Detection in Scene Image

A Feasible Framework for Arbitrary-Shaped Scene Text Recognition

A Text-Context-Aware CNN Network for Multi-oriented and Multi-language Scene Text Detection.

Scene Text Detection Based On Robust Stroke Width Transform And Deep Belief Network

Adaptive feature fusion for scene text script identification

A Robust Hierarchical Detection Method for Scene Text Based on Convolutional Neural Networks

Robust Seed Localization And Growing With Deep Convolutional Features For Scene Text Detection

Robust Scene Text Recognition with Automatic Rectification

Text-Attentional Convolutional Neural Networks for Scene Text Detection

Scene Text Detection via Holistic, Multi-Channel Prediction

Text Detection in Scene Images Based on Exhaustive Segmentation

A Robust Approach for Recognition of Text Embedded in Natural Scenes