Abstract:Script identification is an essential preliminary step in multilingual OCR systems. This paper focuses primarily on tackling the challenging problem of script identification in scene text images, which are usually characterized by low image quality, diverse text styles, and complex backgrounds. Furthermore, script identification becomes a fine-grained classification problem when some scripts share common characters. To address this issue, we propose a novel end-to-end CNN comprising two streams for extracting distinct types of features, namely, visual features and spatial features. In the visual stream, we introduce an enhanced Squeeze-and-Excitation (SE) channel attention mechanism to emphasize valuable features and suppress irrelevant ones. The enhanced SE is composed of squeeze and excitation steps. The squeeze step employs adaptive average pooling for information aggregation. Two 1x1 convolutional layers are used to derive channel weights in the excitation step. In the spatial stream, we perform efficient analysis of the spatial dependencies within the text lines based on LSTM. Finally, we propose an adaptive fusion approach that combines probability vectors from the two streams. Instead of being fixed, the weight assigned to each probability vector is learned during network training. To validate our proposed method, we conduct extensive tests on four publicly available datasets, viz. MLe2e, RRC-MLT2017, SIW-13, and CVSI-2015. Our proposed method achieves accuracies of , , , and on these four datasets, respectively, which compare favorably with state-of-the-art methods. The two streams have demonstrated complementarity. Moreover, ablation experiments have been conducted to verify the effectiveness of each component in the proposed method.

Automatic Script Identification in the Wild

Script Identification in the Wild Via Discriminative Convolutional Neural Network

Residual attention-based multi-scale script identification in scene text images

ScriptNet: A Two Stream CNN for Script Identification in Camera-Based Document Images.

Adaptive feature fusion for scene text script identification

SANet-SI: A New Self-Attention-Network for Script Identification in Scene Images

Improving patch-based scene text script identification with ensembles of conjoined networks

Scene Text Script Identification With Convolutional Recurrent Neural Networks

Text detection and script identification in natural scene images using deep learning

ICDAR 2021 Competition on Script Identification in the Wild

Robust Scene Text Detection for Multi-script Languages Using Deep Learning.

ConvPatchTrans: A script identification network with global and local semantics deeply integrated

Sequence-to-Label Script Identification for Multilingual OCR

Script Identification of Multi-Script Documents: a Survey

A Study of Script Language Effects in Deep Neural-Network-Based Scene Text Detection.

Patch Aggregator for Scene Text Script Identification

A Novel Multi-scale Deep Neural Framework for Script Invariant Text Detection

Mlts: A Multi-Language Scene Text Spotter

Improving Script Identification by Integrating Text Recognition Information

SARN: Script-aware Recognition Network for Scene Multilingual Text Recognition

Exploring Knowledge Distillation of a Deep Neural Network for Multi-Script identification