Abstract:Script identification is an essential preliminary step in multilingual OCR systems. This paper focuses primarily on tackling the challenging problem of script identification in scene text images, which are usually characterized by low image quality, diverse text styles, and complex backgrounds. Furthermore, script identification becomes a fine-grained classification problem when some scripts share common characters. To address this issue, we propose a novel end-to-end CNN comprising two streams for extracting distinct types of features, namely, visual features and spatial features. In the visual stream, we introduce an enhanced Squeeze-and-Excitation (SE) channel attention mechanism to emphasize valuable features and suppress irrelevant ones. The enhanced SE is composed of squeeze and excitation steps. The squeeze step employs adaptive average pooling for information aggregation. Two 1x1 convolutional layers are used to derive channel weights in the excitation step. In the spatial stream, we perform efficient analysis of the spatial dependencies within the text lines based on LSTM. Finally, we propose an adaptive fusion approach that combines probability vectors from the two streams. Instead of being fixed, the weight assigned to each probability vector is learned during network training. To validate our proposed method, we conduct extensive tests on four publicly available datasets, viz. MLe2e, RRC-MLT2017, SIW-13, and CVSI-2015. Our proposed method achieves accuracies of , , , and on these four datasets, respectively, which compare favorably with state-of-the-art methods. The two streams have demonstrated complementarity. Moreover, ablation experiments have been conducted to verify the effectiveness of each component in the proposed method.

SCRIPT IDENTIFICATION BASED ON FUSED TEXTURE FEATURE OF CURVELET TRANSFORM SUB-BANDS

Chinese Handwriting Identification Based on Stable Spectral Feature of Texture Images

Texture for script identification

Off- Line Chinese Writer Identification Based on Character-Level Decision Combination

Residual attention-based multi-scale script identification in scene text images

Adaptive feature fusion for scene text script identification

Word Level Script Recognition for Uighur Document Mixed with English Script.

New Gradient-Spatial-Structural Features for Video Script Identification

Handwritten Script Identification from Text Lines

A New Approach for Texture based Script Identification At Block Level using Quad Tree Decomposition

ConvPatchTrans: A script identification network with global and local semantics deeply integrated

Sequence-to-Label Script Identification for Multilingual OCR

Script identification in handwritten and printed documents using convolutional recurrent connection

Multi-Script-Oriented Text Detection and Recognition in Video/Scene/Born Digital Images

Identification of arabic word from bilingual text using character features

Texture Image Classification Using Non-subsampled Contourlet Transform and Support Vector Machines

Script Independent Approach for Multi-Oriented Text Detection in Scene Image

Text detection and script identification in natural scene images using deep learning

SANet-SI: A New Self-Attention-Network for Script Identification in Scene Images

A novel features and classifiers fusion technique for recognition of Arabic handwritten character script

Patch Aggregator for Scene Text Script Identification