Abstract:Inspired by speech recognition, most of the recent state-of-the-art works convert scene text recognition into sequence prediction. Like most speech recognition problems, context modeling is considered as a critical component in these methods for achieving better performance. However, they usually only consider using a holistic or single-scale local sequence context, in a single dimension. Actually, scene texts or sequence contexts may span arbitrarily across a two-dimensional (2-D) space and in any style, not limited to only horizontal. Moreover, contexts of various scales may synthetically contribute to text recognition, in particular for irregular text recognition. In our method, we consider the context in a 2-D manner, and simultaneously consider context reasoning at various scales, from local to global. Based on this, we propose a new Two-Dimensional Multi-Scale Perceptive Context (TDMSPC) module, which performs multi-scale context learning, along both the horizontal and vertical directions, and then merges them. This can generate shape and layout-dependent feature maps for scene text recognition. This proposed module can be handily inserted into existing sequence-based frameworks to replace their context learning mechanism. Furthermore, a new scene text recognition network, called TDMSPC-Net, is built, by using the TDMSPC module as a building block for the encoder, and adopting an attention-based LSTM as the decoder. Experiments on benchmark datasets show that the TDMSPC module can substantially boost the performance of existing sequence-based scene text recognizers, irrespective of the decoder or backbone network being used. The proposed TDMSPC-Net achieves state-of-the-art accuracy on all the benchmark datasets. (C) 2020 Elsevier B.V. All rights reserved.

Multi-Scale Channel Attention for Chinese Scene Text Recognition.

Learning and Fusing Multi-Scale Representations for Accurate Arbitrary-Shaped Scene Text Recognition.

A Multi-Scale Natural Scene Text Detection Method Based on Attention Feature Extraction and Cascade Feature Fusion

MA-CRNN: a Multi-Scale Attention CRNN for Chinese Text Line Recognition in Natural Scenes

SaHAN: Scale-aware Hierarchical Attention Network for Scene Text Recognition

MASTER: Multi-Aspect Non-local Network for Scene Text Recognition

Text Recognition Model Based on Multi-Scale Fusion CRNN.

Two-dimensional multi-scale perceptive context for scene text recognition

Scene text recognition based on two-stage attention and multi-branch feature fusion module

Natural scene text detection based on attention mechanism and deep multi-scale feature fusion

SLOAN: Scale-Adaptive Orientation Attention Network for Scene Text Recognition.

Adaptive Multi-Scale HyperNet with Bi-Direction Residual Attention Module for Scene Text Detection

Scene Text Recognition Via Gated Cascade Attention

Scene Chinese Recognition with Local and Global Attention

DSRN: A Deep Scale Relationship Network for Scene Text Detection.

Scene Text Recognition with Cascade Attention Network.

Scene Text Recognition from Two-Dimensional Perspective

A Text-Context-Aware CNN Network for Multi-oriented and Multi-language Scene Text Detection.

MTSTR: Multi-task learning for low-resolution scene text recognition via dual attention mechanism and its application in logistics industry

Flexible scene text recognition based on dual attention mechanism

Scene Understanding Based on Multi-Scale Pooling of Deep Learning Features