Abstract:Inspired by speech recognition, most of the recent state-of-the-art works convert scene text recognition into sequence prediction. Like most speech recognition problems, context modeling is considered as a critical component in these methods for achieving better performance. However, they usually only consider using a holistic or single-scale local sequence context, in a single dimension. Actually, scene texts or sequence contexts may span arbitrarily across a two-dimensional (2-D) space and in any style, not limited to only horizontal. Moreover, contexts of various scales may synthetically contribute to text recognition, in particular for irregular text recognition. In our method, we consider the context in a 2-D manner, and simultaneously consider context reasoning at various scales, from local to global. Based on this, we propose a new Two-Dimensional Multi-Scale Perceptive Context (TDMSPC) module, which performs multi-scale context learning, along both the horizontal and vertical directions, and then merges them. This can generate shape and layout-dependent feature maps for scene text recognition. This proposed module can be handily inserted into existing sequence-based frameworks to replace their context learning mechanism. Furthermore, a new scene text recognition network, called TDMSPC-Net, is built, by using the TDMSPC module as a building block for the encoder, and adopting an attention-based LSTM as the decoder. Experiments on benchmark datasets show that the TDMSPC module can substantially boost the performance of existing sequence-based scene text recognizers, irrespective of the decoder or backbone network being used. The proposed TDMSPC-Net achieves state-of-the-art accuracy on all the benchmark datasets. (C) 2020 Elsevier B.V. All rights reserved.

Context Aware Topic Model for Scene Recognition

Learning Visual Context for Group Activity Recognition.

Scene Recognition by Jointly Modeling Latent Topics.

Scene and place recognition using a hierarchical latent topic model.

A Novel Context-Aware Topic Model For Category Discovery In Natural Scenes

A Context Model for Object Recognition Improved by Spatial Relationships

Sparse Bayesian discriminative learning method for context-based scene recognition model

Discriminative Latent Models for Recognizing Contextual Group Activities

Category Constrained Learning Model for Scene Classification

Local–class–shared–topic Latent Dirichlet Allocation Based Scene Classification

Spatial-DiscLDA for visual recognition

Spatially-Aware Context Neural Networks.

Discriminative Context Models for Collective Activity Recognition

Reconfigurable models for scene recognition

Context-LGM: Leveraging Object-Context Relation for Context-Aware Object Recognition

A Text-Context-Aware CNN Network for Multi-oriented and Multi-language Scene Text Detection.

Two-dimensional multi-scale perceptive context for scene text recognition

Multi-scale Feature and Spatial Relation Inference for Object Detection.

Object Recognition Based on Improved Context Model

Natural Scene Classification Based on Integrated Topic Simplex

Object detection using discriminative photogrammetric context