Abstract:Scene text recognition has attracted great interests from the computer vision and pattern recognition community in recent years. State-of-the-art methods use concolutional neural networks (CNNs), recurrent neural networks with long short-term memory (RNN-LSTM) or the combination of them. In this paper, we investigate the intrinsic characteristics of text recognition, and inspired by human cognition mechanisms in reading texts, we propose a scene text recognition method with character models on convolutional feature map. The method simultaneously detects and recognizes characters by sliding the text line image with character models, which are learned end-to-end on text line images labeled with text transcripts. The character classifier outputs on the sliding windows are normalized and decoded with Connectionist Temporal Classification (CTC) based algorithm. Compared to previous methods, our method has a number of appealing properties: (1) It avoids the difficulty of character segmentation which hinders the performance of segmentation-based recognition methods; (2) The model can be trained simply and efficiently because it avoids gradient vanishing/exploding in training RNN-LSTM based models; (3) It bases on character models trained free of lexicon, and can recognize unknown words. (4) The recognition process is highly parallel and enables fast recognition. Our experiments on several challenging English and Chinese benchmarks, including the IIIT-5K, SVT, ICDAR03/13 and TRW15 datasets, demonstrate that the proposed method yields superior or comparable performance to state-of-the-art methods while the model size is relatively small.

Cascade 2D attentional decoders with context-enhanced encoder for scene text recognition

Scene Text Recognition Via Gated Cascade Attention

Representation and Correlation Enhanced Encoder-Decoder Framework for Scene Text Recognition

MASTER: Multi-Aspect Non-local Network for Scene Text Recognition

Scene Text Recognition with Cascade Attention Network.

I2C2W: Image-to-Character-to-Word Transformers for Accurate Scene Text Recognition

A holistic representation guided attention network for scene text recognition

Character Region Awareness Network for Scene Text Recognition

Attention and Language Ensemble for Scene Text Recognition with Convolutional Sequence Modeling.

Scene Text Recognition from Two-Dimensional Perspective

ReADS: A Rectified Attentional Double Supervised Network for Scene Text Recognition

Context Perception Parallel Decoder for Scene Text Recognition

C V ] 9 M ay 2 01 8 Edit Probability for Scene Text Recognition

Reading Scene Text with Attention Convolutional Sequence Modeling

Deep Neural Network with Attention Model for Scene Text Recognition.

Convolutional Attention Networks for Scene Text Recognition

Scene Text Recognition with Temporal Convolutional Encoder

NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognition

2D Attentional Irregular Scene Text Recognizer

Scene Text Recognition with Sliding Convolutional Character Models

Focus on the Whole Character: Discriminative Character Modeling for Scene Text Recognition