Abstract:Scene text recognition has attracted great interests from the computer vision and pattern recognition community in recent years. State-of-the-art methods use concolutional neural networks (CNNs), recurrent neural networks with long short-term memory (RNN-LSTM) or the combination of them. In this paper, we investigate the intrinsic characteristics of text recognition, and inspired by human cognition mechanisms in reading texts, we propose a scene text recognition method with character models on convolutional feature map. The method simultaneously detects and recognizes characters by sliding the text line image with character models, which are learned end-to-end on text line images labeled with text transcripts. The character classifier outputs on the sliding windows are normalized and decoded with Connectionist Temporal Classification (CTC) based algorithm. Compared to previous methods, our method has a number of appealing properties: (1) It avoids the difficulty of character segmentation which hinders the performance of segmentation-based recognition methods; (2) The model can be trained simply and efficiently because it avoids gradient vanishing/exploding in training RNN-LSTM based models; (3) It bases on character models trained free of lexicon, and can recognize unknown words. (4) The recognition process is highly parallel and enables fast recognition. Our experiments on several challenging English and Chinese benchmarks, including the IIIT-5K, SVT, ICDAR03/13 and TRW15 datasets, demonstrate that the proposed method yields superior or comparable performance to state-of-the-art methods while the model size is relatively small.

A Novel Method Based on Character Segmentation for Slant Chinese Screen-render Text Detection and Recognition

A Novel Method Of Detecting Chinese Rendered Text On Tilted Screen Of Mobile Devices

Screen-rendered Text Images Recognition Using a Deep Residual Network Based Segmentation-Free Method

Text Detection in Scene Images Based on Exhaustive Segmentation

A Novel Semantic Segmentation Model for Chinese Characters

Recognition of Handwritten Chinese Text by Segmentation: A Segment-annotation-free Approach

Scene Text Recognition with Sliding Convolutional Character Models

An approach for handwritten Chinese text recognition unifying character segmentation and recognition

Character Segmentation of Offline Unconstrained Handwritten Chinese Text Lines

A Fast and Accurate Fully Convolutional Network for End-to-End Handwritten Chinese Text Segmentation and Recognition

Orientation-Independent Chinese Text Recognition in Scene Images

Seeing Text in the Dark: Algorithm and Benchmark

A Character Recognition Method for Chip Surface Characters Based on Text Replacement

Chinese Characters Recognition from Screen-Rendered Images Using Inception Deep Learning Architecture.

Scene Text Localization Using Edge Analysis and Feature Pool.

Integrated Method for Text Detection in Natural Scene Images

Chinese Image Text Recognition with BLSTM-CTC: A Segmentation-Free Method.

Text Font Correction and Alignment Method for Scene Text Recognition

Multiscale Fully Convolutional Network‐based Approach for Multilingual Character Segmentation

Towards Fast, Accurate and Compact Online Handwritten Chinese Text Recognition

Character Region Awareness Network for Scene Text Recognition