Abstract:This paper proposes an effective segmentation-free approach using a hybrid neural network hidden Markov model (NN-HMM) for offline handwritten Chinese text recognition (HCTR). In the general Bayesian framework, the handwritten Chinese text line is sequentially modeled by HMMs with each representing one character class, while the NN-based classifier is adopted to calculate the posterior probability of all HMM states. The key issues in feature extraction, character modeling, and language modeling are comprehensively investigated to show the effectiveness of NN-HMM framework for offline HCTR. First, a conventional deep neural network (DNN) architecture is studied with a well-designed feature extractor. As for the training procedure, the label refinement using forced alignment and the sequence training can yield significant gains on top of the frame-level cross-entropy criterion. Second, a deep convolutional neural network (DCNN) with automatically learned discriminative features demonstrates its superiority to DNN in the HMM framework. Moreover, to solve the challenging problem of distinguishing quite confusing classes due to the large vocabulary of Chinese characters, NN-based classifier should output 19900 HMM states as the classification units via a high-resolution modeling within each character. On the ICDAR 2013 competition task of CASIA-HWDB database, DNN-HMM yields a promising character error rate (CER) of 5.24% by making a good trade-off between the computational complexity and recognition accuracy. To the best of our knowledge, DCNN-HMM can achieve a best published CER of 3.53%.

Modified Bootstrap Approach with State Number Optimization for Hidden Markov Model Estimation in Small-Size Printed Arabic Text Line Recognition.

On-line Handwritten Recognition with Optimized GDTW-SVM Algoriyhm

Exploring More Representative States of Hidden Markov Model in Optical Character Recognition: A Clustering-Based Model Pre-Training Approach

Hidden Markov random field based approach for off-line handwritten Chinese character recognition

Printed Arabic Character Recognition Using Hmm

Hmmrf: A Stochastic Model For Offline Handwritten Chinese Character Recognition

New Statistical Method for Machine-Printed Arabic Character Recognition

Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition

Analyzing the Information Entropy of States to Optimize the Number of States in an Hmm-Based Off-Line Handwritten Arabic Word Recognizer

Hidden Markov Acoustic Modeling with Bootstrap and Restructuring for Low-Resourced Languages

Baseline-independent feature extraction for Arabic writing

A modified Adaboost algorithm for Chinese handwritten character recognition

Adaboost Based Handwritten/Printed Discrimination On Single Character

Uyghur Character Models with Shared Structure Information for Segmentation-free Recognition under Low Data Resource Conditions

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Robust Multi-Layer Hierarchical Model for Digit Character Recognition

A HMM Based On-line Chinese Character Recognition System and Improved Training Algorithm

A Hybrid Post-Processing System For Offline Handwritten Chinese Character Recognition Based On A Statistical Language Model

AdaBoost-based handwritten/printed discrimination on a single character

A Novel Short Merged Off-line Handwritten Chinese Character String Segmentation Algorithm Using Hidden Markov Model

Chinese Handwritten Legal Amount Recognition with HMM-Based Approach