Abstract:This paper proposes an effective segmentation-free approach using a hybrid neural network hidden Markov model (NN-HMM) for offline handwritten Chinese text recognition (HCTR). In the general Bayesian framework, the handwritten Chinese text line is sequentially modeled by HMMs with each representing one character class, while the NN-based classifier is adopted to calculate the posterior probability of all HMM states. The key issues in feature extraction, character modeling, and language modeling are comprehensively investigated to show the effectiveness of NN-HMM framework for offline HCTR. First, a conventional deep neural network (DNN) architecture is studied with a well-designed feature extractor. As for the training procedure, the label refinement using forced alignment and the sequence training can yield significant gains on top of the frame-level cross-entropy criterion. Second, a deep convolutional neural network (DCNN) with automatically learned discriminative features demonstrates its superiority to DNN in the HMM framework. Moreover, to solve the challenging problem of distinguishing quite confusing classes due to the large vocabulary of Chinese characters, NN-based classifier should output 19900 HMM states as the classification units via a high-resolution modeling within each character. On the ICDAR 2013 competition task of CASIA-HWDB database, DNN-HMM yields a promising character error rate (CER) of 5.24% by making a good trade-off between the computational complexity and recognition accuracy. To the best of our knowledge, DCNN-HMM can achieve a best published CER of 3.53%.

Hmmrf: A Stochastic Model For Offline Handwritten Chinese Character Recognition

Hidden Markov random field based approach for off-line handwritten Chinese character recognition

Spatio-temporal unified model for on-line handwritten Chinese character recognition

Markov random field-based statistical character structure modeling for handwritten Chinese character recognition

A new approach for off-line handwritten Chinese character recognition using self-adaptive HMM

Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Off-line Recognition of Realistic Chinese Handwriting Using Segmentation-Free Strategy

HMM-Based Recognizer with Segmentation-free Strategy for Unconstrained Chinese Handwritten Text

A HMM Based On-line Chinese Character Recognition System and Improved Training Algorithm

Hmm-Based Off-Line Handwritten Chinese Characters Recognition Using Krawtchouk Moments

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Combining Krawtchouk Moments And Hmms For Offline Handwritten Chinese Character Recognition

HMM Model for Online Handwritten Chinese Character Recognition Describing the Correlations Between Segments

Parsimonious HMMs for Offline Handwritten Chinese Text Recognition

Application of Hidden Markov Model in On-line Recognition of Handwritten Tibetan Characters

An On- Line Free Handwritten Chinese Character Recognition Method Based on Component Cascaded HMMs

Hmm-Based System for Transcribing Chinese Handwriting

On-Line Handwritten English Word Recognition Based On Cascade Connection Of Character Hmms

Cascade Markov Random Fields for Stroke Extraction of Chinese Characters

An HMM-based Over-Segmentation Method for Touching Chinese Handwriting Recognition