Abstract:This paper proposes an effective segmentation-free approach using a hybrid neural network hidden Markov model (NN-HMM) for offline handwritten Chinese text recognition (HCTR). In the general Bayesian framework, the handwritten Chinese text line is sequentially modeled by HMMs with each representing one character class, while the NN-based classifier is adopted to calculate the posterior probability of all HMM states. The key issues in feature extraction, character modeling, and language modeling are comprehensively investigated to show the effectiveness of NN-HMM framework for offline HCTR. First, a conventional deep neural network (DNN) architecture is studied with a well-designed feature extractor. As for the training procedure, the label refinement using forced alignment and the sequence training can yield significant gains on top of the frame-level cross-entropy criterion. Second, a deep convolutional neural network (DCNN) with automatically learned discriminative features demonstrates its superiority to DNN in the HMM framework. Moreover, to solve the challenging problem of distinguishing quite confusing classes due to the large vocabulary of Chinese characters, NN-based classifier should output 19900 HMM states as the classification units via a high-resolution modeling within each character. On the ICDAR 2013 competition task of CASIA-HWDB database, DNN-HMM yields a promising character error rate (CER) of 5.24% by making a good trade-off between the computational complexity and recognition accuracy. To the best of our knowledge, DCNN-HMM can achieve a best published CER of 3.53%.

Application of Hidden Markov Model in On-line Recognition of Handwritten Tibetan Characters

Dynamic hand gesture recognition using hidden Markov models

2D-HMM BASED CHARACTER RECOGNITION OF THE ENGINEERING DRAWING

An On- Line Free Handwritten Chinese Character Recognition Method Based on Component Cascaded HMMs

Hidden control neural network and HMM hybrid approach for on-line cursive handwriting recognition

On-Line Handwritten English Word Recognition Based On Cascade Connection Of Character Hmms

A HMM Based On-line Chinese Character Recognition System and Improved Training Algorithm

A new approach for off-line handwritten Chinese character recognition using self-adaptive HMM

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition

International Conference on Machine Learning and Cybernetics , Hong Kong , 19-22 August 2007 HMM-BASED SYSTEM FOR TRANSCRIBING CHINESE HANDWRITING

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Data Driven Design Of An Ann/Hmm System For On-Line Unconstrained Handwritten Character Recognition

Off-line Recognition of Realistic Chinese Handwriting Using Segmentation-Free Strategy

Writer identification of Chinese handwriting documents using hidden Markov tree model

HMM-Based Recognizer with Segmentation-free Strategy for Unconstrained Chinese Handwritten Text

Spatio-temporal unified model for on-line handwritten Chinese character recognition

A Novel Short Merged Off-line Handwritten Chinese Character String Segmentation Algorithm Using Hidden Markov Model

An Open-Source Library of 2D-GMM-HMM Based on Kaldi Toolkit and Its Application to Handwritten Chinese Character Recognition

A comprehensive study of hybrid neural network hidden Markov model for offline handwritten Chinese text recognition

HMM-based On-Line Multi-Stroke Sketch Recognition