Abstract:This paper proposes an effective segmentation-free approach using a hybrid neural network hidden Markov model (NN-HMM) for offline handwritten Chinese text recognition (HCTR). In the general Bayesian framework, the handwritten Chinese text line is sequentially modeled by HMMs with each representing one character class, while the NN-based classifier is adopted to calculate the posterior probability of all HMM states. The key issues in feature extraction, character modeling, and language modeling are comprehensively investigated to show the effectiveness of NN-HMM framework for offline HCTR. First, a conventional deep neural network (DNN) architecture is studied with a well-designed feature extractor. As for the training procedure, the label refinement using forced alignment and the sequence training can yield significant gains on top of the frame-level cross-entropy criterion. Second, a deep convolutional neural network (DCNN) with automatically learned discriminative features demonstrates its superiority to DNN in the HMM framework. Moreover, to solve the challenging problem of distinguishing quite confusing classes due to the large vocabulary of Chinese characters, NN-based classifier should output 19900 HMM states as the classification units via a high-resolution modeling within each character. On the ICDAR 2013 competition task of CASIA-HWDB database, DNN-HMM yields a promising character error rate (CER) of 5.24% by making a good trade-off between the computational complexity and recognition accuracy. To the best of our knowledge, DCNN-HMM can achieve a best published CER of 3.53%.

End-to-End Model for Offline Handwritten Mongolian Word Recognition

End to End Recognition System for Recognizing Offline Unconstrained Vietnamese Handwriting

A new dataset for mongolian online handwritten recognition

Offline Mongolian Handwriting Recognition Based on Data Augmentation and Improved ECA-Net

Unconstrained Offline Handwritten Word Recognition by Position Embedding Integrated ResNets Model

An Efficient End-to-End Neural Model for Handwritten Text Recognition

Multi-layer Recurrent Neural Network Based Offline Arabic Handwriting Recognition

Combination of Global and Local Baseline-Independent Features for Offline Arabic Handwriting Recognition.

Deep LSTM Networks for Online Chinese Handwriting Recognition

Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition

Topic Language Model Adaption for Recognition of Homologous Offline Handwritten Chinese Text Image

An Approach to Offline Handwritten Chinese Character Recognition Based on Segment Evaluation of Adaptive Duration

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

A Residual-Attention Offline Handwritten Chinese Text Recognition Based on Fully Convolutional Neural Networks.

HMM-Based Recognizer with Segmentation-free Strategy for Unconstrained Chinese Handwritten Text

Off-line Recognition of Realistic Chinese Handwriting Using Segmentation-Free Strategy

A new approach for off-line handwritten Chinese character recognition using self-adaptive HMM

Recurrent neural network transducer for Japanese and Chinese offline handwritten text recognition

On the Use of Attention Mechanism in a Seq2Seq Based Approach for Off-Line Handwritten Digit String Recognition

An Effective Approach to Offline Arabic Handwriting Recognition

On-Line Handwritten English Word Recognition Based On Cascade Connection Of Character Hmms