Abstract:This paper proposes an effective segmentation-free approach using a hybrid neural network hidden Markov model (NN-HMM) for offline handwritten Chinese text recognition (HCTR). In the general Bayesian framework, the handwritten Chinese text line is sequentially modeled by HMMs with each representing one character class, while the NN-based classifier is adopted to calculate the posterior probability of all HMM states. The key issues in feature extraction, character modeling, and language modeling are comprehensively investigated to show the effectiveness of NN-HMM framework for offline HCTR. First, a conventional deep neural network (DNN) architecture is studied with a well-designed feature extractor. As for the training procedure, the label refinement using forced alignment and the sequence training can yield significant gains on top of the frame-level cross-entropy criterion. Second, a deep convolutional neural network (DCNN) with automatically learned discriminative features demonstrates its superiority to DNN in the HMM framework. Moreover, to solve the challenging problem of distinguishing quite confusing classes due to the large vocabulary of Chinese characters, NN-based classifier should output 19900 HMM states as the classification units via a high-resolution modeling within each character. On the ICDAR 2013 competition task of CASIA-HWDB database, DNN-HMM yields a promising character error rate (CER) of 5.24% by making a good trade-off between the computational complexity and recognition accuracy. To the best of our knowledge, DCNN-HMM can achieve a best published CER of 3.53%.

Deep Convolutional Neural Networks Based on Knowledge Distillation for Offline Handwritten Chinese Character Recognition

Improved Deep Convolutional Neural Network For Online Handwritten Chinese Character Recognition using Domain-Specific Knowledge

Deep networks for online handwriting Chinese character recognition

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

A Light and Discriminative Deep Networks for Off-Line Handwritten Chinese Character Recognition

Research on Offline Handwritten Chinese Character Recognition Based on Deep Learning

High Performance Offline Handwritten Chinese Character Recognition Using GoogLeNet and Directional Feature Maps

Deep Matching Network for Handwritten Chinese Character Recognition

Offline Handwritten Chinese Character Using Convolutional Neural Network: State-of-the-Art Methods

A Residual-Attention Offline Handwritten Chinese Text Recognition Based on Fully Convolutional Neural Networks.

A Modified Inception-ResNet Network with Discriminant Weighting Loss for Handwritten Chinese Character Recognition

A Study of Designing Compact Classifiers Using Deep Neural Networks for Online Handwritten Chinese Character Recognition

Building Fast and Compact Convolutional Neural Networks for Offline Handwritten Chinese Character Recognition

Offline Handwritten Chinese Character Recognition Based on New Training Methodology

Offline Handwritten Chinese Text Recognition with Convolutional Neural Networks

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Recognition of Off-line Handwritten Chinese Character Based on Deep Residual Network

Joint architecture and knowledge distillation in CNN for Chinese text recognition

Similar Handwritten Chinese Character Recognition Based on Deep Neural Networks with Big Data

A high-performance CNN method for offline handwritten Chinese character recognition and visualization

DropSample: A New Training Method to Enhance Deep Convolutional Neural Networks for Large-Scale Unconstrained Handwritten Chinese Character Recognition