Abstract:This paper proposes an effective segmentation-free approach using a hybrid neural network hidden Markov model (NN-HMM) for offline handwritten Chinese text recognition (HCTR). In the general Bayesian framework, the handwritten Chinese text line is sequentially modeled by HMMs with each representing one character class, while the NN-based classifier is adopted to calculate the posterior probability of all HMM states. The key issues in feature extraction, character modeling, and language modeling are comprehensively investigated to show the effectiveness of NN-HMM framework for offline HCTR. First, a conventional deep neural network (DNN) architecture is studied with a well-designed feature extractor. As for the training procedure, the label refinement using forced alignment and the sequence training can yield significant gains on top of the frame-level cross-entropy criterion. Second, a deep convolutional neural network (DCNN) with automatically learned discriminative features demonstrates its superiority to DNN in the HMM framework. Moreover, to solve the challenging problem of distinguishing quite confusing classes due to the large vocabulary of Chinese characters, NN-based classifier should output 19900 HMM states as the classification units via a high-resolution modeling within each character. On the ICDAR 2013 competition task of CASIA-HWDB database, DNN-HMM yields a promising character error rate (CER) of 5.24% by making a good trade-off between the computational complexity and recognition accuracy. To the best of our knowledge, DCNN-HMM can achieve a best published CER of 3.53%.

Irrelevant Variability Normalization Via Hierarchical Deep Neural Networks for Online Handwritten Chinese Character Recognition.

An Irrelevant Variability Normalization Approach to Discriminative Training of Multi-Prototype Based Classifiers and Its Applications for Online Handwritten Chinese Character Recognition.

Hierarchical Deep Neural Network for Multivariate Regression

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

A Study of Designing Compact Classifiers Using Deep Neural Networks for Online Handwritten Chinese Character Recognition

A New Hybrid-parameter Recurrent Neural Networks for Online Handwritten Chinese Character Recognition

Improved Deep Convolutional Neural Network For Online Handwritten Chinese Character Recognition using Domain-Specific Knowledge

Deep Convolutional Neural Networks Based on Knowledge Distillation for Offline Handwritten Chinese Character Recognition

DeepHSV: User-Independent Offline Signature Verification Using Two-Channel CNN

Deep Network with Pixel-Level Rectification and Robust Training for Handwriting Recognition

Writer Adaptation Via Deeply Learned Features for Online Chinese Handwriting Recognition

A Stroke-Based RNN for Writer-Independent Online Signature Verification.

Writer Adaptation Using Bottleneck Features and Discriminative Linear Regression for Online Handwritten Chinese Character Recognition

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition

Writer Adaptive Feature Extraction Based on Convolutional Neural Networks for Online Handwritten Chinese Character Recognition

Writer Code Based Adaptation of Deep Neural Network for Offline Handwritten Chinese Text Recognition.

Adversarial Attack and Defence on Handwritten Chinese Character Recognition

Integrating Canonical Neural Units and Multi-Scale Training for Handwritten Text Recognition

Deep Matching Network for Handwritten Chinese Character Recognition

A Residual-Attention Offline Handwritten Chinese Text Recognition Based on Fully Convolutional Neural Networks.