Abstract:Recently, the hybrid convolutional neural network hidden Markov model (CNN-HMM) has been introduced for offline handwritten Chinese text recognition (HCTR) and has achieved state-of-the-art performance. However, modeling each of the large vocabulary of Chinese characters with a uniform and fixed number of hidden states requires high memory and computational costs and makes the tens of thousands of HMM state classes confusing. Another key issue of CNN-HMM for HCTR is the diversified writing style, which leads to model strain and a significant performance decline for specific writers. To address these issues, we propose a writer-aware CNN based on parsimonious HMM (WCNN-PHMM). First, PHMM is designed using a data-driven state-tying algorithm to greatly reduce the total number of HMM states, which not only yields a compact CNN by state sharing of the same or similar radicals among different Chinese characters but also improves the recognition accuracy due to the more accurate modeling of tied states and the lower confusion among them. Second, WCNN integrates each convolutional layer with one adaptive layer fed by a writer-dependent vector, namely, the writer code, to extract the irrelevant variability in writer information to improve recognition performance. The parameters of writer-adaptive layers are jointly optimized with other network parameters in the training stage, while a multiple-pass decoding strategy is adopted to learn the writer code and generate recognition results. Validated on the ICDAR 2013 competition of CASIA-HWDB database, the more compact WCNN-PHMM of a 7360-class vocabulary can achieve a relative character error rate (CER) reduction of 16.6% over the conventional CNN-HMM without considering language modeling. By adopting a powerful hybrid language model (N-gram language model and recurrent neural network language model), the CER of WCNN-PHMM is reduced to 3.17%.

Analyzing the Information Entropy of States to Optimize the Number of States in an Hmm-Based Off-Line Handwritten Arabic Word Recognizer

Off- Line Chinese Writer Identification Based on Character-Level Decision Combination

On-line Handwritten Recognition with Optimized GDTW-SVM Algoriyhm

HMM State Estimation Based on Two-Pass Character Alignment in Arabic Recognition

Parsimonious HMMs for Offline Handwritten Chinese Text Recognition

Exploring More Representative States of Hidden Markov Model in Optical Character Recognition: A Clustering-Based Model Pre-Training Approach

THE APPLICATION OF HMMs CONSISTING OF DIFFERENT NUMBER STATES IN CHINESE SIGN LANGUAGE RECOGNITION

Self-adaptive Design of Hidden Markov Models

A new approach for off-line handwritten Chinese character recognition using self-adaptive HMM

The Optimal Selecting for HMM State-number in Mandarin Continuous Speech

Boosting the Expense and Performance of Ann／Hmm Approch for On-Line Handwriting Recognition

Combination of Global and Local Baseline-Independent Features for Offline Arabic Handwriting Recognition.

Offline handwritten arabic character segmentation with probabilistic model

Segmentation-Driven Offline Handwritten Chinese And Arabic Script Recognition

A HMM Based On-line Chinese Character Recognition System and Improved Training Algorithm

A Novel Short Merged Off-line Handwritten Chinese Character String Segmentation Algorithm Using Hidden Markov Model

An Effective Approach to Offline Arabic Handwriting Recognition

Baseline-independent feature extraction for Arabic writing

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

An Efficient Hidden Markov Model for Offline Handwritten Numeral Recognition

Writer-Aware CNN for Parsimonious HMM-Based Offline Handwritten Chinese Text Recognition