Abstract:This paper proposes a method for handwritten Chinese/Japanese text (character string) recognition based on semi-Markov conditional random fields (semi-CRFs). The high-order semi-CRF model is defined on a lattice containing all possible segmentation-recognition hypotheses of a string to elegantly fuse the scores of candidate character recognition and the compatibilities of geometric and linguistic contexts by representing them in the feature functions. Based on given models of character recognition and compatibilities, the fusion parameters are optimized by minimizing the negative log-likelihood loss with a margin term on a training string sample set. A forward-backward lattice pruning algorithm is proposed to reduce the computation in training when trigram language models are used, and beam search techniques are investigated to accelerate the decoding speed. We evaluate the performance of the proposed method on unconstrained online handwritten text lines of three databases. On the test sets of databases CASIA-OLHWDB (Chinese) and TUAT Kondate (Japanese), the character level correct rates are 95.20 and 95.44 percent, and the accurate rates are 94.54 and 94.55 percent, respectively. On the test set (online handwritten texts) of ICDAR 2011 Chinese handwriting recognition competition, the proposed method outperforms the best system in competition.

Applying conditional random fields on Chinese syllable recognition

Conditional Random Fields Based Label Sequence and Information Feedback

Exploiting Prosodic and Lexical Features for Tone Modeling in A Conditional Random Field Framework

Context Dependent Syllable Acoustic Model For Continuous Chinese Speech Recognition

Chinese Text Chunking Based CRF

Hybrid Semi-Markov CRF for Neural Sequence Labeling.

A method for Chinese syllables recognition based upon sub-syllable hidden Markov model

A Hybrid Model Based on CRFs for Chinese Named Entity Recognition

Chinese Named Entity Recognition with the Improved Smoothed Conditional Random Fields

Automatic segmentation of Chinese Mandarin speech into syllable-like

Chinese unknown word recognition using improved conditional random fields

Handwritten Chinese/Japanese text recognition using semi-Markov conditional random fields

Masked Conditional Random Fields for Sequence Labeling

Conditional Random Fields Based POS Tagging

Transcript Mapping for Handwritten Text Lines Using Conditional Random Fields

Chinese named entity recognition: a CRF approach based on word triggers information

Using Conditional Random Fields to Predict Focus Word Pair in Spontaneous Spoken English

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

Deep neural networks for syllable based acoustic modeling in Chinese speech recognition.

Gradual Transition Detection with Conditional Random Fields.

Learning Conditional Random Field with Hierarchical Representations for Dialogue Act Recognition