Abstract:Online and offline handwritten Chinese text recognition (HTCR) has been studied for decades. Early methods adopted oversegmentation-based strategies but suffered from low speed, insufficient accuracy, and high cost of character segmentation annotations. Recently, segmentation-free methods based on connectionist temporal classification (CTC) and attention mechanism, have dominated the field of HCTR. However, people actually read text character by character, especially for ideograms such as Chinese. This raises the question: are segmentation-free strategies really the best solution to HCTR? To explore this issue, we propose a new segmentation-based method for recognizing handwritten Chinese text that is implemented using a simple yet efficient fully convolutional network. A novel weakly supervised learning method is proposed to enable the network to be trained using only transcript annotations; thus, the expensive character segmentation annotations required by previous segmentation-based methods can be avoided. Owing to the lack of context modeling in fully convolutional networks, we propose a contextual regularization method to integrate contextual information into the network during the training stage, which can further improve the recognition performance. Extensive experiments conducted on four widely used benchmarks, namely CASIA-HWDB, CASIA-OLHWDB, ICDAR2013, and SCUT-HCCDoc, show that our method significantly surpasses existing methods on both online and offline HCTR, and exhibits a considerably higher inference speed than CTC/attention-based approaches.

Transcript Mapping for Handwritten Text Lines Using Conditional Random Fields

Handwritten Chinese/Japanese text recognition using semi-Markov conditional random fields

Transcript Mapping for Handwritten Chinese Documents by Integrating Character Recognition Model and Geometric Context

The Automatic Extraction of Temporal Relation from Chinese Narrative Medical Records Using Conditional Random Fields

Hidden Markov random field based approach for off-line handwritten Chinese character recognition

An Improved Scene Text Extraction Method Using Conditional Random Field and Optical Character Recognition

Hmmrf: A Stochastic Model For Offline Handwritten Chinese Character Recognition

Chinese Text Chunking Based CRF

An approach for handwritten Chinese text recognition unifying character segmentation and recognition

Fully Convolutional Recurrent Network for Handwritten Chinese Text Recognition

Sparse Higher Order Conditional Random Fields for Improved Sequence Labeling.

Markov random field-based statistical character structure modeling for handwritten Chinese character recognition

Automatic Labeling of Semantic Role on Chinese FrameNet Using Conditional Random Fields.

Recognition of Handwritten Chinese Text by Segmentation: A Segment-annotation-free Approach

Semi-supervised training for conditional random fields with pseudo auxiliary task.

Word Recognition with Deep Conditional Random Fields

Neural CRF transducers for sequence labeling

International Conference on Machine Learning and Cybernetics , Hong Kong , 19-22 August 2007 HMM-BASED SYSTEM FOR TRANSCRIBING CHINESE HANDWRITING

A conditional random field model for image parsing.

Handwritten Chinese Text Recognition by Integrating Multiple Contexts

Encyclopedia Text Topic Segmentation Based on CRF