Abstract:We propose a novel model, called stroke sequence-dependent deep convolutional neural network (SSDCNN), which uses the stroke sequence information and eight-directional features of Chinese characters for online handwritten Chinese character recognition (OLHCCR). SSDCNN learns the representation of OLHCCs by incorporating the natural sequence information of the strokes. Furthermore, it naturally incorporates the eight-directional features. First, SSDCNN inputs the stroke sequence and transforms it into stacks of feature maps following the writing order of the strokes. Second, the fixed-length, stroke sequence-dependent representations of OLHCC are derived through convolutional, residual, and max-pooling operations. Third, the stroke sequence-dependent representation is combined with the eight-directional features via a number of fully connected neural network layers. Finally, the Chinese characters are recognized using a softmax classifier. The SSDCNN is trained in two stages: 1) the whole architecture is pretrained using the training data until the performance converges to an acceptable degree. 2) The stroke sequence-dependent representation is combined with the eight-directional features by a fully connected neural network and a softmax layer for further training. The model was experimentally evaluated on the OLHCCR competition tasks of International Conference on Document Analysis and Recognition (ICDAR) 2013. The recognition error was a maximum 58.28% lower in SSDCNN than in a model using the eight-directional features alone (5.13% versus 2.14%). Owing to its high accuracy (97.86%), the proposed SSDCNN reduced the recognition error by approximately 18.0% as compared with that of the winning system in the ICDAR 2013 competition. SSDCNN integrated with an adaptation mechanism, called the SSDCNN+Adapt model, and reached a new state-of-the-art (SOTA) stan-ard with an accuracy of 97.94%. The SSDCNN exploits the stroke sequence information to learn high-quality OLHCC representations. Moreover, the learned representation and the classical eight-directional features complement each other within the SSDCNN architecture.

Drawing Order Recovery For Handwriting Chinese Characters

Pen Tip Motion Prediction for Handwriting Drawing Order Recovery Using Deep Neural Network

A New Method for Stroke Order Recognition of Handwritten Chinese Characters

Two-Stage Fully Convolutional Networks for Stroke Recovery of Handwritten Chinese Character

Using CONDENSATION Tracking to Recover Stroke Order of Chinese Calligraphic Handwritings with CCM.

Online Chinese Handwriting Recognition with Time Sequence Information

Query Pixel Guided Stroke Extraction with Model-Based Matching for Offline Handwritten Chinese Characters

A character image restoration method for unconstrained handwritten Chinese character recognition

Stroke Extraction of Chinese Character Based on Deep Structure Deformable Image Registration

Extraction of the drawing order from static handwriting

Research Of 3d Chinese Calligraphic Handwriting Recur System And Its Key Algorithm

Recovery of stroke sequences from offline handwriting characters

A Stroke Order Verification Method for On-Line Handwritten Chinese Characters Based on Tempo-spatial Consistency Analysis

Stroke Sequence-Dependent Deep Convolutional Neural Network for Online Handwritten Chinese Character Recognition

Drawing and Recognizing Chinese Characters with Recurrent Neural Network

Occluded Offline Handwritten Chinese Character Inpainting Via Generative Adversarial Network and Self-Attention Mechanism

Generating Realistic Chinese Handwriting Characters via Deep Convolutional Generative Adversarial Networks.

Off-Line Chinese Handwriting Identification Based on Stroke Shape and Structure

A Fast Solution for Chinese Calligraphy Relief Modeling from 2D Handwriting Image

Complex Handwriting Trajectory Recovery: Evaluation Metrics and Algorithm

Stroke Correspondence Based On Graph Matching For Detecting Stroke Production Errors In Chinese Character Handwriting