Abstract:Recent deep learning based approaches have achieved great success on handwriting recognition. Chinese characters are among the most widely adopted writing systems in the world. Previous research has mainly focused on recognizing handwritten Chinese characters. However, recognition is only one aspect for understanding a language, another challenging and interesting task is to teach a machine to automatically write (pictographic) Chinese characters. In this paper, we propose a framework by using the recurrent neural network (RNN) as both a discriminative model for recognizing Chinese characters and a generative model for drawing (generating) Chinese characters. To recognize Chinese characters, previous methods usually adopt the convolutional neural network (CNN) models which require transforming the online handwriting trajectory into image-like representations. Instead, our RNN based approach is an end-to-end system which directly deals with the sequential structure and does not require any domain-specific knowledge. With the RNN system (combining an LSTM and GRU), state-of-the-art performance can be achieved on the ICDAR-2013 competition database. Furthermore, under the RNN framework, a conditional generative model with character embedding is proposed for automatically drawing recognizable Chinese characters. The generated characters (in vector format) are human-readable and also can be recognized by the discriminative RNN model with high accuracy. Experimental results verify the effectiveness of using RNNs as both generative and discriminative models for the tasks of drawing and recognizing Chinese characters.

An Algorithm of Bidirectional RNN for Offline Handwritten Chinese Text Recognition

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

A New Hybrid-parameter Recurrent Neural Networks for Online Handwritten Chinese Character Recognition

Drawing and Recognizing Chinese Characters with Recurrent Neural Network

Deep LSTM Networks for Online Chinese Handwriting Recognition

A Comprehensive Study of Hybrid Neural Network Hidden Markov Model for Offline Handwritten Chinese Text Recognition.

Hidden Markov random field based approach for off-line handwritten Chinese character recognition

Convolutional Multi-directional Recurrent Network for Offline Handwritten Text Recognition

A Residual-Attention Offline Handwritten Chinese Text Recognition Based on Fully Convolutional Neural Networks.

Offline Handwritten Chinese Text Recognition with Convolutional Neural Networks

Learning Spatial-Semantic Context with Fully Convolutional Recurrent Network for Online Handwritten Chinese Text Recognition

Online Chinese Handwriting Recognition with Time Sequence Information

Offline Handwritten Chinese Character Using Convolutional Neural Network: State-of-the-Art Methods

Deep Convolutional Neural Network Based Hidden Markov Model for Offline Handwritten Chinese Text Recognition

Fully Convolutional Recurrent Network for Handwritten Chinese Text Recognition

Recognition of Off-line Handwritten Chinese Character Based on Deep Residual Network

Offline Handwritten Chinese Character Recognition Based on New Training Methodology

Unconstrained Offline Handwritten Word Recognition by Position Embedding Integrated ResNets Model

End-to-end attention convolutional recurrent network for online handwritten Chinese text recognition

Increasing Offline Handwritten Chinese Character Recognition Using Separated Pre-Training Models: A Computer Vision Approach

Writer Adaptive Feature Extraction Based on Convolutional Neural Networks for Online Handwritten Chinese Character Recognition