Abstract:Single online handwritten Chinese character recognition~(single OLHCCR) has achieved prominent performance. However, in real application scenarios, users always write multiple Chinese characters to form one complete sentence and the contextual information within these characters holds the significant potential to improve the accuracy, robustness and efficiency of sentence-level OLHCCR. In this work, we first propose a simple and straightforward end-to-end network, namely vanilla compositional network~(VCN) to tackle the sentence-level OLHCCR. It couples convolutional neural network with sequence modeling architecture to exploit the handwritten character's previous contextual information. Although VCN performs much better than the state-of-the-art single OLHCCR model, it exposes high fragility when confronting with not well written characters such as sloppy writing, missing or broken strokes. To improve the robustness of sentence-level OLHCCR, we further propose a novel deep spatial-temporal fusion network~(DSTFN). It utilizes a pre-trained autoregresssive framework as the backbone component, which projects each Chinese character into word embeddings, and integrates the spatial glyph features of handwritten characters and their contextual information multiple times at multi-layer fusion module. We also construct a large-scale sentence-level handwriting dataset, named as CSOHD to evaluate models. Extensive experiment results demonstrate that DSTFN achieves the state-of-the-art performance, which presents strong robustness compared with VCN and exiting single OLHCCR models. The in-depth empirical analysis and case studies indicate that DSTFN can significantly improve the efficiency of handwriting input, with the handwritten Chinese character with incomplete strokes being recognized precisely.

High Performance Offline Handwritten Chinese Text Recognition with a New Data Preprocessing and Augmentation Pipeline

Offline Handwritten Chinese Text Recognition with Convolutional Neural Networks

Recognition of Handwritten Chinese Text by Segmentation: A Segment-annotation-free Approach

Towards Fast, Accurate and Compact Online Handwritten Chinese Text Recognition

Increasing Offline Handwritten Chinese Character Recognition Using Separated Pre-Training Models: A Computer Vision Approach

A Residual-Attention Offline Handwritten Chinese Text Recognition Based on Fully Convolutional Neural Networks.

Deep Network with Pixel-Level Rectification and Robust Training for Handwriting Recognition

Offline Handwritten Chinese Character Using Convolutional Neural Network: State-of-the-Art Methods

Toward high-performance online HCCR: a CNN approach with DropDistortion, path signature and spatial stochastic max-pooling

SegCTC: Offline Handwritten Chinese Text Recognition Via Better Fusion Between Explicit and Implicit Segmentation

Research on Offline Handwritten Chinese Character Recognition Based on Deep Learning

Convolutional Multi-directional Recurrent Network for Offline Handwritten Text Recognition

Offline Handwritten Text Recognition Based On Ctc-Attention

Deep LSTM Networks for Online Chinese Handwriting Recognition

Learning Spatial-Semantic Context with Fully Convolutional Recurrent Network for Online Handwritten Chinese Text Recognition

A Fast and Accurate Fully Convolutional Network for End-to-End Handwritten Chinese Text Segmentation and Recognition

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Building Efficient CNN Architecture for Offline Handwritten Chinese Character Recognition

Sentence-level Online Handwritten Chinese Character Recognition

Building Fast and Compact Convolutional Neural Networks for Offline Handwritten Chinese Character Recognition

Fully Convolutional Recurrent Network for Handwritten Chinese Text Recognition