Abstract:Single online handwritten Chinese character recognition~(single OLHCCR) has achieved prominent performance. However, in real application scenarios, users always write multiple Chinese characters to form one complete sentence and the contextual information within these characters holds the significant potential to improve the accuracy, robustness and efficiency of sentence-level OLHCCR. In this work, we first propose a simple and straightforward end-to-end network, namely vanilla compositional network~(VCN) to tackle the sentence-level OLHCCR. It couples convolutional neural network with sequence modeling architecture to exploit the handwritten character's previous contextual information. Although VCN performs much better than the state-of-the-art single OLHCCR model, it exposes high fragility when confronting with not well written characters such as sloppy writing, missing or broken strokes. To improve the robustness of sentence-level OLHCCR, we further propose a novel deep spatial-temporal fusion network~(DSTFN). It utilizes a pre-trained autoregresssive framework as the backbone component, which projects each Chinese character into word embeddings, and integrates the spatial glyph features of handwritten characters and their contextual information multiple times at multi-layer fusion module. We also construct a large-scale sentence-level handwriting dataset, named as CSOHD to evaluate models. Extensive experiment results demonstrate that DSTFN achieves the state-of-the-art performance, which presents strong robustness compared with VCN and exiting single OLHCCR models. The in-depth empirical analysis and case studies indicate that DSTFN can significantly improve the efficiency of handwriting input, with the handwritten Chinese character with incomplete strokes being recognized precisely.

Combinatorial Coarse Classification Method for OLCCR.

Online Discriminative Dictionary Learning for Image Classification Based on Block-Coordinate Descent Method

Recognition of A Limited Chinese Character Set Based on Improved CLAFIC-LSM Algorithm

Recognition of a Limited Chinese Character Set Based on PCA Learning Subspace Algorithm

New method of combining multiple classifiers for Chinese character recognition

Pairwise Classifier Combination and Its Application on Chinese Character Recognition

Adaptive Confidence Transform Based Classifier Combination For Chinese Character Recognition

Chinese Character Recognition with Augmented Character Profile Matching

Pre-merger Method of Chinese Online Handwritten Text Based on Classification

Evaluation and application of recognition confidence in OCR

An Efficient Post-Processing Approach for Off-Line Handwritten Chinese Address Recognition

A Discriminative Linear Regression Approach to OCR Adaptation

OCR Result Optimization Based on Pattern Matching.

On-line Chinese Character Recognition System for Overlapping Samples

A Chinese Character-Level and Word-Level Complementary Text Classification Method.

Designing compact classifiers for rotation-free recognition of large vocabulary online handwritten Chinese characters

Realization of a high-performance bilingual Chinese-English OCR system

A Two-Stage Scheme Based on Block Search for Low-Quality Chinese Character

Sentence-level Online Handwritten Chinese Character Recognition

A modified Adaboost algorithm for Chinese handwritten character recognition

Toward high-performance online HCCR: a CNN approach with DropDistortion, path signature and spatial stochastic max-pooling