Abstract:Single online handwritten Chinese character recognition~(single OLHCCR) has achieved prominent performance. However, in real application scenarios, users always write multiple Chinese characters to form one complete sentence and the contextual information within these characters holds the significant potential to improve the accuracy, robustness and efficiency of sentence-level OLHCCR. In this work, we first propose a simple and straightforward end-to-end network, namely vanilla compositional network~(VCN) to tackle the sentence-level OLHCCR. It couples convolutional neural network with sequence modeling architecture to exploit the handwritten character's previous contextual information. Although VCN performs much better than the state-of-the-art single OLHCCR model, it exposes high fragility when confronting with not well written characters such as sloppy writing, missing or broken strokes. To improve the robustness of sentence-level OLHCCR, we further propose a novel deep spatial-temporal fusion network~(DSTFN). It utilizes a pre-trained autoregresssive framework as the backbone component, which projects each Chinese character into word embeddings, and integrates the spatial glyph features of handwritten characters and their contextual information multiple times at multi-layer fusion module. We also construct a large-scale sentence-level handwriting dataset, named as CSOHD to evaluate models. Extensive experiment results demonstrate that DSTFN achieves the state-of-the-art performance, which presents strong robustness compared with VCN and exiting single OLHCCR models. The in-depth empirical analysis and case studies indicate that DSTFN can significantly improve the efficiency of handwriting input, with the handwritten Chinese character with incomplete strokes being recognized precisely.

Radical aggregation network for few-shot offline handwritten Chinese character recognition

DenseRAN for Offline Handwritten Chinese Character Recognition

Radical Counter Network for Robust Chinese Character Recognition

Trajectory-based Radical Analysis Network for Online Handwritten Chinese Character Recognition

Radical Analysis Network for Zero-Shot Learning in Printed Chinese Character Recognition

Rare Chinese Character Recognition by Radical Extraction Network

A Transformer-based Radical Analysis Network for Chinese Character Recognition

Joint Spatial and Radical Analysis Network for Distorted Chinese Character Recognition

Chinese character recognition with radical-structured stroke trees

RZCR: Zero-shot Character Recognition via Radical-based Reasoning

Hippocampus-heuristic Character Recognition Network for Zero-shot Learning

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Zero-Shot Offline Handwritten Chinese Character Recognition with Graph Embedding.

Zero-Shot Chinese Character Recognition with Stroke-Level Decomposition

Self-information of radicals: A new clue for zero-shot Chinese character recognition

Zero-shot Handwritten Chinese Character Recognition with hierarchical decomposition embedding

Radical-Enhanced Chinese Character Embedding

Radical Composition Network for Chinese Character Generation

Toward Zero-shot Character Recognition: A Gold Standard Dataset with Radical-level Annotations

Learning Spatial-Semantic Context with Fully Convolutional Recurrent Network for Online Handwritten Chinese Text Recognition

Sentence-level Online Handwritten Chinese Character Recognition