Abstract:Stroke extraction and matching are critical for structural interpretation based applications of handwritten Chinese characters, such as Chinese character education and calligraphy analysis. Stroke extraction from offline handwritten Chinese characters is difficult because of the missing of temporal information, the multi-stroke structures and the distortion of handwritten shapes. In this paper, we propose a comprehensive scheme for solving the stroke extraction problem for handwritten Chinese characters. The method consists of three main steps: (1) fully convolutional network (FCN) based skeletonization; (2) query pixel guided stroke extraction; (3) model-based stroke matching. Specifically, based on a recently proposed architecture of FCN, both the stroke skeletons and cross regions are firstly extracted from the character image by the proposed SkeNet and CrossNet, respectively. Stroke extraction is solved by simulating the human perception that once given a certain pixel from non-cross region of a stroke, the whole stroke containing the pixel can be traced. To realize this idea, we formulate stroke extraction as a problem of pairing and connecting skeleton-wise stroke segments which are adjacent to the same cross region, where the pairing consistency between stroke segments is measured using a PathNet [1]. To reduce the ambiguity of stroke extraction, the extracted candidate strokes are matched with a character model consisting of standard strokes by tree search to identify the correct strokes. For verifying the effectiveness of the proposed method, we train and test our models on character images with stroke segmentation annotations generated from the online handwriting datasets CASIA-OLHWDB and ICDAR13-Online, as well as a dataset of Regularly-Written online handwritten characters (RW-OLHWDB). The experimental results demonstrate the effectiveness of the proposed method and provide several benchmarks. Particularly, the precisions of stroke extraction for ICDAR13-Online and RW-OLHWDB are 89.0% and 94.9%, respectively.

A Sparse Projection and Low-Rank Recovery Framework for Handwriting Representation and Salient Stroke Feature Extraction

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Robust auto-weighted projective low-rank and sparse recovery for visual representation

RAP: Scalable RPCA for Low-rank Matrix Recovery

RES-PCA: A Scalable Approach to Recovering Low-Rank Matrices

Deep Network with Pixel-Level Rectification and Robust Training for Handwriting Recognition

Robust Image Restoration via Reweighted Low-Rank Matrix Recovery

Low-rank Representation Integrated with Principal Line Distance for Contactless Palmprint Recognition

Adaptive Structure-constrained Robust Latent Low-Rank Coding for Image Recovery

Robust High-Order Manifold Constrained Sparse Principal Component Analysis for Image Representation

Tensorized Multi-View Low-Rank Approximation Based Robust Hand-Print Recognition

Robust and Sparse Least Square Regression for Finger Vein and Finger Knuckle Print Recognition

CSSL-RHA: Contrastive Self-Supervised Learning for Robust Handwriting Authentication

Query Pixel Guided Stroke Extraction with Model-Based Matching for Offline Handwritten Chinese Characters

Robust sparse low-rank embedding for image dimension reduction

Correntropy-Induced Discriminative Nonnegative Sparse Coding for Robust Palmprint Recognition

Handwritten Numeral Recognition Based On Nonlinear Subspace Method

Robust principal component analysis for sparse face recognition

Structure Preserving Projections Learning Via Low-Rank Embedding for Image Classification

Stroke Extraction of Chinese Character Based on Deep Structure Deformable Image Registration

Structure Suture Learning-Based Robust Multiview Palmprint Recognition.