Abstract:Compared with human-computer interaction in terms of optical and speech signals, inertial sensor-based handwriting recognition shows more competitive due to low power consumption, independence of environment, and portable wearing. However, recognizing handwriting characters under usual habits in continuous writing motion is quite challenging as it is hard to accurately extract data segments of characters from a continuous inertial data stream. Considering the cumbersome manual annotation of segmentation points in inertial data streams, we propose a trajectory upheaval network (TUN), which can be trained on unlabeled data and achieve character segmentation in successive writing motions. Furthermore, considering that individual writing habits lead to various stroke orders and ill-formed writing, we then propose a cooperation-competition learning (CCL) model, which fuses the features of writing trajectory morphology and the inertial dynamic signal, to recognize the semantics of these character motions with successes. The CCL guides a competing mechanism of the two features to avoid a collaborative degradation phenomenon while their mutual learning promotes the efficient fusion of two features to achieve optimal recognition performance. The extensive experiments illustrate that our TUN-CCL model achieves the final recognition accuracy of 98.6% for 62 English-number characters without requirements on stroke order and writing habits. The comparative experiment and ablation experiment validate the effectiveness of our method, which exhibits potential application prospects in human-computer interaction.

Feature extraction methods for handwritten character recognition based on acceleration

A handwritten character recognition system based on acceleration

Handwritten Character Recognition Using Orientation Quantization Based on 3D Accelerometer

3D Space Handwriting Recognition Feature Extraction Based on PCA and LDA Combination

Space Handwriting Character Recognition Method Based on Elimination of Connected Stroke

Chinese Handwriting Identification Based on Stable Spectral Feature of Texture Images

3D Space Handwriting Recognition Based on Time-frequency Fusion Feature

Real Time 3D-Handwritten Character and Gesture Recognition for Smartphone

2D-HMM BASED CHARACTER RECOGNITION OF THE ENGINEERING DRAWING

Gesture Recognition with a 3-D Accelerometer

Research on Automatic Recognition of Unconstratined Handwritten Digits

Handwritten character recognition using gradient feature and quadratic classifier with multiple discrimination schemes

A Novel Algorithm For Handwritten Chinese Character Recognition

Image iterative method for handwritten Chinese character recognition

Dynamic feature analysis of handwritten electronic signatures based on Fourier transform

Robust Feature Extraction For Character Recognition Based On Binary Images

Chinese Character Recognition with Augmented Character Profile Matching

A comparative study of different feature sets for recognition of handwritten Arabic numerals using a Multi Layer Perceptron

A neural network structure for feature extraction and recognition of handwritten digits

Handwriting Recognition under Natural Writing Habits based on A Low-cost Inertial Sensor

Offline handwritten arabic character segmentation with probabilistic model