Abstract:Compared with human-computer interaction in terms of optical and speech signals, inertial sensor-based handwriting recognition shows more competitive due to low power consumption, independence of environment, and portable wearing. However, recognizing handwriting characters under usual habits in continuous writing motion is quite challenging as it is hard to accurately extract data segments of characters from a continuous inertial data stream. Considering the cumbersome manual annotation of segmentation points in inertial data streams, we propose a trajectory upheaval network (TUN), which can be trained on unlabeled data and achieve character segmentation in successive writing motions. Furthermore, considering that individual writing habits lead to various stroke orders and ill-formed writing, we then propose a cooperation-competition learning (CCL) model, which fuses the features of writing trajectory morphology and the inertial dynamic signal, to recognize the semantics of these character motions with successes. The CCL guides a competing mechanism of the two features to avoid a collaborative degradation phenomenon while their mutual learning promotes the efficient fusion of two features to achieve optimal recognition performance. The extensive experiments illustrate that our TUN-CCL model achieves the final recognition accuracy of 98.6% for 62 English-number characters without requirements on stroke order and writing habits. The comparative experiment and ablation experiment validate the effectiveness of our method, which exhibits potential application prospects in human-computer interaction.

Design of handwriting information acquisition system based on multi-dimensional force sensor

Palmprint identification system based on ARM and WinCE

KinWrite: Handwriting-Based Authentication Using Kinect.

Flexible Capacitive Three-Dimensional Force Sensor for Hand Motion Capture and Handwriting Recognition

Design and Implementation of Handwritten Manchu Alphabet Acquisition System

Fingerprint-inspired Dual-mode Pressure Sensor for Robotic Static and Dynamic Perception

Development of Robotic Hand Tactile Sensing System for Distributed Contact Force Sensing in Robotic Dexterous Multimodal Grasping

Motion-Based Handwriting Recognition

Handwriting-Assistant: Reconstructing Continuous Strokes with Millimeter-level Accuracy via Attachable Inertial Sensors

Handwriting-Assistant

Toward Force-Based Signature Verification: A Pen-Type Sensor and Preliminary Validation

DEVICE DESIGN FOR THE NOVEL HANDWRITING RECOGNITION SYSTEM

TheDesign Ofdigital Handwriting Forces Vector Inkand Its Application Inonline Signature Verification

Design and Implementation of A Contactless Multiple Hand Feature Acquisition System

Research on Data Acquisition System of Six-Dimensional Force Sensor

Design and Implementation of Handwritten Character Recognition System Based on the Embedded System

Handwriting Input System Based on Ultrasonic Transducers

An Effective Robust Fingertip Detection Method For Finger Writing Character Recognition System

Handwriting Recognition under Natural Writing Habits based on A Low-cost Inertial Sensor

Design and Implementation of Embedded Handwritten Manchu Letter Recognition System*

Signature verification using handwriting friction force