Abstract:Compared with human-computer interaction in terms of optical and speech signals, inertial sensor-based handwriting recognition shows more competitive due to low power consumption, independence of environment, and portable wearing. However, recognizing handwriting characters under usual habits in continuous writing motion is quite challenging as it is hard to accurately extract data segments of characters from a continuous inertial data stream. Considering the cumbersome manual annotation of segmentation points in inertial data streams, we propose a trajectory upheaval network (TUN), which can be trained on unlabeled data and achieve character segmentation in successive writing motions. Furthermore, considering that individual writing habits lead to various stroke orders and ill-formed writing, we then propose a cooperation-competition learning (CCL) model, which fuses the features of writing trajectory morphology and the inertial dynamic signal, to recognize the semantics of these character motions with successes. The CCL guides a competing mechanism of the two features to avoid a collaborative degradation phenomenon while their mutual learning promotes the efficient fusion of two features to achieve optimal recognition performance. The extensive experiments illustrate that our TUN-CCL model achieves the final recognition accuracy of 98.6% for 62 English-number characters without requirements on stroke order and writing habits. The comparative experiment and ablation experiment validate the effectiveness of our method, which exhibits potential application prospects in human-computer interaction.

DEVICE AND METHOD FOR INPUTTING ONE-DIMENSIONAL HANDWRITTEN TEXT

Space Handwriting Character Recognition Method Based on Elimination of Connected Stroke

SmartWriting: Pen-Holding Gesture Recognition with Smartwatch

One-Dimensional Handwriting: Inputting Letters and Words on Smart Glasses.

AirText: One-Handed Text Entry in the Air for COTS Smartwatches

SmartGe: Identifying Pen-Holding Gesture with Smartwatch.

SmartHandwriting: Handwritten Chinese Character Recognition with Smartwatch.

Text input method and electronic device

Enable Traditional Laptops with Virtual Writing Capability Leveraging Acoustic Signals.

Reconstructing Multi-Stroke Characters from Brain Signals Toward Generalizable Handwriting Brain-Computer Interfaces

Method for generating individualized digital ink of Chinese characters

Motion-Based Handwriting Recognition

DEVICE DESIGN FOR THE NOVEL HANDWRITING RECOGNITION SYSTEM

Handwriting Chinese Character Computer Writer Identification Based on Stroke——Computer Writer Identification Based on Motion Feature,First and Last Feature

Tap, Dwell or Gesture?: Exploring Head-Based Text Entry Techniques for HMDs.

Handwriting Input System Based on Ultrasonic Transducers

Handwriting Recognition under Natural Writing Habits based on A Low-cost Inertial Sensor

Handwriting recognition training and synthesis

The effects of human finger and Chinese character on Chinese handwriting performance on mobile touch devices.

Handwriting-Assistant: Reconstructing Continuous Strokes with Millimeter-level Accuracy via Attachable Inertial Sensors

Handwriting-Assistant