Abstract:Despite rapid advancements in technology, handwritten characters still hold significant roles in various fields, including education, communication, biometric signature verification, and health care. These applications often require digitization of the handwritten characters and associated hand movements to facilitate effective analysis and interpretation of the underlying task. Offline and online handwriting recognition are crucial steps involving the digitization of handwritten characters. Most of these existing systems actively use image processing techniques that are highly sensitive to environmental lighting conditions. Surface Electromyography signals (sEMG), being invariant to lighting conditions, are used in online handwriting recognition to facilitate the automatic transcription of handwritten characters. In this article, we have leveraged deep representation learning to build an efficient and robust sEMG-based Handwritten Character Recognition (HCR) pipeline. A Stacked sparse denoising autoencoder network is applied to obtain an effective deep feature representation. These rich low dimensional features obtained are further introduced into basic classifiers, producing state-of-the-art accuracy for the task. Additional experiments were performed to analyze the effect of the fusion of complementary sensing modules (Accelerometer and Gyroscope) on the performance of sEMG based HCR pipeline. Extensive evaluations were performed to ensure the validity of the obtained results. For the experimentation, new datasets consisting of sEMG, Accelerometer, and Gyroscope signals corresponding to 26 handwritten lower English alphabets were collected from 15 subjects. Our proposed pipeline can be used to build real-time Human–Computer Interaction(HCI) applications for smart classrooms facilitating digitization of handwritten notes and clinical applications involving handwriting analysis tasks.

A Multi-Scale Bimodal Fusion Network for Robust and Accurate Online Handwriting Recognition.

Improving Online Gesture Recognition with WarpingLCSS by Multi-Sensor Fusion

Content-Independent Online Handwriting Verification Based on Multi-Modal Fusion.

Acid Reactivity of Carbonated Apatites with Strontium and Fluoride Substitutions

Motion-Based Handwriting Recognition

Handwriting Recognition under Natural Writing Habits based on A Low-cost Inertial Sensor

A New Hybrid-Parameter Recurrent Neural Network for Online Handwritten Chinese Character Recognition

Multi-modal fusion for robust hand gesture recognition based on heterogeneous networks

Multiple classifiers fusion and CNN feature extraction for handwritten digits recognition

Method for Visualizing Filaments in Axoplasm by Electron Microscopy.

A Stroke-Based RNN for Writer-Independent Online Signature Verification.

Object Detection Based Handwriting Localization

Deep Network with Pixel-Level Rectification and Robust Training for Handwriting Recognition

Integrating Canonical Neural Units and Multi-Scale Training for Handwritten Text Recognition

Robust End-to-End Offline Chinese Handwriting Text Page Spotter with Text Kernel

A Lightweight Hand-Gesture Recognition Network With Feature Fusion Prefiltering and FMCW Radar Spatial Angle Estimation

Multi-Scale Attention 3D Convolutional Network for Multimodal Gesture Recognition

A Multimodal Dynamic Hand Gesture Recognition Based on Radar–Vision Fusion

Leveraging deep feature learning for wearable sensors based handwritten character recognition

Multiscale Feature Learning Using Co-Tuplet Loss for Offline Handwritten Signature Verification

A Novel Multi-Feature Fusion Network With Spatial Partitioning Strategy and Cross-Attention for Armband-Based Gesture Recognition