Abstract:Air-writing is a modern human–computer interaction technology that allows participants to write words or letters with finger or hand movements in free space in a simple and intuitive manner. Air-writing recognition is a particular case of gesture recognition in which gestures can be matched to write characters and digits in the air. Air-written characters show extensive variations depending on the various writing styles of participants and their speed of articulation, which presents quite a difficult task for effective character recognition. In order to solve these difficulties, this current work proposes an air-writing system using a web camera. The proposed system consists of two parts: alphabetic recognition and digit recognition. In order to assess our proposed system, two character datasets were used: an alphabetic dataset and a numeric dataset. We collected samples from 17 participants and asked each participant to write alphabetic characters (A to Z) and numeric digits (0 to 9) about 5–10 times. At the same time, we recorded the position of the fingertips using MediaPipe. As a result, we collected 3166 samples for the alphabetic dataset and 1212 samples for the digit dataset. First, we preprocessed the dataset and then created two datasets: image data and padding sequential data. The image data were fed into the convolution neural networks (CNN) model, whereas the sequential data were fed into bidirectional long short-term memory (BiLSTM). After that, we combined these two models and trained again with 5-fold cross-validation in order to increase the character recognition accuracy. In this work, this combined model is referred to as a hybrid deep learning model. Finally, the experimental results showed that our proposed system achieved an alphabet recognition accuracy of 99.3% and a digit recognition accuracy of 99.5%. We also validated our proposed system using another publicly available 6DMG dataset. Our proposed system provided better recognition accuracy compared to the existing system.

Enhancing 3D-Air Signature by Pen Tip Tail Trajectory Awareness: Dataset and Featuring by Novel Spatio-temporal CNN

DeepAirSig: End-to-End Deep Learning Based in-Air Signature Verification

Sketch-R2CNN: an Attentive Network for Vector Sketch Recognition

Signature Detection, Restoration, and Verification: A Novel Chinese Document Signature Forgery Detection Benchmark

TARNet: An Efficient and Lightweight Trajectory-Based Air-Writing Recognition Model Using a CNN and LSTM Network

3DAirSig: A Framework for Enabling In-Air Signatures Using a Multi-Modal Depth Sensor

Synthesis of 3D on-air signatures with the Sigma-Lognormal model

Fingertip Detection and Tracking for Recognition of Air-Writing in Videos

Multi-dilation Convolutional Neural Network for Automatic Handwritten Signature Verification

Synchronous spatio-temporal signature verification via Fusion Triplet Supervised Network

DeepHSV: User-Independent Offline Signature Verification Using Two-Channel CNN

A Novel Trajectory Prediction Method Based on CNN, BiLSTM, and Multi-Head Attention Mechanism

Sparse arrays of signatures for online character recognition

2D Camera-Based Air-Writing Recognition Using Hand Pose Estimation and Hybrid Deep Learning Model

Deep Learning Methods for Signature Verification

SigScatNet: A Siamese + Scattering based Deep Learning Approach for Signature Forgery Detection and Similarity Assessment

Air Signing and Privacy-Preserving Signature Verification for Digital Documents

Sim2Air - Synthetic aerial dataset for UAV monitoring

Offline signature verification using deep neural network with application to computer vision

Chebyshev-Harmonic-Fourier-Moments and Deep CNNs for Detecting Forged Handwriting

A novel hand gesture detection and recognition system based on ensemble-based convolutional neural network