Abstract:The uncertainty of hand gestures, the variability of gestures across subjects, and the high cost of collecting a large amount of annotated data lead to a great challenge to the robust recognition of gestures, and thus it remains quite crucial to capture the informative features of hand movements and to mitigate inter-subject variations. To this end, we propose a gesture recognition model that uses two different types of sensors and optimizes the feature space towards enhanced accuracy and better generalization. Specifically, we use an accelerometer and a surface electromyography sensor to capture kinematic and physiological signals of hand movements. We use a sliding window to divide the streaming sensor data and then extract time-domain and frequency-domain features from each segment to return feature vectors. Afterwards, the feature space is optimized with a feature selector and a gesture recognizer is optimized. To handle the case where no labeled training data are available for a new user, we apply the transfer learning technique to reuse the cross-subject knowledge. Finally, extensive comparative experiments concerning different classification models, different sensors, and different types of features are conducted. Results show that the joint use of kinematic and physiological sensors generally outperforms the use of single sensor, indicating the synthetic effect of different sensors, and that the use of transfer learning helps improve the cross-subject recognition accuracy. In addition, we quantitatively investigate the impact of null gesture on a gesture recognizer and results indicate that null gesture would lower its accuracy, enlightening related studies to consider it.

Gesture Recognition Using Video and Floor Pressure Data

Dynamic hand gesture recognition using hidden Markov models

RGC: Reliable Gesture Classification Via Wearables Using GANs-Based Data Augmentation.

Gesture Recognition with a 3-D Accelerometer

Gesture Recognition Based on Flexible Data Glove Using Deep Learning Algorithms

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

Fusion of kinematic and physiological sensors for hand gesture recognition

Multimodal Gesture Recognition Based On Choquet Integral

Semg-Based Gesture Recognition with Embedded Virtual Hand Poses and Adversarial Learning.

Gesture Recognition Using Enhanced Depth Motion Map and Static Pose Map

Recognizing Hand Gestures with Pressure-Sensor-Based Motion Sensing.

A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors

Gesture recognition based on HMM-FNN model using a Kinect

Multi-modal Gesture Recognition with Voting-Based Dynamic Time Warping

Multi-layered Gesture Recognition with Kinect

Natural Gesture Modeling and Recognition Approach Based on Joint Movements and Arm Orientations

Online human gesture recognition from motion data streams.

A Kinect Based Gesture Recognition Algorithm Using Gmm And Hmm

A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Devices.

Online gesture spotting from visual hull data.

Channel Selection for Gesture Recognition Using Force Myography: A Universal Model for Gesture Measurement Points