Abstract:Accurate surface electromyography decoding of hand gestures is pivotal for advancing human–computer interaction applications. Recent developments in end-to-end deep neural networks have facilitated the automatic extraction of features from raw signals; however, not all extracted features are relevant and unimportant information can impede gesture estimation. Additionally, the accuracy of hand gesture estimation often declines when applying pre-trained models to new users. Therefore, a deep learning model using attention mechanism and transfer learning for electromyographic hand gesture estimation is proposed in this study. The proposed model consists of a feature extractor, a label classifier and a gesture estimator. A convolutional neural network is employed as the feature extractor, enabling the learning of high-level discriminative features from input signals. Attention modules are integrated into the convolutional layers, enhancing the extraction of pertinent features by emphasizing critical information through weight recalibration. The label classifier, consisting of three fully connected layers, classifies gesture labels using feature maps generated by the feature extractor. The gesture estimator, which adopts a threshold voting algorithm, is capable of estimating gestures during hand movement, making it suitable for real-time hand gesture estimation. A transfer learning approach is utilized to selectively transfer parameters from a pre-trained model to a target model, which is then partially retrained with limited target data. The proposed model is evaluated on both the Myo dataset and the public NinaPro dataset, demonstrating superior performance compared to baseline models in terms of estimation accuracy. Furthermore, the proposed transfer learning method proves more effective than training a new model from scratch, as retraining the target model with only two sessions yields satisfactory estimation accuracy.

Hand Gesture Recognition Based on Deep Learning Method.

Deep Learning Based Hand Gesture Recognition in Complex Scenes

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

sEMG-Based Gesture Recognition with Convolution Neural Networks

A deep learning approach using attention mechanism and transfer learning for electromyographic hand gesture estimation

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

Online cross session electromyographic hand gesture recognition using deep learning and transfer learning

A Global and Local Feature fused CNN architecture for the sEMG-based hand gesture recognition

sEMG based hand gesture recognition with deformable convolutional network

Gesture recognition based on surface electromyography‐feature image

A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition

Gesture Recognition Based on Deep Learning: A Review

A Hybrid CNN-LSTM Network for Hand Gesture Recognition with Surface EMG Signals

Visual Hand Gesture Recognition With Convolution Neural Network

Recognition of Hand Gesture Image Using Deep Convolutional Neural Network

Classification of multichannel surface-electromyography signals based on convolutional neural networks

Hand Gesture Recognition with Skin Detection and Deep Learning Method

A Deep Learning-Based End-to-End Composite System for Hand Detection and Gesture Recognition

From Forearm to Wrist: Deep Learning for Surface Electromyography-Based Gesture Recognition.

Dual Stream Long Short-Term Memory Feature Fusion Classifier for Surface Electromyography Gesture Recognition

Machine Learning-based sEMG Signal Classification for Hand Gesture Recognition