Abstract:With the goal of promoting the development of myoelectric control technology, this paper focuses on exploring graph neural network (GNN) based robust electromyography (EMG) pattern recognition solutions. Given that high-density surface EMG (HD-sEMG) signal contains rich temporal and spatial information, the multi-view spatial-temporal graph convolutional network (MSTGCN)is adopted as the basic classifier, and a feature extraction convolutional neural network (CNN) module is designed and integrated into MSTGCN to generate a new model called CNN-MSTGCN. The EMG pattern recognition experiments are conducted on HD-sEMG data of 17 gestures from 11 subjects. The ablation experiments show that each functional module of the proposed CNN-MSTGCN network has played a more or less positive role in improving the performance of EMG pattern recognition. The user-independent recognition experiments and the transfer learning-based cross-user recognition experiments verify the advantages of the proposed CNN-MSTGCN network in improving recognition rate and reducing user training burden. In the user-independent recognition experiments, CNN-MSTGCN achieves the recognition rate of 68%, which is significantly better than those obtained by residual network-50 (ResNet50, 47.5%, p < 0.001) and long-short-term-memory (LSTM, 57.1%, p=0.045). In the transfer learning-based cross-user recognition experiments, TL-CMSTGCN achieves an impressive recognition rate of 92.3%, which is significantly superior to both TL-ResNet50 (84.6%, p = 0.003) and TL-LSTM (85.3%, p = 0.008). The research results of this paper indicate that GNN has certain advantages in overcoming the impact of individual differences, and can be used to provide possible solutions for achieving robust EMG pattern recognition technology.

STCN-GR: Spatial-Temporal Convolutional Networks for Surface-Electromyography-Based Gesture Recognition

A Spatio-Temporal Graph Convolutional Network for Gesture Recognition from High-Density Electromyography

Improved Network and Training Scheme for Cross-Trial Surface Electromyography (Semg)-Based Gesture Recognition.

Learning Effective Spatial–Temporal Features for sEMG Armband-Based Gesture Recognition

GTGR-Net: Graph Attentional-Temporal Network for Surface-Electromyography-Based Gesture Recognition

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

SGRN: SEMG-based Gesture Recognition Network with Multi-Dimensional Feature Extraction and Multi-Branch Information Fusion

A Multi-stream Convolutional Model Using Attention Module for Semg Gesture Recognition

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Semi-Supervised Learning for Surface EMG-based Gesture Recognition.

Cross-User Electromyography Pattern Recognition Based on a Novel Spatial-Temporal Graph Convolutional Network

Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method

A Hybrid Model Based on ResNet and GCN for sEMG-Based Gesture Recognition

STGNN-LMR: A Spatial–Temporal Graph Neural Network Approach Based on sEMG Lower Limb Motion Recognition

A multi-stream convolutional neural network for sEMG-based gesture recognition in muscle-computer interface

High-Density Surface EMG-Based Gesture Recognition Using a 3D Convolutional Neural Network

A Teleoperated Manipulator Control System Based on Surface Electromyography Using Deep Learning

Spatio-Temporal Dynamic Attention Graph Convolutional Network Based on Skeleton Gesture Recognition

Gesture recognition by instantaneous surface EMG images

A Hybrid CNN-LSTM Network for Hand Gesture Recognition with Surface EMG Signals

A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition