Abstract:sEMG(surface electromyography) signals have been widely used in rehabilitation medicine in the past decades because of their non-invasive, convenient and informative features, especially in human action recognition, which has developed rapidly. However, the research on sparse EMG in multi-view fusion has made less progress compared to high-density EMG signals, and for the problem of how to enrich sparse EMG feature information, a method that can effectively reduce the information loss of feature signals in the channel dimension is needed. In this article, a novel IMSE (Inception-MaxPooling-Squeeze- Excitation) network module is proposed to reduce the loss of feature information during deep learning. Then, multiple feature encoders are constructed to enrich the information of sparse sEMG feature maps based on the multi-core parallel processing method in multi-view fusion networks, while SwT (Swin Transformer) is used as the classification backbone network. By comparing the feature fusion effects of different decision layers of the multi-view fusion network, it is experimentally obtained that the fusion of decision layers can better improve the classification performance of the network. In NinaPro DB1, the proposed network achieves 93.96% average accuracy in gesture action classification with the feature maps obtained in 300ms time window, and the maximum variation range of action recognition rate of individuals is less than 11.2%. The results show that the proposed framework of multi-view learning plays a good role in reducing individuality differences and augmenting channel feature information, which provides a certain reference for non-dense biosignal pattern recognition.

Multi-object Intergroup Gesture Recognition Combined with Fusion Feature and KNN Algorithm

Multi-modal fusion for robust hand gesture recognition based on heterogeneous networks

Multi-View Fusion Network-Based Gesture Recognition Using sEMG Data

Hand Motions Recognition Based on Semg Nonlinear Feature and Time Domain Feature Fusion

A Multi-Gestures Recognition System Based on Less Semg Sensors

Multiuser gesture recognition using sEMG signals via canonical correlation analysis and optimal transport

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Feature Fusion of sEMG and Ultrasound Signals in Hand Gesture Recognition

Hand Gesture Recognition Based on High-Density Myoelectricity in Forearm Flexors in Humans

Hand Gesture Recognition Based Improved Multi-Channels CNN Architecture Using EMG Sensors

A Multifeatured Time–Frequency Neural Network System for Classifying Semg

Identification of Gesture Based on Combination of Raw Semg and Semg Envelope Using Supervised Learning and Univariate Feature Selection

A Novel Multi-Feature Fusion Network With Spatial Partitioning Strategy and Cross-Attention for Armband-Based Gesture Recognition

Comparative Study on Gesture Recognition Using Multiple Kernel Learning Via Multi-mode Information Fusion

Simultaneous Semg Recognition of Gestures and Force Levels for Interaction with Prosthetic Hand

Multi-gesture Recognition Method of Single-Channel EMG Signal Based on Deep Learning

Multi-stream Fusion Network for Continuous Gesture Recognition Based on Semg

A Hybrid Multimodal Fusion Framework for Semg-Acc-based Hand Gesture Recognition

Improving Hand Gesture Recognition Robustness to Dynamic Posture Variations by Multimodal Deep Feature Fusion

A Global and Local Feature fused CNN architecture for the sEMG-based hand gesture recognition

Synergistic Myoelectrical Activities Of Forearm Muscles Improving Robust Recognition Of Multi-Fingered Gestures