Abstract:Hand gesture recognition tasks based on surface electromyography (sEMG) are vital in human-computer interaction, speech detection, robot control, and rehabilitation applications. However, existing models, whether traditional machine learnings (ML) or other state-of-the-arts, are limited in the number of movements. Targeting a large number of gesture classes, more data features such as temporal information should be persisted as much as possible. In the field of sEMG-based recognitions, the recurrent convolutional neural network (RCNN) is an advanced method due to the sequential characteristic of sEMG signals. However, the invariance of the pooling layer damages important temporal information. In the all convolutional neural network (ACNN), because of the feature-mixing convolution operation, a same output can be received from completely different inputs. This paper proposes a concatenate feature fusion (CFF) strategy and a novel concatenate feature fusion recurrent convolutional neural network (CFF-RCNN). In CFF-RCNN, a max-pooling layer and a 2-stride convolutional layer are concatenated together to replace the conventional simple dimensionality reduction layer. The featurewise pooling operation serves as a signal amplitude detector without using any parameter. The feature-mixing convolution operation calculates the contextual information. Complete evaluations are made on both the accuracy and convergence speed of the CFF-RCNN. Experiments are conducted using three sEMG benchmark databases named DB1, DB2 and DB4 from the NinaPro database. With more than 50 gestures, the classification accuracies of the CFF-RCNN are 88.87% on DB1, 99.51% on DB2, and 99.29% on DB4. These accuracies are the highest compared with reported accuracies of machine learnings and other state-of-the-art methods. To achieve accuracies of 86%, 99% and 98% for the RCNN, the training time are 2353.686 s, 816.173 s and 731.771 s, respectively. However, for the CFF-RCNN to reach the same accuracies, it needs only 1727.415 s, 542.245 s and 576.734 s, corresponding to a reduction of 26.61%, 33.56% and 21.19% in training time. We concluded that the CFF-RCNN is an improved method when classifying a large number of hand gestures. The CFF strategy significantly improved model performance with higher accuracy and faster convergence as compared to traditional RCNN.

Gesture Recognition Using Semg Based on Multi-Scale Fusion Convolution and Channel Attention

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.

Multi-View Fusion Network-Based Gesture Recognition Using sEMG Data

Gesture recognition based on surface electromyography‐feature image

A multi-stream convolutional neural network for sEMG-based gesture recognition in muscle-computer interface

MSFF-Net: Multi-Stream Feature Fusion Network for surface electromyography gesture recognition

A novel concatenate feature fusion RCNN architecture for sEMG-based hand gesture recognition

sEMG-Based Gesture Recognition with Convolution Neural Networks

A Global and Local Feature fused CNN architecture for the sEMG-based hand gesture recognition

A novel attention-based hybrid CNN-RNN architecture for sEMG-based gesture recognition

Improved Network and Training Scheme for Cross-Trial Surface Electromyography (Semg)-Based Gesture Recognition.

sEMG and IMU Data-Based Hand Gesture Recognition Method Using Multistream CNN With a Fine-Tuning Transfer Framework

A wearable sensor-based dynamic gesture recognition model via broad attention learning

Study on Gesture Recognition Method with Two-Stream Residual Network Fusing sEMG Signals and Acceleration Signals

Pattern recognition of surface electromyography based on multi-scale convolutional neural network with attention mechanism.

Gesture Recognition System Based on CNN-IndRNN and OpenBCI

Integration of Convolutional Neural Network and Vision Transformer for Gesture Recognition Using Semg

Dynamic Gesture Recognition Using Surface EMG Signals Based on Multi-Stream Residual Network

Gesture recognition by instantaneous surface EMG images

Analysis of the metabolic profile of parishin by ultra-performance liquid chromatography/quadrupole-time of flight mass spectrometry.