Abstract:Hand gesture recognition tasks based on surface electromyography (sEMG) are vital in human-computer interaction, speech detection, robot control, and rehabilitation applications. However, existing models, whether traditional machine learnings (ML) or other state-of-the-arts, are limited in the number of movements. Targeting a large number of gesture classes, more data features such as temporal information should be persisted as much as possible. In the field of sEMG-based recognitions, the recurrent convolutional neural network (RCNN) is an advanced method due to the sequential characteristic of sEMG signals. However, the invariance of the pooling layer damages important temporal information. In the all convolutional neural network (ACNN), because of the feature-mixing convolution operation, a same output can be received from completely different inputs. This paper proposes a concatenate feature fusion (CFF) strategy and a novel concatenate feature fusion recurrent convolutional neural network (CFF-RCNN). In CFF-RCNN, a max-pooling layer and a 2-stride convolutional layer are concatenated together to replace the conventional simple dimensionality reduction layer. The featurewise pooling operation serves as a signal amplitude detector without using any parameter. The feature-mixing convolution operation calculates the contextual information. Complete evaluations are made on both the accuracy and convergence speed of the CFF-RCNN. Experiments are conducted using three sEMG benchmark databases named DB1, DB2 and DB4 from the NinaPro database. With more than 50 gestures, the classification accuracies of the CFF-RCNN are 88.87% on DB1, 99.51% on DB2, and 99.29% on DB4. These accuracies are the highest compared with reported accuracies of machine learnings and other state-of-the-art methods. To achieve accuracies of 86%, 99% and 98% for the RCNN, the training time are 2353.686 s, 816.173 s and 731.771 s, respectively. However, for the CFF-RCNN to reach the same accuracies, it needs only 1727.415 s, 542.245 s and 576.734 s, corresponding to a reduction of 26.61%, 33.56% and 21.19% in training time. We concluded that the CFF-RCNN is an improved method when classifying a large number of hand gestures. The CFF strategy significantly improved model performance with higher accuracy and faster convergence as compared to traditional RCNN.

ResMFuse-Net: Residual-based multilevel fused network with spatial–temporal features for hand hygiene monitoring

Real-time hand rubbing quality estimation using deep learning enhanced by separation index and feature-based confidence metric

Hand Hygiene Assessment via Joint Step Segmentation and Key Action Scorer

Wearable Sensor-Based Residual Multifeature Fusion Shrinkage Networks for Human Activity Recognition

MSFF-Net: Multi-Stream Feature Fusion Network for surface electromyography gesture recognition

A Hybrid Multimodal Fusion Framework for Semg-Acc-based Hand Gesture Recognition

Mask-R-FCN: A Deep Fusion Network for Semantic Segmentation.

SqueezeNet and Fusion Network-Based Accurate Fast Fully Convolutional Network for Hand Detection and Gesture Recognition

MFNet: A Novel Multilevel Feature Fusion Network With Multibranch Structure for Surface Defect Detection

Multi-modal fusion for robust hand gesture recognition based on heterogeneous networks

A novel concatenate feature fusion RCNN architecture for sEMG-based hand gesture recognition

Multimodal Multiresolution Data Fusion Using Convolutional Neural Networks for IoT Wearable Sensing

A Comparison of Deep Learning Models for the Prediction of Hand Hygiene Videos

MFH‐Net: A Hybrid CNN‐Transformer Network Based Multi‐Scale Fusion for Medical Image Segmentation

Fully Automated Hand Hygiene Monitoring\\in Operating Room using 3D Convolutional Neural Network

TFN-FICFM: sEMG-Based Gesture Recognition Using Temporal Fusion Network and Fuzzy Integral-based Classifier Fusion

Deepfusion: A Deep Learning Framework For The Fusion Of Heterogeneous Sensory Data

CRMEFNet: A coupled refinement, multiscale exploration and fusion network for medical image segmentation

DeepFuse Neural Networks

EFNet: A multitask deep learning network for simultaneous quantification of left ventricle structure and function

Hand Gesture Recognition using Deep Feature Fusion Network based on Wearable Sensors