Abstract:Low‐cost data glove based on deep‐learning‐enhanced multiwalled carbon nanotube sensors for real‐time gesture recognition is proposed. The glove is a promising platform for wearable human–machine interaction, achieving an accuracy of 97.5% of 30 gestures with average recognition time of 2.173 ms based on only five sensors, which can be directly interfaced in various applications. With advancements in artificial intelligence, wearable motion recognition systems based on flexible nanomaterial sensors exhibit excellent potential for harmonious human–machine interaction. However, the sensing stability and demand of large‐scale arrays limit the application of flexible nanomaterial sensors. Herein, a data glove system based on simple multiwalled carbon nanotube (MWCNT) sensors and a lightweight deep‐learning algorithm to achieve accurate gesture recognition is proposed. A regional‐crack mechanism is introduced through the microspine structure to enhance the strain sensitivity. Moreover, an efficient signal processing strategy based on an adaptive wavelet threshold function to improve the robustness and anti‐interference of signals obtained from MWCNT sensors, which exhibit strong generalization and can be used in other nanomaterial strain sensor. Based on the depth‐wise separable convolution, a novel hybrid convolutional neural network (CNN) long short‐term memory (LSTM) model for gesture recognition is constructed. The proposed model achieves an average accuracy of 97.5% and recognition accuracy of 30 gestures with an average recognition time of 2.173 ms based on only five sensors. The fabricated data glove is a promising platform for low‐cost and wearable human–machine interaction that can be directly interfaced in applications such as robotic hands, smart cars, and first‐person shooting games.

Utilizing Gramian Angular Fields and Convolution Neural Networks in Flex Sensors Glove for Human–Computer Interaction

Low‐Cost Data Glove Based on Deep‐Learning‐Enhanced Flexible Multiwalled Carbon Nanotube Sensors for Real‐Time Gesture Recognition

A Flexible Iontronic Capacitive Sensing Array for Hand Gesture Recognition Using Deep Convolutional Neural Networks

Hand Gesture Recognition using Deep Feature Fusion Network based on Wearable Sensors

Interaction and control with the auxiliary of hand gesture

Gesture recognition based on Gramian angular difference field and multi-stream fusion methods

Deep Learning Based Real-Time Recognition of Dynamic Finger Gestures Using a Data Glove

Exploiting domain transformation and deep learning for hand gesture recognition using a low-cost dataglove

Gesture Recognition Based on Flexible Data Glove Using Deep Learning Algorithms

High‐accuracy Dynamic Gesture Recognition: A Universal and Self‐adaptive Deep‐learning‐assisted System Leveraging High‐performance Ionogels‐based Strain Sensors

Dynamic Gesture Recognition Using Inertial Sensors-based Data Gloves.

A Convolutional-Transformer-Based Approach for Dynamic Gesture Recognition of Data Gloves

Plastic Optical Fiber Enabled Smart Glove for Machine Learning-Based Gesture Recognition

Gesture Recognition Based on a Convolutional Neural Network–Bidirectional Long Short-Term Memory Network for a Wearable Wrist Sensor with Multi-Walled Carbon Nanotube/Cotton Fabric Material

A Robust Data-Driven Soft Sensory Glove for Human Hand Motions Identification and Replication

Gesture Recognition Using Inertial Sensors with 1D Convolutional Neural Network

Recognition of Hand Gesture Image Using Deep Convolutional Neural Network

A Real-time Gesture Prediction System Using Neural Networks and Multimodal Fusion Based on Data Glove

Simultaneous Hand Gesture Classification and Finger Angle Estimation via a Novel Dual-Output Deep Learning Model

Investigation of flexible graphene hybrid knitted sensor for joint motion recognition based on convolutional neural network fusion long short-term memory network

A 3D-CLDNN Based Multiple Data Fusion Framework for Finger Gesture Recognition in Human-Robot Interaction