Fabric-based Self-Powered Noncontact Smart Gloves for Gesture Recognition

Hanxiang Wu,Hang Guo,Zongming Su,Mayue Shi,Xuexian Chen,Xiaoliang Cheng,Mengdi Han,Haixia Zhang

DOI: https://doi.org/10.1039/c8ta08276f

IF: 11.9

2018-01-01

Journal of Materials Chemistry A

Abstract:With flexibility, compatibility, and low electrode numbers, the smart gloves provide excellent sensing ability and interaction experience in gesture recognition.

What problem does this paper attempt to address?

Highly Conductive Carbon-Based E-Textile for Gesture Recognition

Xianghui Zeng,Minglu Hu,Pei He,Weikai Zhao,Sihan Dong,Xiaowen Xu,Guozhang Dai,Jia Sun,Junliang Yang

DOI: https://doi.org/10.1109/led.2023.3263170

IF: 4.8157

2023-04-28

IEEE Electron Device Letters

Abstract:Textile, as the most commonly used item in people's daily life, is the ideal substrate for carrying wearable devices. However, it is difficult to form robust conductive patterns on fabric substrates due to the roughness and porousness of fabric fiber. Here, we used heat transfer printing technology for simple modification of fabric substrate, which reduces the surface roughness of textile substrate. A pure carbon based wearable electronic textile (e-textile) with high conductivity ( /sq) and durability (1000 cycles) was obtained by depositing the mixed ink of graphene and carbon nanotubes through screen printing process and combining with roller pressing process. The sensor can well reflect the different bending degrees of fingers and work well in waterproof situations. In addition, five sensors were integrated into the fabric glove. The fabricated smart fabric glove combined with machine learning can recognize 8 different gestures with the average accuracy of 96.58%.

engineering, electrical & electronic
Self-Powered Smart Gloves Based on Triboelectric Nanogenerators

Sophia Shen,Xiao Xiao,Junyi Yin,Jun Chen

DOI: https://doi.org/10.1002/smtd.202200830

IF: 12.4

Small Methods

Abstract:The hands are used in all facets of daily life, from simple tasks such as grasping and holding to complex tasks such as communication and using technology. Finding a way to not only monitor hand movements and gestures but also to integrate that data with technology is thus a worthwhile task. Gesture recognition is particularly important for those who rely on sign language to communicate, but the limitations of current vision-based and sensor-based methods, including lack of portability, bulkiness, low sensitivity, highly expensive, and need for external power sources, among many others, make them impractical for daily use. To resolve these issues, smart gloves can be created using a triboelectric nanogenerator (TENG), a self-powered technology that functions based on the triboelectric effect and electrostatic induction and is also cheap to manufacture, small in size, lightweight, and highly flexible in terms of materials and design. In this review, an overview of the existing self-powered smart gloves will be provided based on TENGs, both for gesture recognition and human-machine interface, concluding with a discussion on the future outlook of these devices.
Stretchable e-Skin Patch for Gesture Recognition on the Back of the Hand

Shuo Jiang,Ling Li,Haipeng Xu,Junkai Xu,Guoying Gu,Peter B. Shull

DOI: https://doi.org/10.1109/TIE.2019.2914621

IF: 7.7

2020-01-01

IEEE Transactions on Industrial Electronics

Abstract:Gesture recognition is important for human-computer interaction and a variety of emerging research and commercial areas including virtual and augmented reality. Current approaches typically require sensors to be placed on the forearm, wrist, or directly across finger joints; however, they can be cumbersome or hinder human movement and sensation. In this paper, we introduce a novel approach to recognize hand gestures by estimating skin strain with multiple soft sensors optimally placed across the back of the hand. A pilot study was first conducted by covering the back of the hand with 40 small 2.5 mm reflective markers and using a high-precision camera system to measure skin strain patterns for individual finger movements. Optimal strain locations are then determined and used for sensor placement in a stretchable e-skin patch prototype. Experimental testing is performed to evaluate the stretchable e-skin patch performance in classifying individual finger gestures and American Sign Language 0-9 number gestures. Results showed classification accuracies of 95.3% and 94.4% for finger gestures and American Sign Language 0-9 gestures, respectively. These results demonstrate the feasibility of a stretchable e-skin patch on the back of the hand for hand gesture recognition and their potential to significantly enhance human-computer interaction.
A smart glove with integrated triboelectric nanogenerator for self-powered gesture recognition and language expression

Che-Min Chiu,Shuo-Wen Chen,Yu-Ping Pao,Ming-Zheng Huang,Shuen-Wen Chan,Zong-Hong Lin

DOI: https://doi.org/10.1080/14686996.2019.1665458

IF: 7.821

2019-09-30

Science and Technology of Advanced Materials

Abstract:Flexible electronics with great functional characteristics have proved to be a stepping stone in the field of wearable devices. Amongst all, gesture-sensing techniques have been widely studied for human-machine interfaces. In this paper, we propose a self-powered gesture-sensing system attached to the back of the hands, which has the capability of distinguishing hand gestures by measuring the triboelectric nanogenerator output signal. By attaching the sensor on the back of the hand, we can sense the displacement of tendons to detect the gestures. In addition, humidity resistance and durability of the device were tested and validated. Furthermore, we have established a set of rules to define the relationship between gestures and corresponding English letters. Therefore, the proposed sensor can further serve as an electronic sign language translator by converting gestures into words. Finally, we can integrate this system into gloves to enhance the applicability and utility. Overall, we have developed a real-time self-powered back-of-hand sensing system which can recognize various hand gestures.GRAPHICAL

materials science, multidisciplinary
A Wearable Gesture Recognition System with Ultra-high Accuracy and Robustness Enabled by the Synergy of Multiple Fabric Sensing Devices

Xueguang Yuan,Ning Liang,Wenle Fu,Qi Wang,Yangan Zhang,Junming Cao,Hao Liu,Kai Liu,Yongqing Huang,Xiaomin Ren

DOI: https://doi.org/10.1109/jsen.2023.3265775

IF: 4.3

2023-01-01

IEEE Sensors Journal

Abstract:Recently, numerous wearable devices for gesture recognition have been reported; however, most of them are fabricated by assembling the separately designed sensing layers with the substrate through linking agents, which will lead to the shifting or detaching of the sensing layers after long-duration use. Subsequently, over-reliance on multiple filtering algorithms to smooth the collected datasets becomes very popular, unavoidably resulting in the loss of data features and overfitting. In our point of view, it is much more crucial and effective for gesture recognition performance to reinforce the stability of the sensing layers. Therefore, in this work, we designed a type of integrated MXene/polyurethane (I-M/PU) sensor based on textile fabrics and further prepared a data glove, a smart wristband, and a smart elbow pad. A wearable system for gesture recognition with ultrahigh sensitivity to strain, as well as excellent stability and durability, is successfully realized by the synergy of those three devices. The collected original data by the integrated sensors were steady with specific features, making the simplification of the classification model feasible. Finally, 19 static gestures (including nine complex gestures) with a recognition accuracy of 100% in 6998 data samples have been impressively achieved by the simple multilayer perceptron (MLP) algorithm, which is the state-of-art best result as we know in the gesture recognition reports without any assistant computer vision algorithms, demonstrating our solution with a promising prospect in virtual reality (VR) and human–machine interaction (HMI) fields.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
A self-powered intelligent glove for real-time human-machine gesture interaction based on piezoelectric effect of T-ZnO/PVDF film

Chuanqiang Gao,Zhihe Long,Tianyan Zhong,Shan Liang,Lili Xing

DOI: https://doi.org/10.1088/1361-6463/ac5192

2022-02-16

Abstract:Abstract In the emerging field of human-machine interaction, intelligent gesture recognition techniques have great application prospects. The traditional use of rigid and over-sized power units has restrained the development of wearable gesture recognition systems. Here, we present a self-powered intelligent glove based on piezoelectric motion sensor arrays for real-time gesture recognition. The system can be confortably worn on human hands, and mainly consists of three parts: a flexible piezoelectric motion sensor based on T-ZnO/PVDF film (T-ZnO, tetrapod ZnO nanostructures), a signal processing module for analyzing the sensing information, and a Bluetooth unit for wireless communication. The system can work without external power, and the piezoelectric output can act as both the energy source of the system and the sensing signal. The working mechanism can be attributed to the piezoelectric effect of T-ZnO/PVDF composites and with flexion and extension of the fingers, a series of pulse signals can be generated and converted into specific corresponding codes. The sensing signal can be wirelessly transmitted to smartphones through the Bluetooth unit, and the phone can recognize the codes corresponding to sign language actions and translate them. This work can potentially promote the development of the next generation of human-machine interaction systems and expand the scope of self-powered techniques and wearable electronics.
Low‐Cost Data Glove Based on Deep‐Learning‐Enhanced Flexible Multiwalled Carbon Nanotube Sensors for Real‐Time Gesture Recognition

Yang Li,Lina Yang,Zhanmei He,Yijian Liu,Hongfei Wang,Wenbin Zhang,Lu Teng,Da Chen,Ge Song

DOI: https://doi.org/10.1002/aisy.202200128

IF: 7.298

2022-10-07

Advanced Intelligent Systems

Abstract:Low‐cost data glove based on deep‐learning‐enhanced multiwalled carbon nanotube sensors for real‐time gesture recognition is proposed. The glove is a promising platform for wearable human–machine interaction, achieving an accuracy of 97.5% of 30 gestures with average recognition time of 2.173 ms based on only five sensors, which can be directly interfaced in various applications. With advancements in artificial intelligence, wearable motion recognition systems based on flexible nanomaterial sensors exhibit excellent potential for harmonious human–machine interaction. However, the sensing stability and demand of large‐scale arrays limit the application of flexible nanomaterial sensors. Herein, a data glove system based on simple multiwalled carbon nanotube (MWCNT) sensors and a lightweight deep‐learning algorithm to achieve accurate gesture recognition is proposed. A regional‐crack mechanism is introduced through the microspine structure to enhance the strain sensitivity. Moreover, an efficient signal processing strategy based on an adaptive wavelet threshold function to improve the robustness and anti‐interference of signals obtained from MWCNT sensors, which exhibit strong generalization and can be used in other nanomaterial strain sensor. Based on the depth‐wise separable convolution, a novel hybrid convolutional neural network (CNN) long short‐term memory (LSTM) model for gesture recognition is constructed. The proposed model achieves an average accuracy of 97.5% and recognition accuracy of 30 gestures with an average recognition time of 2.173 ms based on only five sensors. The fabricated data glove is a promising platform for low‐cost and wearable human–machine interaction that can be directly interfaced in applications such as robotic hands, smart cars, and first‐person shooting games.
eGlove: Designing Interactive Fabric Sensor for Enhancing Contact-Based Interactions

Hebo Gong,Zhitong Cui,Yanan Wang,Chengyi Shen,Deyin Zhang,Shijian Luo

DOI: https://doi.org/10.1145/3411763.3451824

2021-01-01

Abstract:We present eGlove, a wearable and low-cost fabric sensor for recognizing a rich context of objects by touching them, including daily necessities, fruits, plants, as well as different body parts. Our sensing approach utilizes Swept frequency Capacitive Sensing (SFCS) to provide consistent sensor readings even when the fabric electrode is under varying deformation and stretching degrees. Our work proposes an easy fabrication method and hardware configuration for prototyping the interactive fabric sensor. We evaluated our system's classification accuracy through per-user training and found a real-time classification of 96.3%. We also demonstrated novel contextual interactions enabled by our technical approach with several applications.
Machine Learning Glove Using Self‐Powered Conductive Superhydrophobic Triboelectric Textile for Gesture Recognition in VR/AR Applications

Feng Wen,Zhongda Sun,Tianyiyi He,Qiongfeng Shi,Minglu Zhu,Zixuan Zhang,Lianhui Li,Ting Zhang,Chengkuo Lee

DOI: https://doi.org/10.1002/advs.202000261

IF: 15.1

2020-06-09

Advanced Science

Abstract:<p>The rapid progress of Internet of things (IoT) technology raises an imperative demand on human machine interfaces (HMIs) which provide a critical linkage between human and machines. Using a glove as an intuitive and low‐cost HMI can expediently track the motions of human fingers, resulting in a straightforward communication media of human–machine interactions. When combining several triboelectric textile sensors and proper machine learning technique, it has great potential to realize complex gesture recognition with the minimalist‐designed glove for the comprehensive control in both real and virtual space. However, humidity or sweat may negatively affect the triboelectric output as well as the textile itself. Hence, in this work, a facile carbon nanotubes/thermoplastic elastomer (CNTs/TPE) coating approach is investigated in detail to achieve superhydrophobicity of the triboelectric textile for performance improvement. With great energy harvesting and human motion sensing capabilities, the glove using the superhydrophobic textile realizes a low‐cost and self‐powered interface for gesture recognition. By leveraging machine learning technology, various gesture recognition tasks are done in real time by using gestures to achieve highly accurate virtual reality/augmented reality (VR/AR) controls including gun shooting, baseball pitching, and flower arrangement, with minimized effect from sweat during operation.</p>

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
Artificial Vascular Stent-Inspired Bending Sensors Embedded in A Data Glove for Hand Gesture Recognition

Hanrui Dong,Chao Zhi,Conger Wang,Runjun Sun,Zijing Dong,Yujing Zhang,Chen Xu,Hao Guo,Mengyue Ren,Yiqin Xu,Mimi Zhang,Lingjie Yu

DOI: https://doi.org/10.1109/jsen.2023.3306045

IF: 4.3

2023-01-01

IEEE Sensors Journal

Abstract:Owing to the superior conductivity and conductivity stability, the metal filaments are excellent potential materials for wearable sensors. However, the rigidity of metal limits its further application in wearable devices. Inspired by the structure of artificial vascular stents, a new idea for fabricating flexible and stretchable bending sensors based on metal filaments via structural design was presented in this article. Two braiding methods, with the plain-like structure and the loop-like structure, were proposed to fabricate rigid metal filaments into flexible finger sleeves. The designed bending sensors were further integrated into a multichannel and low-cost smart glove for hand gesture recognition (HGR), together with five commercial pressure sensors. The support vector machine (SVM) model was then utilized to recognize the hand gesture from the fusing data composed of five bending signals and five pressure signals, which were collected and transmitted via an embedded electronic system. The experimental results indicate that the smart glove achieves HGR using SVM model with an accuracy of 98.49% in the plain-like structure and 98.15% in the loop-like structure.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Structural design of magnetostrictive sensing glove and its application for gesture recognition

Boyang Hu,Ling Weng,Kaile Liu,Yang Liu,Zhuolin Li,Yuxin Chen

DOI: https://doi.org/10.1108/sr-07-2023-0301

2024-03-24

Sensor Review

Abstract:Purpose Gesture recognition plays an important role in many fields such as human–computer interaction, medical rehabilitation, virtual and augmented reality. Gesture recognition using wearable devices is a common and effective recognition method. This study aims to combine the inverse magnetostrictive effect and tunneling magnetoresistance effect and proposes a novel wearable sensing glove applied in the field of gesture recognition. Design/methodology/approach A magnetostrictive sensing glove with function of gesture recognition is proposed based on Fe-Ni alloy, tunneling magnetoresistive elements, Agilus30 base and square permanent magnets. The sensing glove consists of five sensing units to measure the bending angle of each finger joint. The optimal structure of the sensing units is determined through experimentation and simulation. The output voltage model of the sensing units is established, and the output characteristics of the sensing units are tested by the experimental platform. Fifteen gestures are selected for recognition, and the corresponding output voltages are collected to construct the data set and the data is processed using Back Propagation Neural Network. Findings The sensing units can detect the change in the bending angle of finger joints from 0 to 105 degrees and a maximum error of 4.69% between the experimental and theoretical values. The average recognition accuracy of Back Propagation Neural Network is 97.53% for 15 gestures. Research limitations/implications The sensing glove can only recognize static gestures at present, and further research is still needed to recognize dynamic gestures. Practical implications A new approach to gesture recognition using wearable devices. Social implications This study has a broad application prospect in the field of human–computer interaction. Originality/value The sensing glove can collect voltage signals under different gestures to realize the recognition of different gestures with good repeatability, which has a broad application prospect in the field of human–computer interaction.

instruments & instrumentation
Machine Learning-Based Gesture Recognition Glove: Design and Implementation

Anna Filipowska,Wojciech Filipowski,Paweł Raif,Marcin Pieniążek,Julia Bodak,Piotr Ferst,Kamil Pilarski,Szymon Sieciński,Rafał Jan Doniec,Julia Mieszczanin,Emilia Skwarek,Katarzyna Bryzik,Maciej Henkel,Marcin Grzegorzek

DOI: https://doi.org/10.3390/s24186157

2024-09-23

Abstract:In the evolving field of human-computer interaction (HCI), gesture recognition has emerged as a critical focus, with smart gloves equipped with sensors playing one of the most important roles. Despite the significance of dynamic gesture recognition, most research on data gloves has concentrated on static gestures, with only a small percentage addressing dynamic gestures or both. This study explores the development of a low-cost smart glove prototype designed to capture and classify dynamic hand gestures for game control and presents a prototype of data gloves equipped with five flex sensors, five force sensors, and one inertial measurement unit (IMU) sensor. To classify dynamic gestures, we developed a neural network-based classifier, utilizing a convolutional neural network (CNN) with three two-dimensional convolutional layers and rectified linear unit (ReLU) activation where its accuracy was 90%. The developed glove effectively captures dynamic gestures for game control, achieving high classification accuracy, precision, and recall, as evidenced by the confusion matrix and training metrics. Despite limitations in the number of gestures and participants, the solution offers a cost-effective and accurate approach to gesture recognition, with potential applications in VR/AR environments.
Design of a lightweight and easy‐to‐wear hand glove with multi‐modal tactile perception for digital human

Zhigeng Pan,Hongyi Ren,Chang Liu,Ming Chen,Mithun Mukherjee,Wenzhen Yang

DOI: https://doi.org/10.1002/cav.2258

IF: 1.01

2024-06-01

Computer Animation and Virtual Worlds

Abstract:The gloves proposed in this paper integrate 16 sensors capable of detecting temperature, finger pressure, and bending data of the hand. Additionally, we have designed a small circuit board. The incorporation of a novel traversal polling method for the streamlined collection of multi‐channel sensor readings is innovative. The experimental results indicate that the data glove demonstrates a high degree of precision in acquiring real‐time hand interaction information, as well as effectively displaying hand posture in real‐time using Unity3D. Within the field of human–computer interaction, data gloves play an essential role in establishing a connection between virtual and physical environments for the realization of digital human. To enhance the credibility of human‐virtual hand interactions, we aim to develop a system incorporating a data glove‐embedded technology. Our proposed system collects a wide range of information (temperature, bending, and pressure of fingers) that arise during natural interactions and afterwards reproduce them within the virtual environment. Furthermore, we implement a novel traversal polling technique to facilitate the streamlined aggregation of multi‐channel sensors. This mitigates the hardware complexity of the embedded system. The experimental results indicate that the data glove demonstrates a high degree of precision in acquiring real‐time hand interaction information, as well as effectively displaying hand posture in real‐time using Unity3D. The data glove's lightweight and compact design facilitates its versatile utilization in virtual reality interactions.

computer science, software engineering
Object Identification with Smart Glove Assembled by Pressure Sensors

Tianyi Fan,Zheyu Liu,Xiyue Tian,Junda Li,Jin Yang,Chaolun Wang,Hengchang Bi,Fei Qiao,Xing Wu,Junhao Chu

DOI: https://doi.org/10.1109/lsens.2021.3114314

2021-01-01

IEEE Sensors Letters

Abstract:The study and replication of human sensory abilities, such as visual, auditory, and tactile perception, depends on the availability of integrating electronics into flexible materials. Much previous research on pressure sensing films has a lack of flexibilities in its products and cannot be well applied to wearable device. In this letter, we first prepare Graphene-VSe2-Ecoflex sponge, and then fabricate highly compressible Graphene-VSe2-Ecoflex pressure sensors using this sponge, and finally construct an innovative glove with this highly compressible pressure sensor array. The Graphene-VSe2-Ecoflex pressure sensor sustains high strain up to 85%. The sensor retains a good linearity performance under the cycling test. Moreover, the glove can identify and manipulate subjects at an over 89% recognition rate after trained by neural networks. The realization of the smart object identification glove may provide a new strategy for applying flexible devices to intelligent sensing systems.
Magnetic/conductive/elastic multi-material 3D-printed self-powered sensing gloves for underwater/smoke environmental Human-Computer Interaction

Shanfei Zhang,Zhigang Xia,Zhufeng Liu,Qi Wang,Yamei Yue,Jianyu Huang,Bin Su

DOI: https://doi.org/10.1016/j.cej.2023.142388

IF: 15.1

2023-03-17

Chemical Engineering Journal

Abstract:Current Human-Computer Interaction (HCI) devices allow interactive communications between the users' gestures and the computers. However, extreme environments beyond atmosphere, such as underwater or smoke, will greatly interrupt the normal operation of existing HCI devices. Here we demonstrated the fabrication of 3D-printed self-powered sensing gloves that can be used for underwater/smoke environmental HCI. A home-made multi-extrusion-head manipulator, which can simultaneously print three kinds of functional inks including magnetic, conductive and elastic materials, has been developed to generate the self-powered sensing gloves. The magnetic part was printed on the polymeric thumb region while four liquid metal coils were printed on the other four fingers, yielding the self-powered gesture recognition by clicking the fingers or nine-key input method keys of alphabetic typing. Our work offers a design of self-powered sensing glove for gesture recognition and therefore provides a pathway to realize HCI in extreme environments.

engineering, chemical, environmental
Conductive graphene-based E-textile for highly sensitive, breathable, and water-resistant multimodal gesture-distinguishable sensors

Xurui Hu,Tao Huang,Zhiduo Liu,Gang Wang,Da Chen,Qinglei Guo,Siwei Yang,Zhiwen Jin,Jong-Min Lee,Guqiao Ding

DOI: https://doi.org/10.1039/d0ta04915h

IF: 11.9

2020-01-01

Journal of Materials Chemistry A

Abstract:Graphene E-textile exhibits excellent electrical conductivity, breathability, and washability. The application of a graphene E-textile on a wearable remote-control system by sewing the pressure sensors into the five fingers of a glove to invoke a human–machine interaction.

materials science, multidisciplinary,chemistry, physical,energy & fuels
A Finger Motion Monitoring Glove for Hand Rehabilitation Training and Assessment Based on Gesture Recognition

Qi Huang,Yadong Jiang,Zaihua Duan,Zhen Yuan,Yuanming Wu,Jialei Peng,Yang Xu,Hao Li,Hongchen He,Huiling Tai

DOI: https://doi.org/10.1109/jsen.2023.3264620

IF: 4.3

2023-01-01

IEEE Sensors Journal

Abstract:Hand rehabilitation training and assessment require the frequent participation of professional doctors, which is time-consuming, laborious, and sometime non-quantitative. To liberate both doctors and patients, a finger motion monitoring glove is expected to give a helping hand by monitoring the speed and state of hand movement in real time. However, the existing finger motion monitoring gloves suffer from low sensitivity, narrow detection range, and a lack of fabrication consistency. Herein, a highly sensitive finger motion monitoring glove with an intrinsic surface microstructure is fabricated based on the stable printing method, and hand rehabilitation training and assessment are realized with the help of the machine learning method. The printed strain sensors achieve a high strain sensitivity (gauge factor (GF) reaches 100.69 at 30%–50% strain), wide response range (0.1%–50%), fast response/recovery speed (71.43/178.49 ms), satisfied durability (function properly after 5000 cycles), and low batch-to-batch variation (within 0.10). These advantages enable the printed sensors to monitor finger movements quickly and comprehensively, thus making it practicable for hand rehabilitation training and assessment. This work provides a simple and stable method to obtain a highly sensitive finger motion monitoring glove, which is expected to make hand rehabilitation training and assessment more convenient and reliable.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
An Intelligent Glove System for Real‐Time Multiple Electrical Signal Acquisition and Display

Yulin Qiu,Xingyi Dai,Jingkun Yang,Jiaying Liao,Jiaxin Han,Yinghui Wu,Yajun Cao,Xuyang Zhang,Aihua Zhong,He Ni,Long‐Biao Huang

DOI: https://doi.org/10.1002/admt.202302027

IF: 6.8

2024-02-01

Advanced Materials Technologies

Abstract:A real‐time intelligent glove system that can capture and monitor multimodal hand information (pressure, bending, and temperature) is proposed. By processing multi‐channel signals, this system can generate real‐time 2D images that display tactile information of the hand, with high sensitivity and fault tolerance. Realizing multimodal tactile perception for robots is highly desirable for achieving more intelligent human–machine interaction. A real‐time intelligent glove system that can capture and monitor hand tactile information, including pressure, bending, and temperature is proposed. This system processes the collected data and visualizes the tactile information in a 2D image. The intelligent glove system integrates a palm‐shaped sensor unit, a multi‐channel data acquisition board, and a data analysis module. The glove consists of 34 flexible sensors, including 28 pressure sensors, five bending sensors, and one temperature sensor, which convert biological information into electrical signals. By enhancing the performance of the system, the intelligent glove achieves high sensitivity and good fault tolerance, allowing it to analyze the multimodal tactile information of the entire hand with fast responsivity. By analyzing the acquired multi‐channel electrical signals, the system can analyze object shapes and various gripping states. This work paves the way for wearable devices used in multimodal tactile perception and promotes the emergence of new modes of human–machine interaction.

materials science, multidisciplinary
Analog Sensing and Computing Systems with Low Power Consumption for Gesture Recognition

Tianyi Fan,Zheyu Liu,Zewei Luo,Junda Li,Xiyue Tian,Yeshen Chen,Yuan Feng,Chaolun Wang,Hengchang Bi,Xinming Li,Fei Qiao,Xing Wu

DOI: https://doi.org/10.1002/aisy.202000184

IF: 7.298

2020-11-16

Advanced Intelligent Systems

Abstract:Traditional general architecture chips have shown excessive power consumption and insufficient functional redundancy in some customized applications. Flexible electronics also call for customized chips in smart wearable devices. Common chips in intelligent systems process digital signals, and continuous operation of the system clock brings great power consumption. Herein, an intelligent gesture recognition system is developed by combining the flexible 2D materials and an analog computing chip. The pressure‐sensitive sponge with graphene fillings is proposed as a piezoresistive sensor. A nine‐sensor array is used to detect the pressure field distribution caused by hand movement. To get rid of the power consumption caused by the system clock, a novel analog‐computing customized chip which adopts a near‐sensor processing architecture is proposed. It implements the binary neural network algorithm with an analog circuit and completes the recognition of the transmission signal at the hardware level. The chip possesses a low power consumption which is less than 1.8 mW. Moreover, a glove assembled by highly pressure‐sensitive material recognizes mute gestures including Arabic numerals 0–9, with a recognition rate as high as 98.5%. Herein, the prospects for the application of customized smart chips in the field of smart wearable electronics are illuminated. A chip based on a near‐sensor processing architecture is fabricated to assemble with pressure sensors and directly process the perceptive signals. With the design of analog multiply‐accumulate operation inside the chip, a binarize neural network algorithm is implemented to compute data from sensors and recognize various gestures including Arabic numerals, and its recognition rate is up to 98.5%.
Triboelectric-Inertial Sensing Glove Enhanced by Charge-Retained Strategy for Human-Machine Interaction.

Bo Yang,Jia Cheng,Xuecheng Qu,Yuning Song,Lifa Yang,Junyao Shen,Ziqian Bai,Linhong Ji

DOI: https://doi.org/10.1002/advs.202408689

2024-01-01

Abstract:As technology advances, human-machine interaction (HMI) demands more intuitive and natural methods. To meet this demand, smart gloves, capable of capturing intricate hand movements, are emerging as vital HMI tools. Moreover, triboelectric-based sensors, with their self-powered, cost-effective, and material various characteristics, can offer promising solutions for enhancing existing glove systems. However, a key limitation of these sensors is that charge leakage in the measurement circuit results in capturing only transient signals, rather than continuous changes. To address this issue, a charge-retained circuit that effectively prevents triboelectric signal attenuation is developed, enabling accurate measurement of continuous finger movements. This innovation forms the foundation of a highly integrated smart glove system, enhancing HMI functionality by combining continuous triboelectric signals with inertial sensor data. The system showcases a diverse range of applications, including complex robotic control, virtual reality interaction, smart home lighting adjustments, and intuitive interface operations. Furthermore, by leveraging artificial intelligence (AI) techniques, the system achieves accurate recognition of complex sign language with an impressive 99.38% accuracy. This work presents a charge-retained approach for continuous sensing with triboelectric-based sensors, offering valuable insights for developing future multifunctional HMI and sign language recognition systems. The proposed smart glove system, with its dual-mode sensing and AI integration, holds great potential for revolutionizing various domains and enhancing user experiences.

Fabric-based Self-Powered Noncontact Smart Gloves for Gesture Recognition

Highly Conductive Carbon-Based E-Textile for Gesture Recognition

Self-Powered Smart Gloves Based on Triboelectric Nanogenerators

Stretchable e-Skin Patch for Gesture Recognition on the Back of the Hand

A smart glove with integrated triboelectric nanogenerator for self-powered gesture recognition and language expression

A Wearable Gesture Recognition System with Ultra-high Accuracy and Robustness Enabled by the Synergy of Multiple Fabric Sensing Devices

A self-powered intelligent glove for real-time human-machine gesture interaction based on piezoelectric effect of T-ZnO/PVDF film

Low‐Cost Data Glove Based on Deep‐Learning‐Enhanced Flexible Multiwalled Carbon Nanotube Sensors for Real‐Time Gesture Recognition

eGlove: Designing Interactive Fabric Sensor for Enhancing Contact-Based Interactions

Machine Learning Glove Using Self‐Powered Conductive Superhydrophobic Triboelectric Textile for Gesture Recognition in VR/AR Applications

Artificial Vascular Stent-Inspired Bending Sensors Embedded in A Data Glove for Hand Gesture Recognition

Structural design of magnetostrictive sensing glove and its application for gesture recognition

Machine Learning-Based Gesture Recognition Glove: Design and Implementation

Design of a lightweight and easy‐to‐wear hand glove with multi‐modal tactile perception for digital human

Object Identification with Smart Glove Assembled by Pressure Sensors

Magnetic/conductive/elastic multi-material 3D-printed self-powered sensing gloves for underwater/smoke environmental Human-Computer Interaction

Conductive graphene-based E-textile for highly sensitive, breathable, and water-resistant multimodal gesture-distinguishable sensors

A Finger Motion Monitoring Glove for Hand Rehabilitation Training and Assessment Based on Gesture Recognition

An Intelligent Glove System for Real‐Time Multiple Electrical Signal Acquisition and Display

Analog Sensing and Computing Systems with Low Power Consumption for Gesture Recognition

Triboelectric-Inertial Sensing Glove Enhanced by Charge-Retained Strategy for Human-Machine Interaction.