Soft Sign Language Interpreter on Your Skin

Mengdi Han,Jean Won Kwak,John A. Rogers

DOI: https://doi.org/10.1016/j.matt.2020.07.012

IF: 18.9

2020-01-01

Matter

Abstract:Sign language represents an essentialmeans of communication for a significant fraction of the population but can only be used by trained individuals. Researchers report a wearable system that incorporates stretchable sensors and a wireless circuit for real-time sign-to-speech translation.

What problem does this paper attempt to address?

Stretchable e-Skin Patch for Gesture Recognition on the Back of the Hand

Shuo Jiang,Ling Li,Haipeng Xu,Junkai Xu,Guoying Gu,Peter B. Shull

DOI: https://doi.org/10.1109/TIE.2019.2914621

IF: 7.7

2020-01-01

IEEE Transactions on Industrial Electronics

Abstract:Gesture recognition is important for human-computer interaction and a variety of emerging research and commercial areas including virtual and augmented reality. Current approaches typically require sensors to be placed on the forearm, wrist, or directly across finger joints; however, they can be cumbersome or hinder human movement and sensation. In this paper, we introduce a novel approach to recognize hand gestures by estimating skin strain with multiple soft sensors optimally placed across the back of the hand. A pilot study was first conducted by covering the back of the hand with 40 small 2.5 mm reflective markers and using a high-precision camera system to measure skin strain patterns for individual finger movements. Optimal strain locations are then determined and used for sensor placement in a stretchable e-skin patch prototype. Experimental testing is performed to evaluate the stretchable e-skin patch performance in classifying individual finger gestures and American Sign Language 0-9 number gestures. Results showed classification accuracies of 95.3% and 94.4% for finger gestures and American Sign Language 0-9 gestures, respectively. These results demonstrate the feasibility of a stretchable e-skin patch on the back of the hand for hand gesture recognition and their potential to significantly enhance human-computer interaction.
Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays

Zhihao Zhou,Kyle Chen,Xiaoshi Li,Songlin Zhang,Yufen Wu,Yihao Zhou,Keyu Meng,Chenchen Sun,Qiang He,Wenjing Fan,Endong Fan,Zhiwei Lin,Xulong Tan,Weili Deng,Jin Yang,Jun Chen

DOI: https://doi.org/10.1038/s41928-020-0428-6

IF: 33.255

2020-06-29

Nature Electronics

Abstract:<p>Nature Electronics, Published online: 29 June 2020; <a href="https://www.nature.com/articles/s41928-020-0428-6">doi:10.1038/s41928-020-0428-6</a></p>Wearable yarn-based stretchable sensor arrays, combined with machine learning, can be used to translate American Sign Language into speech in real time.

engineering, electrical & electronic
Smart Glove for Sign Language Translation

Ahmad Imran Mohd Thaim,Norazlianie Sazali,Kumaran Kadirgama,Ahmad Shahir Jamaludin,Faiz Mohd Turan,Norhaida Ab. Razak

DOI: https://doi.org/10.37934/aram.112.1.8087

2023-12-29

Journal of Advanced Research in Applied Mechanics

Abstract:Sign language is a vital mode of communication for deaf people, yet it presents a significant barrier when interacting with those who do not understand it. The advent of technology has paved the way for innovative solutions to bridge this communication gap. This abstract explores the development and implications of a smart glove designed for sign language translation (SLT). The primary aim of this study is to create a wearable device, the Smart Glove, capable of recognizing and translating sign language gestures into text or speech. Key objectives include designing a lightweight and ergonomic glove prototype, developing machine learning algorithms for sign language recognition, implementing real-time translation capabilities, evaluating the glove's accuracy and usability, and assessing the potential impact on facilitating communication for deaf people. The Smart Glove utilizes only one sensor, flex sensors, to capture hand movements and gestures. These data inputs are processed through a custom-built machine learning model trained on a comprehensive sign language dataset. Preliminary results indicate a high accuracy rate in recognizing sign language gestures, with an average recognition rate of over 90% across a diverse set of signs. While challenges such as expanding gesture recognition and refining translation algorithms remain, this technology offers a promising solution to break down communication barriers and enhance the quality of life for those who rely on sign language.
Multimodal Hand/finger Movement Sensing and Fuzzy Encoding for Data‐efficient Universal Sign Language Recognition

Caise Wei,Shiqiang Liu,Jinfeng Yuan,Rong Zhu

DOI: https://doi.org/10.1002/inf2.12642

2024-01-01

InfoMat

Abstract:AbstractWearable sign language recognition helps hearing/speech impaired people communicate with non‐signers. However current technologies still unsatisfy practical uses due to the limitations of sensing and decoding capabilities. Here, A continuous sign language recognition system is proposed with multimodal hand/finger movement sensing and fuzzy encoding, trained with small word‐level samples from one user, but applicable to sentence‐level language recognition for new untrained users, achieving data‐efficient universal recognition. A stretchable fabric strain sensor is developed by printing conductive poly(3,4‐ethylenedioxythiophene):poly(styrenesulfonate) (PEDOT:PSS) ink on a pre‐stretched fabric wrapping rubber band, allowing the strain sensor with superior performances of wide sensing range, high sensitivity, good linearity, fast dynamic response, low hysteresis, and good long‐term reliability. A flexible e‐skin with a homemade micro‐flow sensor array is further developed to accurately capture three‐dimensional hand movements. Benefitting from fabric strain sensors for finger movement sensing, micro‐flow sensor array for 3D hand movement sensing, and human‐inspired fuzzy encoding for semantic comprehension, sign language is captured accurately without the interferences from individual action differences. Experiment results show that the semantic comprehension accuracy reaches 99.7% and 95%, respectively, in recognizing 100 isolated words and 50 sentences for a trained user, and achieves 80% in recognizing 50 sentences for new untrained users.image
SignSpeaker: A Real-time, High-Precision SmartWatch-based Sign Language Translator

Jiahui Hou,Xiang-Yang Li,Peide Zhu,Zefan Wang,Yu Wang,Jianwei Qian,Panlong Yang

DOI: https://doi.org/10.1145/3300061.3300117

2019-01-01

Abstract:Sign language is a natural and fully-formed communication method for deaf or hearing-impaired people. Unfortunately, most of the state-of-the-art sign recognition technologies are limited by either high energy consumption or expensive device costs and have a difficult time providing a real-time service in a daily-life environment. Inspired by previous works on motion detection with wearable devices, we propose Sign Speaker - a real-time, robust, and user-friendly American sign language recognition (ASLR) system with affordable and portable commodity mobile devices. SignSpeaker is deployed on a smartwatch along with a smartphone; the smartwatch collects the sign signals and the smartphone outputs translation through an inbuilt loudspeaker. We implement a prototype system and run a series of experiments that demonstrate the promising performance of our system. For example, the average translation time is approximately $1.1$ seconds for a sentence with eleven words. The average detection ratio and reliability of sign recognition are 99.2% and 99.5%, respectively. The average word error rate of continuous sentence recognition is 1.04% on average.
American Sign Language Translation via Smart Wearable Glove Technology

Muhammad Saad Zahid Khan,Shaheer Rizwan,M. Imran

DOI: https://doi.org/10.1109/RAEE.2019.8886931

2019-08-01

Abstract:In the world of sound, for those without it, sign language is a powerful tool to make their voices heard. The ASL, short for American Sign Language is the most widely used sign language across the globe with certain variations according to the country. In this work, we developed a wearable wireless gesture decoder module that can translate the fundamental set of ASL gestures into corresponding alphabets and words. Our project utilizes a glove that houses a series of flex sensors on the metacarpal and inter-phalangeal joints of the fingers to detect the bending of fingers, through piezoresistive effect. The glove is outfitted with an accelerometer as well, that helps to detect the hand movements. Simple classification algorithms from machine learning are then applied to translate the gestures into alphabets or words. With the assistance of a bluetooth module, the data is sent wirelessly. The result is then displayed and heard on the android smartphone using an android application named “Dastaana”, which is an Urdu word for glove. Portability, compactness, cost-effectiveness and a user-friendly android application gives this system an edge.

Computer Science,Linguistics
An All-Fibrous, Permeable, Adhesive, and Stretchable Self-Powered Electronic Skin for Sign Language Recognition

Fan Chen,Xian Song,Jingjing Fu,Jiaheng Liang,Junhua Zhou,Jiehua Cai,Yufei Zhang,Mengjia Zhu,Yichun Ding,Jinxing Jiang,Zijian Chen,Youchao Qi,Zhihao Zhou,Qiyao Huang,Yingying Zhang,Zijian Zheng

DOI: https://doi.org/10.1039/d4ta05825a

IF: 11.9

2024-01-01

Journal of Materials Chemistry A

Abstract:Self-powered human motion electronic skins (E-skins) hold significant potential for intelligent sports, healthcare, and human-machine interactions. However, the limited permeability to air and moisture, along with poor stretchability, impedes the wearing comfort, long-term application, and skin compliance of self-powered E-skins. Here, we present an all-fibrous, permeable, adhesive, and intrinsically stretchable electronic skin (PASE-skin). The PASE-skin employs core-sheath fiber mats, liquid-metal-fiber mats, and acrylic fiber mats as the triboelectric layer, electrode layer, and skin adhesive layer, respectively, to achieve an all-fibrous and intrinsically stretchable structure. Such a material and structural design simultaneously offer exceptional stretchability, minimal residual strain, textile-like breathability, skin adhesion, biocompatibility, and good sensing performance. The core-sheath structure increases the stretchability of the triboelectric layer threefold, from 200% to 600%. The liquid-metal-fiber mat electrode maintains stable conductivity even under extreme strains (900%) and numerous stretching cycles (10 000 times at 100% strain). The E-skin generates significant triboelectric outputs and maintains stable sensing performance up to 450% strain. Consequently, we have developed a 5-channel human motion sensing system based on PASE-skin, capable of real-time sign language recognition assisted by signal processing and machine learning algorithms. The PASE-skin is poised to make a substantial impact on the development of self-powered human motion E-skins and offers novel insights into the field of sign language recognition. An all-fibrous self-powered electronic skin that offers textile-like breathability, intrinsic stretchability, skin adhesion, biocompatibility, and good sensing performance for real-time gesture recognition assisted by machine learning.
American Sign Language Translation Using Wearable Inertial and Electromyography Sensors for Tracking Hand Movements and Facial Expressions

Yutong Gu,Chao Zheng,Masahiro Todoh,Fusheng Zha

DOI: https://doi.org/10.3389/fnins.2022.962141

2022-07-19

Abstract:A sign language translation system can break the communication barrier between hearing-impaired people and others. In this paper, a novel American sign language (ASL) translation method based on wearable sensors was proposed. We leveraged inertial sensors to capture signs and surface electromyography (EMG) sensors to detect facial expressions. We applied a convolutional neural network (CNN) to extract features from input signals. Then, long short-term memory (LSTM) and transformer models were exploited to achieve end-to-end translation from input signals to text sentences. We evaluated two models on 40 ASL sentences strictly following the rules of grammar. Word error rate (WER) and sentence error rate (SER) are utilized as the evaluation standard. The LSTM model can translate sentences in the testing dataset with a 7.74% WER and 9.17% SER. The transformer model performs much better by achieving a 4.22% WER and 4.72% SER. The encouraging results indicate that both models are suitable for sign language translation with high accuracy. With complete motion capture sensors and facial expression recognition methods, the sign language translation system has the potential to recognize more sentences.
Sign Language Conversation Interpretation Using Wearable Sensors and Machine Learning

Basma Kalandar,Ziemowit Dworakowski

2023-12-19

Abstract:The count of people suffering from various levels of hearing loss reached 1.57 billion in 2019. This huge number tends to suffer on many personal and professional levels and strictly needs to be included with the rest of society healthily. This paper presents a proof of concept of an automatic sign language recognition system based on data obtained using a wearable device of 3 flex sensors. The system is designed to interpret a selected set of American Sign Language (ASL) dynamic words by collecting data in sequences of the performed signs and using machine learning methods. The built models achieved high-quality performances, such as Random Forest with 99% accuracy, Support Vector Machine (SVM) with 99%, and two K-Nearest Neighbor (KNN) models with 98%. This indicates many possible paths toward the development of a full-scale system.

Signal Processing,Machine Learning
Novel Wearable System to Recognize Sign Language in Real Time

İlhan Umut,Ümit Can Kumdereli

DOI: https://doi.org/10.3390/s24144613

2024-07-16

Abstract:The aim of this study is to develop a practical software solution for real-time recognition of sign language words using two arms. This will facilitate communication between hearing-impaired individuals and those who can hear. We are aware of several sign language recognition systems developed using different technologies, including cameras, armbands, and gloves. However, the system we propose in this study stands out for its practicality, utilizing surface electromyography (muscle activity) and inertial measurement unit (motion dynamics) data from both arms. We address the drawbacks of other methods, such as high costs, low accuracy due to ambient light and obstacles, and complex hardware requirements, which have limited their practical application. Our software can run on different operating systems using digital signal processing and machine learning methods specific to this study. For the test, we created a dataset of 80 words based on their frequency of use in daily life and performed a thorough feature extraction process. We tested the recognition performance using various classifiers and parameters and compared the results. The random forest algorithm emerged as the most successful, achieving a remarkable 99.875% accuracy, while the naïve Bayes algorithm had the lowest success rate with 87.625% accuracy. The new system promises to significantly improve communication for people with hearing disabilities and ensures seamless integration into daily life without compromising user comfort or lifestyle quality.
Intersign Glove: A Communication Interface for the Aid of Deaf and Mute Community

Gaddala Finny Theophorus,Balwant Singh

DOI: https://doi.org/10.38124/ijisrt/ijisrt24may2510

2024-06-15

Abstract:Intersign Glove " is a groundbreaking innovation designed to address the communication barriers faced by the deaf and mute community. With the aim of revolutionizing traditional methods of communication, this paper introduces an innovative approach that utilizes gesture recognition technology to interpret Indian Sign Language (ISL) in real-time. The paper endeavors to eliminate the dependency on sign language interpreters by creating an embedded system comprising both hardware and software components. By leveraging advanced sensors strategically placed on a glove, the system captures intricate gesture parameters and translates them into code for computation. This code is then processed by a microcontroller board integrated into the glove, which generates corresponding speech output through an attached speaker, facilitating seamless communication between the user and non-sign language speakers. The wearable nature of the device ensures portability and ease of use, empowering individuals with hearing and speech impairments to communicate effectively in various social settings. Furthermore, by bridging the communication gap between the deaf and mute community and the wider population, this paper opens up new opportunities for inclusion and collaboration. "Intersign Glove" represents a significant advancement in assistive technology, promising to enhance the quality of life for individuals with hearing and speech disabilities while fostering greater understanding and integration within society.
Human-Computer Chinese Sign Language Interaction System

Lin Xu,Wen Gao

DOI: https://doi.org/10.20870/ijvr.2000.4.3.2651

2000-01-01

International Journal of Virtual Reality

Abstract:The generation and recognition of body language is a key technologies of VR. Sign Language is a visual-gestural language mainly used by hearing-impaired people. In this paper, gesture and facial expression models are created using computer graphics and used to synthesize Chinese Sign Language (CSL), and from it a human-computer CSL interaction system is implemented. Using a system combining CSL synthesis and CSL recognition subsystem, hearing-impaired people with data-gloves can pantomime CSL, which can then be displayed on the computer screen in real time and translated into Chinese text. Hearing people can also use the system by entering Chinese text, which is translated into CSL and displayed on the computer screen. In this way hearing-impaired people and hearing people can communicate with each other conveniently.
AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove

Feng Wen,Zixuan Zhang,Tianyiyi He,Chengkuo Lee

DOI: https://doi.org/10.1038/s41467-021-25637-w

IF: 16.6

2021-09-10

Nature Communications

Abstract:Abstract Sign language recognition, especially the sentence recognition, is of great significance for lowering the communication barrier between the hearing/speech impaired and the non-signers. The general glove solutions, which are employed to detect motions of our dexterous hands, only achieve recognizing discrete single gestures (i.e., numbers, letters, or words) instead of sentences, far from satisfying the meet of the signers’ daily communication. Here, we propose an artificial intelligence enabled sign language recognition and communication system comprising sensing gloves, deep learning block, and virtual reality interface. Non-segmentation and segmentation assisted deep learning model achieves the recognition of 50 words and 20 sentences. Significantly, the segmentation approach splits entire sentence signals into word units. Then the deep learning model recognizes all word elements and reversely reconstructs and recognizes sentences. Furthermore, new/never-seen sentences created by new-order word elements recombination can be recognized with an average correct rate of 86.67%. Finally, the sign language recognition results are projected into virtual space and translated into text and audio, allowing the remote and bidirectional communication between signers and non-signers.

multidisciplinary sciences
A new architecture for hand-worn Sign language to Speech translator

Sai Charan Bodda,Palki Gupta,Gaurav Joshi,Ayush Chaturvedi

DOI: https://doi.org/10.48550/arXiv.2009.03988

IF: 6.4588

2020-09-08

Human-Computer Interaction

Abstract:People with speech and hearing impairments often rely on sign language to communicate with others but most of the general population cannot understand sign language and sign language itself is a difficult language to learn, so there is a definite need for technologies to translate sign language to speech. In this paper, we describe the design and implementation of Smart glove, a hand-worn hardware device capable of translating American Sign Language gestures into English speech by tracking the finger's orientation, gestures and hand motion. It uses hardware sensors like Flex, Accelerometer and gyroscope and intelligent software to capture and translate the gestures into speech. This paper explains the translation of both Alphabet and Word gestures. New approaches and algorithms are proposed and implemented to address hardware-dependent issues in existing glove based designs. The whole device is designed to be modular with distributed processing units to encourage modular enhancement, reducing complexity, and interrelation between subsystems.Decision Trees are used in gesture recognition and error correction. We hope that the henceforth mentioned design and architecture would be the basis for the advancement in research related to sensor-based sign language translation along with research for smart glove and cybernetic accessories.
Hear Sign Language: A Real-Time End-to-End Sign Language Recognition System

Zhibo Wang,Tengda Zhao,Jinxin Ma,Hongkai Chen,Kaixin Liu,Huajie Shao,Qian Wang,Ju Ren

DOI: https://doi.org/10.1109/tmc.2020.3038303

IF: 6.075

2020-01-01

IEEE Transactions on Mobile Computing

Abstract:Sign language recognition (SLR) bridges the communication gap between the hearing-impaired and the ordinary people. However, existing SLR systems either cannot provide continuous recognition or suffer from low recognition accuracy due to the difficulty of sign segmentation and the insufficiency of capturing both finger and arm motions. The latest system, SignSpeaker, has a significant limit in recognizing two-handed signs with only one smartwatch. To address these problems, this paper designs a novel real-time end-to-end SLR system, called DeepSLR, to translate sign language into voices to help people “hear” sign language. Specifically, two armbands embedded with an IMU sensor and multi-channel sEMG sensors are attached on the forearms to capture both coarse-grained arm movements and fine-grained finger motions. We propose an attention-based encoder-decoder model with a multi-channel convolutional neural network (CNN) to realize accurate, scalable, and end-to-end continuous SLR without sign segmentation. We have implemented DeepSLR on a smartphone and evaluated its effectiveness through extensive evaluations. The average word error rate of continuous sentence recognition is 10.8 percent, and it takes less than 1.1s for detecting signals and recognizing a sentence with 4 sign words, validating the recognition efficiency and real-time ability of DeepSLR in real-world scenarios.
Dataglove for Sign Language Recognition of People with Hearing and Speech Impairment via Wearable Inertial Sensors

Ang Ji,Yongzhen Wang,Xin Miao,Tianqi Fan,Bo Ru,Long Liu,Ruicheng Nie,Sen Qiu

DOI: https://doi.org/10.3390/s23156693

IF: 3.9

2023-07-27

Sensors

Abstract:Finding ways to enable seamless communication between deaf and able-bodied individuals has been a challenging and pressing issue. This paper proposes a solution to this problem by designing a low-cost data glove that utilizes multiple inertial sensors with the purpose of achieving efficient and accurate sign language recognition. In this study, four machine learning models—decision tree (DT), support vector machine (SVM), K-nearest neighbor method (KNN), and random forest (RF)—were employed to recognize 20 different types of dynamic sign language data used by deaf individuals. Additionally, a proposed attention-based mechanism of long and short-term memory neural networks (Attention-BiLSTM) was utilized in the process. Furthermore, this study verifies the impact of the number and position of data glove nodes on the accuracy of recognizing complex dynamic sign language. Finally, the proposed method is compared with existing state-of-the-art algorithms using nine public datasets. The results indicate that both the Attention-BiLSTM and RF algorithms have the highest performance in recognizing the twenty dynamic sign language gestures, with an accuracy of 98.85% and 97.58%, respectively. This provides evidence for the feasibility of our proposed data glove and recognition methods. This study may serve as a valuable reference for the development of wearable sign language recognition devices and promote easier communication between deaf and able-bodied individuals.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Sign Language Recognition System using Flex Sensor Network

Alumona T. L.,Okorogu V. N,Nworabude E. F.

DOI: https://doi.org/10.51584/ijrias.2023.8919

2023-01-01

International Journal of Research and Innovation in Applied Science

Abstract:This journal work on sign language recognition system using flex sensor network aims to x-ray the implementation of a sign language recognition system using smart gloves, raspberry pi, python and C language. Therefore, research into sign language interpretation using gestures has been explored progressively during recent decades to serve as an auxiliary tool for deaf and mute people to blend into society without barriers. In this work, a smart sign language interpretation system using a wearable hand device. This wearable system utilizes five flex-sensors, then using a PIC microcontroller, raspberry pi, python and C language to create a real-time Sign Language Recognition system. In this journal work, a sensor-based sign language recognition can serve as a key for overcoming many difficulties and providing convenience for human life. The ability of machines to understand human activities and their meaning can be utilized in a vast array of applications. This work provides a thorough technique in recent hand gesture and sign language recognition. After implementation, the system was able to output up to thirty-one phrases successfully. This paper was focused on improving the accuracy and usability of the system by optimizing the sensor placement and developing a user-friendly interface.

English Else
A Simple Sign Language Recognition System Based on Data Glove

JQ Wu,W Gao,YB Song,W Liu,B Pang

DOI: https://doi.org/10.1109/icosp.1998.770847

1998-01-01

Abstract:Human beings usually interact with each other either by via a natural language channel such as speech and writing, or by body languag, e.g. hand gestures, head gestures, facial expression, lip motion and so on. As a part of natural language understanding, sign language recognition is very important. On one hand, it is one of the main methods of human-computer interaction in virtual reality; on the other hand, it is an auxiliary tool for a deaf-mute to communicate with ordinary people through computer. In this paper the process of building a simple word-level sign language recognition system is presented, and the method for recognizing sign language words is also proposed
All-weather, natural silent speech recognition via machine-learning-assisted tattoo-like electronics

Youhua Wang,Tianyi Tang,Yin Xu,Yunzhao Bai,Lang Yin,Guang Li,Hongmiao Zhang,Huicong Liu,YongAn Huang

DOI: https://doi.org/10.1038/s41528-021-00119-7

IF: 14.6

2021-08-13

npj Flexible Electronics

Abstract:Abstract The internal availability of silent speech serves as a translator for people with aphasia and keeps human–machine/human interactions working under various disturbances. This paper develops a silent speech strategy to achieve all-weather, natural interactions. The strategy requires few usage specialized skills like sign language but accurately transfers high-capacity information in complicated and changeable daily environments. In the strategy, the tattoo-like electronics imperceptibly attached on facial skin record high-quality bio-data of various silent speech, and the machine-learning algorithm deployed on the cloud recognizes accurately the silent speech and reduces the weight of the wireless acquisition module. A series of experiments show that the silent speech recognition system (SSRS) can enduringly comply with large deformation (~45%) of faces by virtue of the electricity-preferred tattoo-like electrodes and recognize up to 110 words covering daily vocabularies with a high average accuracy of 92.64% simply by use of small-sample machine learning. We successfully apply the SSRS to 1-day routine life, including daily greeting, running, dining, manipulating industrial robots in deafening noise, and expressing in darkness, which shows great promotion in real-world applications.

materials science, multidisciplinary,engineering, electrical & electronic
Sign Language Recognition and Translation: A Multidisciplined Approach From the Field of Artificial Intelligence

Becky Sue Parton,B. S. Parton

DOI: https://doi.org/10.1093/deafed/enj003

2005-10-12

Abstract:In recent years, research has progressed steadily in regard to the use of computers to recognize and render sign language. This paper reviews significant projects in the field beginning with finger-spelling hands such as "Ralph" (robotics), CyberGloves (virtual reality sensors to capture isolated and continuous signs), camera-based projects such as the CopyCat interactive American Sign Language game (computer vision), and sign recognition software (Hidden Markov Modeling and neural network systems). Avatars such as "Tessa" (Text and Sign Support Assistant; three-dimensional imaging) and spoken language to sign language translation systems such as Poland's project entitled "THETOS" (Text into Sign Language Automatic Translator, which operates in Polish; natural language processing) are addressed. The application of this research to education is also explored. The "ICICLE" (Interactive Computer Identification and Correction of Language Errors) project, for example, uses intelligent computer-aided instruction to build a tutorial system for deaf or hard-of-hearing children that analyzes their English writing and makes tailored lessons and recommendations. Finally, the article considers synthesized sign, which is being added to educational material and has the potential to be developed by students themselves.

education, special,rehabilitation

Soft Sign Language Interpreter on Your Skin

Stretchable e-Skin Patch for Gesture Recognition on the Back of the Hand

Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays

Smart Glove for Sign Language Translation

Multimodal Hand/finger Movement Sensing and Fuzzy Encoding for Data‐efficient Universal Sign Language Recognition

SignSpeaker: A Real-time, High-Precision SmartWatch-based Sign Language Translator

American Sign Language Translation via Smart Wearable Glove Technology

An All-Fibrous, Permeable, Adhesive, and Stretchable Self-Powered Electronic Skin for Sign Language Recognition

American Sign Language Translation Using Wearable Inertial and Electromyography Sensors for Tracking Hand Movements and Facial Expressions

Sign Language Conversation Interpretation Using Wearable Sensors and Machine Learning

Novel Wearable System to Recognize Sign Language in Real Time

Intersign Glove: A Communication Interface for the Aid of Deaf and Mute Community

Human-Computer Chinese Sign Language Interaction System

AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove

A new architecture for hand-worn Sign language to Speech translator

Hear Sign Language: A Real-Time End-to-End Sign Language Recognition System

Dataglove for Sign Language Recognition of People with Hearing and Speech Impairment via Wearable Inertial Sensors

Sign Language Recognition System using Flex Sensor Network

A Simple Sign Language Recognition System Based on Data Glove

All-weather, natural silent speech recognition via machine-learning-assisted tattoo-like electronics

Sign Language Recognition and Translation: A Multidisciplined Approach From the Field of Artificial Intelligence