Human follicular dendritic cells promote both proliferation and differentiation of CD40 activated B cells.

G. Grouard,O. de Bouteiller,C. Barthélémy,J. Banchereau,Y. Liu

DOI: https://doi.org/10.1007/978-1-4615-1971-3_75

Advances in experimental medicine and biology

Abstract:

What problem does this paper attempt to address?

Real-time Sign Language Recognition Using MobileNetV2 and Transfer Learning

Smruti Jagtap,Kanika Jadhav,Rushikesh Temkar,Minal Deshmukh

2024-12-10

Abstract:The hearing-impaired community in India deserves the access to tools that help them communicate, however, there is limited known technology solutions that make use of Indian Sign Language (ISL) at present. Even though there are many ISL users, ISL cannot access social and education arenas because there is not yet an efficient technology to convert the ISL signal into speech or text. We initiated this initiative owing to the rising demand for products and technologies that are inclusive and help ISL, filling the gap of communication for the ones with hearing disability. Our goal is to build an reliable sign language recognition system with the help of Convolutional Neural Networks (CNN) to . By expanding communication access, we aspire toward better educational opportunities and a more inclusive society for hearing impaired people in India.

Machine Learning
Indian Sign Language Gesture Recognition using Image Processing and Deep Learning

Neel Kamal Bhagat,Y Vishnusai,G N Rathna,Y. Vishnusai,G. N. Rathna

DOI: https://doi.org/10.1109/dicta47822.2019.8945850

2019-12-01

Abstract:Speech impaired people use hand based gestures to communicate. Unfortunately, the vast majority of the people are not aware of the semantics of these gestures. In a attempt to bridge the same, we propose a real time hand gesture recognition system based on the data captured by the Microsoft Kinect RGB-D camera. Given that there is no one to one mapping between the pixels of the depth and the RGB camera, we used computer vision techniques like 3D contruction and affine transformation. After achieving one to one mapping, segmentation of the hand gestures was done from the background noise. Convolutional Neural Networks (CNNs) were utilised for training 36 static gestures relating to Indian Sign Language (ISL) alphabets and numbers. The model achieved an accuracy of 98.81% on training using 45,000 RGB images and 45,000 depth images. Further Convolutional LSTMs were used for training 10 ISL dynamic word gestures and an accuracy of 99.08% was obtained by training 1080 videos. The model showed accurate real time performance on prediction of ISL static gestures, leaving a scope for further research on sentence formation through gestures. The model also showed competitive adaptability to American Sign Language (ASL) gestures when the ISL models weights were transfer learned to ASL and it resulted in giving 97.71% accuracy.
Image-based Indian Sign Language Recognition: A Practical Review using Deep Neural Networks

Mallikharjuna Rao K,Harleen Kaur,Sanjam Kaur Bedi,M A Lekhana

DOI: https://doi.org/10.48550/arXiv.2304.14710

2023-04-28

Computer Vision and Pattern Recognition

Abstract:People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most of the general population cannot understand this language, creating a communication barrier, especially in places such as banks, airports, supermarkets, etc. [1]. A sign language recognition(SLR) system is a must to solve this problem. The main focus of this model is to develop a real-time word-level sign language recognition system that would translate sign language to text. Much research has been done on ASL(American sign language). Thus, we have worked on ISL(Indian sign language) to cater to the needs of the deaf and hard-of-hearing community of India[2]. In this research, we provide an Indian Sign Language-based Sign Language recognition system. For this analysis, the user must be able to take pictures of hand movements using a web camera, and the system must anticipate and display the name of the taken picture. The acquired image goes through several processing phases, some of which use computer vision techniques, including grayscale conversion, dilatation, and masking. Our model is trained using a convolutional neural network (CNN), which is then utilized to recognize the images. Our best model has a 99% accuracy rate[3].
Automated Sign to Speech Conversion Model using Deep Learning

Premanand Ghadekar,Divsehaj Anand,Aryan Gupta,Dheeraj Sharma,Preeti Oswal,Shreyas Khare

DOI: https://doi.org/10.47164/ijngc.v12i5.427

2021-11-26

Abstract:Unable to communicate verbally is a disability. In order to exchange thoughts and interact, there exist severalways. The most predominant method involves use of hand-gestures. The prime motive of the proposed researchwork is to bridge the research gap in Sign Language Recognition with maximum efficiency. The goal is to replacethe human mediator with a machine to minimize human interference. This paper focuses on the recognition of ASLin real-time. In automatic sign language translator design the challenging part lies in selecting a good classifierto classify the static input gestures with high accuracy. CNN architecture is used to design a classifier for signlanguage recognition in the proposed system. The model and the pipeline architecture is developed by keras basedconvolutional neural network to classify 27 alphabets that is 26 English language alphabets and a unique character,space. With different parameter configurations, the system has trained the classifier with different parameters andtabulated the results. The proposed study achieved an efficiency of 99.88% on the test set. The result shows thatthe model accuracy improves as more data is fetched from various subjects for training.
Deepsign: Sign Language Detection and Recognition Using Deep Learning

Deep Kothadiya,Chintan Bhatt,Krenil Sapariya,Kevin Patel,Ana-Belén Gil-González,Juan M. Corchado

DOI: https://doi.org/10.3390/electronics11111780

IF: 2.9

2022-06-04

Electronics

Abstract:The predominant means of communication is speech; however, there are persons whose speaking or hearing abilities are impaired. Communication presents a significant barrier for persons with such disabilities. The use of deep learning methods can help to reduce communication barriers. This paper proposes a deep learning-based model that detects and recognizes the words from a person's gestures. Deep learning models, namely, LSTM and GRU (feedback-based learning models), are used to recognize signs from isolated Indian Sign Language (ISL) video frames. The four different sequential combinations of LSTM and GRU (as there are two layers of LSTM and two layers of GRU) were used with our own dataset, IISL2020. The proposed model, consisting of a single layer of LSTM followed by GRU, achieves around 97% accuracy over 11 different signs. This method may help persons who are unaware of sign language to communicate with persons whose speech or hearing is impaired.

engineering, electrical & electronic,computer science, information systems,physics, applied
Recognition of Indian Sign Language (ISL) Using Deep Learning Model

Sakshi Sharma,Sukhwinder Singh

DOI: https://doi.org/10.1007/s11277-021-09152-1

IF: 2.017

2021-09-28

Wireless Personal Communications

Abstract:An efficient sign language recognition system (SLRS) can recognize the gestures of sign language to ease the communication between the signer and non-signer community. In this paper, a computer-vision based SLRS using a deep learning technique has been proposed. This study has primary three contributions: first, a large dataset of Indian sign language (ISL) has been created using 65 different users in an uncontrolled environment. Second, the intra-class variance in dataset has been increased using augmentation to improve the generalization ability of the proposed work. Three additional copies for each training image are generated in this paper, by using three different affine transformations. Third, a novel and robust model using Convolutional Neural Network (CNN) have been proposed for the feature extraction and classification of ISL gestures. The performance of this method is evaluated on a self-collected ISL dataset and publicly available dataset of ASL. For this total of three datasets have been used and the achieved accuracy is 92.43, 88.01, and 99.52%. The efficiency of this method has been also evaluated in terms of precision, recall, f-score, and time consumed by the system. The results indicate that the proposed method shows encouraging performance compared with existing work.

telecommunications
Real-time Indian Sign Language (ISL) Recognition

Kartik Shenoy,Tejas Dastane,Varun Rao,Devendra Vyavaharkar

DOI: https://doi.org/10.48550/arXiv.2108.10970

2021-08-25

Abstract:This paper presents a system which can recognise hand poses & gestures from the Indian Sign Language (ISL) in real-time using grid-based features. This system attempts to bridge the communication gap between the hearing and speech impaired and the rest of the society. The existing solutions either provide relatively low accuracy or do not work in real-time. This system provides good results on both the parameters. It can identify 33 hand poses and some gestures from the ISL. Sign Language is captured from a smartphone camera and its frames are transmitted to a remote server for processing. The use of any external hardware (such as gloves or the Microsoft Kinect sensor) is avoided, making it user-friendly. Techniques such as Face detection, Object stabilisation and Skin Colour Segmentation are used for hand detection and tracking. The image is further subjected to a Grid-based Feature Extraction technique which represents the hand's pose in the form of a Feature Vector. Hand poses are then classified using the k-Nearest Neighbours algorithm. On the other hand, for gesture classification, the motion and intermediate hand poses observation sequences are fed to Hidden Markov Model chains corresponding to the 12 pre-selected gestures defined in ISL. Using this methodology, the system is able to achieve an accuracy of 99.7% for static hand poses, and an accuracy of 97.23% for gesture recognition.

Computer Vision and Pattern Recognition,Human-Computer Interaction
Benchmarking deep neural network approaches for Indian Sign Language recognition

Ashish Sharma,Nikita Sharma,Yatharth Saxena,Anuraj Singh,Debanjan Sadhya

DOI: https://doi.org/10.1007/s00521-020-05448-8

2020-10-24

Neural Computing and Applications

Abstract:Sign language is the language of the deaf and mute. However, this particular population of the world is unfortunately overlooked as the majority of the hearing population does not understand sign language. In this paper, an extensive comparative analysis of various gesture recognition techniques involving convolutional neural networks and machine learning algorithms has been discussed and tested for real-time accuracy. Three models: a pre-trained VGG16 with fine-tuning, VGG16 with transfer learning and a hierarchical neural network were analyzed based on a number of trainable parameters. These models were trained on a self-developed dataset consisting images of Indian Sign Language (ISL) representation of all 26 English alphabets. The performance evaluation was based on the practical application of these models, which was simulated by varying lighting and background environments. Out of the three, the hierarchical model outperformed the other two models to give the best accuracy of 98.52% for one-hand and 97% for two-hand gestures. Thereafter, a conversation interface was built in Django using this model for the real-time gesture to speech conversion and vice versa. This publicly accessible interface can be used by anyone who wishes to learn or converse in ISL.

computer science, artificial intelligence
Word recognition from Indian Sign Language in videos using dual feature descriptor and GMT-MASKRCNN recognition technique

Bansal, Naman

DOI: https://doi.org/10.1007/s11042-024-20384-8

IF: 2.577

2024-10-24

Multimedia Tools and Applications

Abstract:Indian Sign Language (ISL) is a vital means of interaction for the country's deaf and hard-of-hearing citizens. This highly developed visual-gestural system of language uses forms, gestures with the hands, and facial reactions to convey an extensive variety of complex ideas and viewpoints. Nevertheless, the automated ISL movement recognition technique has a great problem because of the varying characteristics and intricacy of sign lingo sentences. In order to overcome that, the researchers present a thorough approach to the recognition of Indian Sign Language (ISL), utilizing a multi-phase analytic framework that combines sophisticated signal processing techniques with machine learning to improve the accuracy and robustness of ISL gesture detection. The model employs the Central Limits Theorem-Discrete Wavelet Transform (CLT-DWT) eliminating strategies to reduce interference from noise in recorded sign language videos. It also improves the stage of pre-processing by using FICA-KMC for overlapping pixel division and concentrates on resilient extraction of features through the Manhattan Distance-based Histogram of Oriented Gradients (MD-HOG) and CCC-SURF strategies. Furthermore, researchers incorporate MIC-DT for choosing features in order to optimize the detection model's effectiveness. To achieve comprehensive motion recognition and categorization, the final procedure is to incorporate the powerful artificial neural network architecture GMT-Mask RCNN. The technique's possible efficacy in precisely and consistently comprehending Indian Sign Language for the visually impaired belonging is highlighted by the exploratory evaluation, which shows significant improvements in the rate of recognition as well as effective prevention of erroneous positive and negative incidents.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
CNN-LSTM Hybrid Real-Time IoT-Based Cognitive Approaches for ISLR with WebRTC: Auditory Impaired Assistive Technology

Meenu Gupta,Narina Thakur,Dhruvi Bansal,Gopal Chaudhary,Battulga Davaasambuu,Qiaozhi Hua

DOI: https://doi.org/10.1155/2022/3978627

2022-02-21

Abstract:In the era of modern technology, people may readily communicate through facial expressions, body language, and other means. As the use of the Internet evolves, it may be a boon to the medical fields. Recently, the Internet of Medical Things (IoMT) has provided a broader platform to handle difficulties linked to healthcare, including people's listening and hearing impairment. Although there are many translators that exist to help people of various linguistic backgrounds communicate more effectively. Using kinesics linguistics, one may assess or comprehend the communications of auditory and hearing-impaired persons who are standing next to each other. When looking at the present COVID-19 scenario, individuals are still linked in some way via online platforms; however, persons with disabilities have communication challenges with online platforms. The work provided in this research serves as a communication bridge inside the challenged community and the rest of the globe. The proposed work for Indian Sign Linguistic Recognition (ISLR) uses three-dimensional convolutional neural networks (3D-CNNs) and long short-term memory (LSTM) technique for analysis. A conventional hand gesture recognition system involves identifying the hand and its location or orientation, extracting certain essential features and applying an appropriate machine learning algorithm to recognise the completed action. In the calling interface of the web application, WebRTC has been implemented. A teleprompting technology is also used in the web app, which transforms sign language into audible sound. The proposed web app's average recognition rate is 97.21%.
Sign Language to Text Conversion

Deepika Patil,Aniket Patil,Akshay Patil,Amol More,Suraj Shinde Patil

DOI: https://doi.org/10.22214/ijraset.2024.62147

2024-05-31

International Journal for Research in Applied Science and Engineering Technology

Abstract:Abstract: Sign language, being one of the oldest and most natural forms of communication, serves as a crucial means of expression for individuals with hearing and speech impairments. Deaf and dumb individuals heavily rely on sign language for communication, given their limitations in using spoken languages. In this context, we are introducing a real-time method utilizing neural networks for finger spelling based on American Sign Language (ASL). Automatic human gesture recognition, especially from camera images, has become an intriguing area for developing computer vision applications. Recognizing hand gestures in real-time from camera images can significantly enhance communication for individuals with hearing and speech impairments. The proposed method employs Long Short-Term Memory (LSTM) to recognize hand gestures associated with American Sign Language. Sign language, being one of the oldest and most natural forms of communication, serves as a crucial means of expression for individuals with hearing and speech impairments. Deaf and Hard-of-Hearing (D&H) individuals heavily rely on sign language for communication, given their limitations in using spoken languages. In this context, we are introducing a real-time method utilizing neural networks for finger spelling based on American Sign Language (ASL). Automatic human gesture recognition, especially from camera images, has become an intriguing area for developing computer vision applications. Recognizing hand gestures in real-time from camera images can significantly enhance communication for individuals with hearing and speech impairments. The proposed method employs Long Short-Term Memory (LSTM) to recognize hand gestures associated with American Sign Language. However, the lack of tools that seamlessly connect sign language with spoken language creates barriers in understanding and interaction. The project aims to break down these barriers by providing a real-time solution for the recognition and translation of finger-spelling-based hand gestures
Sign Language Recognition from Digital Videos Using Deep Learning Methods

Jia Lu,Minh Nguyen,Wei Qi Yan

DOI: https://doi.org/10.1007/978-3-030-72073-5_9

2021-01-01

Abstract:In this paper, we investigate the state-of-the-art deep learning methods for sign language recognition. In order to achieve this goal, Capsule Network (CapsNet) is proposed in this paper, which shows positive result. We also propose a Selective Kernel Network (SKNet) with attention mechanism in order to extract spatial information. Sign language as an important means of communications, the problems of recognizing sign language from digital videos in real time have become the new challenge of this research field. The contributions of this paper are: (1) The CapsNet attains the accuracy of overall recognition up to 98.72% based on our own dataset. (2) SKNet with attention mechanism is able to achieve the best recognition accuracy 98.88%.
Sign Language Recognition System using TensorFlow Object Detection API

Sharvani Srivastava,Amisha Gangwar,Richa Mishra,Sudhakar Singh

DOI: https://doi.org/10.1007/978-3-030-96040-7_48

2022-03-03

Abstract:Communication is defined as the act of sharing or exchanging information, ideas or feelings. To establish communication between two people, both of them are required to have knowledge and understanding of a common language. But in the case of deaf and dumb people, the means of communication are different. Deaf is the inability to hear and dumb is the inability to speak. They communicate using sign language among themselves and with normal people but normal people do not take seriously the importance of sign language. Not everyone possesses the knowledge and understanding of sign language which makes communication difficult between a normal person and a deaf and dumb person. To overcome this barrier, one can build a model based on machine learning. A model can be trained to recognize different gestures of sign language and translate them into English. This will help a lot of people in communicating and conversing with deaf and dumb people. The existing Indian Sing Language Recognition systems are designed using machine learning algorithms with single and double-handed gestures but they are not real-time. In this paper, we propose a method to create an Indian Sign Language dataset using a webcam and then using transfer learning, train a TensorFlow model to create a real-time Sign Language Recognition system. The system achieves a good level of accuracy even with a limited size dataset.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning,Multimedia
Dynamic gesture recognition using hand pose-based neural networks for sign language interpretation

Vaidehi Sharma,Nehil Sood,Mohita Jaiswal,Abhishek Sharma,Sandeep Saini,Jieh-Ren Chang

DOI: https://doi.org/10.1007/s10209-024-01162-7

2024-11-09

Universal Access in the Information Society

Abstract:The dynamic two-hand Sign Language Recognition system is effective for individuals with speech and hearing impairments, and it also plays a crucial role in computer vision research. Additionally, real-time recognition of such gestures presents a significant challenge as the machine must accurately identify combinations of patterns and interpret them within specified time constraints. The current vision-based systems designed for dynamic gesture recognition are deemed ineffective as a result of an excessive amount of feature extraction from lengthy sequences of frames. Furthermore, current systems are exclusively designed for real-time static gesture recognition. Therefore, this paper proposes a vision-based dynamic sign language recognition system using Time Distributed Long Short-Term Memory Networks that addresses the deficiencies of current systems. The pipeline for creating the corpus for the proposed Dynamic Two Hands Indian Sign Language dataset is also worked out. The proposed model utilizes a keypoints-based feature extraction technique to enhance the accuracy and efficiency of the system. The experimental findings indicate that the developed system has a recognition rate of 99.6%surpassing other current state-of-the-art methods.

computer science, cybernetics,ergonomics
Sign language recognition using modified deep learning network and hybrid optimization: a hybrid optimizer (HO) based optimized CNNSa-LSTM approach

Abdullah Baihan,Ahmed I. Alutaibi,Mohammed Alshehri,Sunil Kumar Sharma

DOI: https://doi.org/10.1038/s41598-024-76174-7

IF: 4.6

2024-10-31

Scientific Reports

Abstract:Speech impairment limits a person's capacity for oral and auditory communication. Improvements in communication between the deaf and the general public can be progressed by a real-time sign language detector. Recent studies have contributed to make progress in motion and gesture identification processes using Deep Learning (DL) methods and computer vision. But the development of static and dynamic sign language recognition (SLR) models is still a challenging area of research. The difficulty is in obtaining an appropriate model that addresses the challenges of continuous signs that are independent of the signer. Different signers' speeds, durations, and many other factors make it challenging to create a model with high accuracy and continuity. This study mainly focused on SLR using a modified DL and hybrid optimization approach. Notably, spatial and geometric-based features are extracted via the Visual Geometry Group 16 (VGG16), and motion features are extracted using the optical flow approach. A new DL model, CNNSa-LSTM, is a combination of a Convolutional Neural Network (CNN), Self-Attention (SA), and Long-Short-Term Memory (LSTM) to identify sign language. This model is developed for feature extraction by combining CNNs for spatial analysis with SA mechanisms for focusing on relevant features, while LSTM effectively models temporal dependencies. The proposed CNNSa-LSTM model enhances performance in tasks involving complex, sequential data, such as sign language processing. Besides, a Hybrid Optimizer (HO) is proposed using the Hippopotamus Optimization Algorithm (HOA) and the Pathfinder Algorithm (PFA). The proposed model has been implemented in Python, and it has been evaluated over the existing models in terms of accuracy (98.7%), sensitivity (98.2%), precision (98.5%), Word Error Rate (WER) (0.131), Sign Error Rate (SER) (0.114), and Normalized Discounted Cumulative Gain (NDCG) (98%) as well. The proposed model has recorded the highest accuracy of 98.7%.

multidisciplinary sciences
Real-Time Sign Language Fingerspelling Recognition using Convolutional Neural Network

Abiodun Oguntimilehin,Kolade Balogun

DOI: https://doi.org/10.34028//iajit/21/1/14

2024-01-01

The International Arab Journal of Information Technology

Abstract:Sign Language allows mute people to communicate, problem occurs when a conversationalist fails to understand it. Despite efforts to address this problem, an effective solution is not yet found. In this work, Convolutional Neural Network was trained on two different datasets separately- Binary and Red Blue Green )RGB(, each contains 25,900 images of Nigerian Sign Language. A Deep Neural pre-trained module was used to detect hand gestures in the video feed which tackled the issue of complex backgrounds, also showed excellent detection in dimly lit areas. The accuracies of (98.95%, 76%) and (98.87%, 98.85%) were obtained respectively on the training and the validation sets. The real time system developed implemented both models as a single system which makes it a unique one.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
A Comparative Analysis of Techniques and Algorithms for Recognising Sign Language

Rupesh Kumar,Ayush Sinha,Ashutosh Bajpai,S.K Singh

DOI: https://doi.org/10.48550/arXiv.2305.13941

2023-05-24

Abstract:Sign language is a visual language that enhances communication between people and is frequently used as the primary form of communication by people with hearing loss. Even so, not many people with hearing loss use sign language, and they frequently experience social isolation. Therefore, it is necessary to create human-computer interface systems that can offer hearing-impaired people a social platform. Most commercial sign language translation systems now on the market are sensor-based, pricey, and challenging to use. Although vision-based systems are desperately needed, they must first overcome several challenges. Earlier continuous sign language recognition techniques used hidden Markov models, which have a limited ability to include temporal information. To get over these restrictions, several machine learning approaches are being applied to transform hand and sign language motions into spoken or written language. In this study, we compare various deep learning techniques for recognising sign language. Our survey aims to provide a comprehensive overview of the most recent approaches and challenges in this field.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
New trends in assessing the outcomes of mental health interventions

G. Thornicroft,M. Slade

DOI: https://doi.org/10.1002/wps.20114

2014-06-01

World Psychiatry

Abstract:Assessing the outcomes of interventions in mental health care is both important and challenging. The aim of this paper is to advance the field of outcomes research by proposing a taxonomy of the decisions that clinicians and researchers need to consider when evaluating outcomes. Our taxonomy has eight components, framed as decisions: Whose outcome will be considered? Which scientific stage is being investigated? What outcome domain(s) matter? What level of assessment will be used? Will clinical and/or recovery outcomes be assessed? Whose perspective will be considered? Will deficits and/or strengths be the focus? Will invariant or individualized measures be preferred? We propose a future focus on understanding what matters most to people using mental health services, and on the use of measures rated by service users as the primary approach to evaluating outcome.
Indian Sign Language Recognition Using Mediapipe Holistic

Dr. Velmathi G,Kaushal Goyal

2023-04-20

Abstract:Deaf individuals confront significant communication obstacles on a daily basis. Their inability to hear makes it difficult for them to communicate with those who do not understand sign language. Moreover, it presents difficulties in educational, occupational, and social contexts. By providing alternative communication channels, technology can play a crucial role in overcoming these obstacles. One such technology that can facilitate communication between deaf and hearing individuals is sign language recognition. We will create a robust system for sign language recognition in order to convert Indian Sign Language to text or speech. We will evaluate the proposed system and compare CNN and LSTM models. Since there are both static and gesture sign languages, a robust model is required to distinguish between them. In this study, we discovered that a CNN model captures letters and characters for recognition of static sign language better than an LSTM model, but it outperforms CNN by monitoring hands, faces, and pose in gesture sign language phrases and sentences. The creation of a text-to-sign language paradigm is essential since it will enhance the sign language-dependent deaf and hard-of-hearing population's communication skills. Even though the sign-to-text translation is just one side of communication, not all deaf or hard-of-hearing people are proficient in reading or writing text. Some may have difficulty comprehending written language due to educational or literacy issues. Therefore, a text-to-sign language paradigm would allow them to comprehend text-based information and participate in a variety of social, educational, and professional settings. Keywords: deaf and hard-of-hearing, DHH, Indian sign language, CNN, LSTM, static and gesture sign languages, text-to-sign language model, MediaPipe Holistic, sign language recognition, SLR, SLT

Computer Vision and Pattern Recognition,Computation and Language,Machine Learning
Sign language recognition system for communicating to people with disabilities

Yulius Obi,Kent Samuel Claudio,Vetri Marvel Budiman,Said Achmad,Aditya Kurniawan

DOI: https://doi.org/10.1016/j.procs.2022.12.106

2023-01-11

Procedia Computer Science

Abstract:Sign language is one of the most reliable ways of communicating with special needs people, as it can be done anywhere. However, most people do not understand sign language. Therefore, we have devised an idea to make a desktop application that can recognize sign language and convert it to text in real time. This research uses American Sign Language (ASL) datasets and the Convolutional Neural Networks (CNN) classification system. In the classification, the hand image is first passed through a filter and after the filter is applied, the hand is passed through a classifier which predicts the class of the hand gestures. This research focuses on the accuracy of the recognition. Our Application resulted in 96,3% accuracy for the 26 letters of the alphabet.

Human follicular dendritic cells promote both proliferation and differentiation of CD40 activated B cells.

Real-time Sign Language Recognition Using MobileNetV2 and Transfer Learning

Indian Sign Language Gesture Recognition using Image Processing and Deep Learning

Image-based Indian Sign Language Recognition: A Practical Review using Deep Neural Networks

Automated Sign to Speech Conversion Model using Deep Learning

Deepsign: Sign Language Detection and Recognition Using Deep Learning

Recognition of Indian Sign Language (ISL) Using Deep Learning Model

Real-time Indian Sign Language (ISL) Recognition

Benchmarking deep neural network approaches for Indian Sign Language recognition

Word recognition from Indian Sign Language in videos using dual feature descriptor and GMT-MASKRCNN recognition technique

CNN-LSTM Hybrid Real-Time IoT-Based Cognitive Approaches for ISLR with WebRTC: Auditory Impaired Assistive Technology

Sign Language to Text Conversion

Sign Language Recognition from Digital Videos Using Deep Learning Methods

Sign Language Recognition System using TensorFlow Object Detection API

Dynamic gesture recognition using hand pose-based neural networks for sign language interpretation

Sign language recognition using modified deep learning network and hybrid optimization: a hybrid optimizer (HO) based optimized CNNSa-LSTM approach

Real-Time Sign Language Fingerspelling Recognition using Convolutional Neural Network

A Comparative Analysis of Techniques and Algorithms for Recognising Sign Language

New trends in assessing the outcomes of mental health interventions

Indian Sign Language Recognition Using Mediapipe Holistic

Sign language recognition system for communicating to people with disabilities