Surrogate health care laws help hospitals.

T. Hudson

1992-04-20

Abstract:

What problem does this paper attempt to address?

Dataset of Pakistan Sign Language and Automatic Recognition of Hand Configuration of Urdu Alphabet through Machine Learning

Ali Imran,Abdul Razzaq,Irfan Ahmad Baig,Aamir Hussain,Sharaiz Shahid,Tausif-Ur Rehman

DOI: https://doi.org/10.1016/j.dib.2021.107021

2021-04-02

Abstract:Social correspondence is one of the most significant columns that the public dependent on. Notably, language is the best way to communicate and associate with one another both verbally and nonverbally. There is a persistent communication gap among deaf and non-deaf communities because non-deaf people have less understanding of sign languages. Every region/country has its sign language. In Pakistan, the sign language of Urdu is a visual gesture language that is being used for communication among deaf peoples. However, the dataset of Pakistan Sign Language (PSL) is not available publicly. The dataset of PSL has been generated by acquiring images of different hand configurations through a webcam. In this work, 40 images of each hand configuration with multiple orientations have been captured. In addition, we developed, an interactive android mobile application based on machine learning that minimized the communication barrier between the deaf and non-deaf communities by using the PSL dataset. The android application recognizes the Urdu alphabet from input hand configuration.
Enhancing sign language recognition using CNN and SIFT: A case study on Pakistan sign language

Sadia Arooj,Saud Altaf,Shafiq Ahmad,Haitham Mahmoud,Adamali Shah Noor Mohamed

DOI: https://doi.org/10.1016/j.jksuci.2024.101934

IF: 9.006

2024-01-19

Journal of King Saud University - Computer and Information Sciences

Abstract:Millions of people who have trouble hearing rely heavily on sign language as their primary means of communication. As a form of visual language, sign language is primarily used as features by the deaf and hard of hearing to communicate with one another. These features make it challenging for the average person to grasp what is being said. As a result, it becomes more difficult for deaf people to interact with the hearing community. In order to solve this communication barrier, scientists have been working on sign language recognition systems. The purpose of this research is to propose a hand gesture recognition framework for Pakistan Sign Language (PSL) by training a Convolutional Neural Network (CNN) on PSL gesture images obtained with the aid of a testbed built in the laboratory using the Kinect motion sensor for Urdu alphabets. Kinect images of hands were taken in this study under a variety of lighting conditions. A feature vector set was created from hand margin, size, shape, palm center points, and finger position using Scale Invariant Feature Transform (SIFT). Important features of PSL-based sign images were extracted using SIFT and then converted to vector points. The proposed improved CNN model was able to achieve an impressive accuracy of 98.74% on the PSL dataset, demonstrating an impressively low error rate of only 1.26%. A case study is demonstrated in the assessment of the system that has been provided. Finally, a comparison is performed between others and our work to show the efficiency of the proposed framework and legitimize the concept.

computer science, information systems
A multi-lingual sign language recognition system using machine learning

Fatma M. Najib

DOI: https://doi.org/10.1007/s11042-024-20165-3

IF: 2.577

2024-09-25

Multimedia Tools and Applications

Abstract:Recently, automatic sign language recognition field gets a great attention. Machine learning algorithms are mainly used to recognize hand gestures. Most of recent studies train their machine learning model using a specific sign language of a specific country such as the American Sign Language. In this paper, we propose a multi-lingual sign language system based machine learning that is called Multi-lingual Sign Languages Interpreter (MSLI) system. MSLI trains a machine learning model based on hand signs of multiple languages. It can detect the language of the input signs and their labels. In a case of input testing signs with the same language, the proposed system can provide two-steps recognition, where it only detects the language of the first sign, and then the rest signs are tested according to the recognized language. Also, MSLI can provide separate classification of signs per each language. Experiments were performed using 11 datasets with different languages. Separate and combined classification was performed on the input data. Experimental results show the accuracy of the proposed system. Training accuracy of the proposed system over most of the used separate different sign language datasets is approximately ranged from 90 to 100%. Also, most classification accuracy results of the test data of the separate datasets exceeded 90%. The combined classification of proposed MSLI archived training accuracy of 95.87% and testing accuracy of 92.33%.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Recognition of Indian Sign Language (ISL) Using Deep Learning Model

Sakshi Sharma,Sukhwinder Singh

DOI: https://doi.org/10.1007/s11277-021-09152-1

IF: 2.017

2021-09-28

Wireless Personal Communications

Abstract:An efficient sign language recognition system (SLRS) can recognize the gestures of sign language to ease the communication between the signer and non-signer community. In this paper, a computer-vision based SLRS using a deep learning technique has been proposed. This study has primary three contributions: first, a large dataset of Indian sign language (ISL) has been created using 65 different users in an uncontrolled environment. Second, the intra-class variance in dataset has been increased using augmentation to improve the generalization ability of the proposed work. Three additional copies for each training image are generated in this paper, by using three different affine transformations. Third, a novel and robust model using Convolutional Neural Network (CNN) have been proposed for the feature extraction and classification of ISL gestures. The performance of this method is evaluated on a self-collected ISL dataset and publicly available dataset of ASL. For this total of three datasets have been used and the achieved accuracy is 92.43, 88.01, and 99.52%. The efficiency of this method has been also evaluated in terms of precision, recall, f-score, and time consumed by the system. The results indicate that the proposed method shows encouraging performance compared with existing work.

telecommunications
Image-based Indian Sign Language Recognition: A Practical Review using Deep Neural Networks

Mallikharjuna Rao K,Harleen Kaur,Sanjam Kaur Bedi,M A Lekhana

DOI: https://doi.org/10.48550/arXiv.2304.14710

2023-04-28

Computer Vision and Pattern Recognition

Abstract:People with vocal and hearing disabilities use sign language to express themselves using visual gestures and signs. Although sign language is a solution for communication difficulties faced by deaf people, there are still problems as most of the general population cannot understand this language, creating a communication barrier, especially in places such as banks, airports, supermarkets, etc. [1]. A sign language recognition(SLR) system is a must to solve this problem. The main focus of this model is to develop a real-time word-level sign language recognition system that would translate sign language to text. Much research has been done on ASL(American sign language). Thus, we have worked on ISL(Indian sign language) to cater to the needs of the deaf and hard-of-hearing community of India[2]. In this research, we provide an Indian Sign Language-based Sign Language recognition system. For this analysis, the user must be able to take pictures of hand movements using a web camera, and the system must anticipate and display the name of the taken picture. The acquired image goes through several processing phases, some of which use computer vision techniques, including grayscale conversion, dilatation, and masking. Our model is trained using a convolutional neural network (CNN), which is then utilized to recognize the images. Our best model has a 99% accuracy rate[3].
Sign Language e-Learning system for hearing-impaired community of Pakistan

Amirita Dewani,Sania Bhatti,Mohsin Ali Memon,Wajiha Arain Arif,Quratulain Arain,Sayyid Batool Zehra

DOI: https://doi.org/10.1007/s41870-018-0105-4

2018-02-19

International Journal of Information Technology

Abstract:An increasing number of ratios in illness and injuries has lead to increase in the number of disabled people at the early age of birth. In this work we presented a web based e-learning system that is completely concerned with the sign language. In Pakistan, there is a scarcity of sign language resources available to assist deaf children in strengthening the language skills necessary for academic advancement. Thus, e-Learning for hearing impaired people is an application developed not only for deaf children but also for normal people to communicate with the deaf people. It is a web based application focusing on sign language of Pakistan which allows non-vocal information exchange. The purpose of this research work is twofold. First is to provide an e-learning system for educating sign language to deaf/hard-of-hearing people of Pakistan. Secondly, to develop a text translation system to translate English into its equivalent Pakistani sign language gestures in order to overcome communication barriers. The system also contains feedback for improving the quality of application by taking suggestions from normal and disable people. The proposed application is distributed in modular client server entities; the framework is specially designed for parents to edify their children the indispensable communication skills. We believe that proper communication lays the foundation for accelerated learning and reduced frustration.
Sign language recognition using a combination of new vision based features

Mahmoud M. Zaki,Samir I. Shaheen

DOI: https://doi.org/10.1016/j.patrec.2010.11.013

IF: 4.757

2011-03-01

Pattern Recognition Letters

Abstract:Sign languages are based on four components hand shape, place of articulation, hand orientation, and movement. This paper presents a novel combination of vision based features in order to enhance the recognition of underlying signs. Three features are selected to be mapped to these four components. Two of these features are newly introduced for American sign language recognition: kurtosis position and principal component analysis, PCA. Although PCA has been used before in sign a language as a dimensionality reduction technique, it is used here as a descriptor that represents a global image feature to provide a measure for hand configuration and hand orientation. Kurtosis position is used as a local feature for measuring edges and reflecting the place of articulation recognition. The third feature is motion chain code that represents the hand movement. On the basis of these features a prototype is designed, constructed and its performance is evaluated. It consists of skin color detector, connected component locator and dominant hand tracker, feature extractor and a Hidden Markov Model classifier. The input to the system is a sign from RWTH-BOSTON-50 database and the output is the corresponding word with a recognition error rate of 10.90%.

computer science, artificial intelligence
Indian Sign Language recognition system using SURF with SVM and CNN

Shagun Katoch,Varsha Singh,Uma Shanker Tiwary

DOI: https://doi.org/10.1016/j.array.2022.100141

2022-07-01

Array

Abstract:Hand signs are an effective form of human-to-human communication that has a number of possible applications. Being a natural means of interaction, they are commonly used for communication purposes by speech impaired people worldwide. In fact, about one percent of the Indian population belongs to this category. This is the key reason why it would have a huge beneficial effect on these individuals to incorporate a framework that would understand Indian Sign Language. In this paper, we present a technique that uses the Bag of Visual Words model (BOVW) to recognize Indian sign language alphabets (A-Z) and digits (0–9) in a live video stream and output the predicted labels in the form of text as well as speech. Segmentation is done based on skin colour as well as background subtraction. SURF (Speeded Up Robust Features) features have been extracted from the images and histograms are generated to map the signs with corresponding labels. The Support Vector Machine (SVM) and Convolutional Neural Networks (CNN) are used for classification. An interactive Graphical User Interface (GUI) is also developed for easy access.
BOOK REVIEW: Chimpanzee Politics: Power and Sex Among the Apes.By Frans de Waal. Johns Hopkins University Press, Baltimore, Maryland, 1998, xv = 235 pp., $29.95 (hardback)

D. Watts

DOI: https://doi.org/10.1023/A:1020586806742

1999-04-01

International Journal of Primatology

Abstract:
Sign language : a systematic review on classification and recognition

S Renjith,Rashmi Manazhy

DOI: https://doi.org/10.1007/s11042-024-18583-4

IF: 2.577

2024-02-22

Multimedia Tools and Applications

Abstract:Sign language serves as an alternative communication mode for those with limitations in hearing and speaking abilities. In India, an estimated population of around 2.7 million people have hearing or speech impairments. Among this population, a significant majority of 98% use sign language as their primary mode of communication. Unfortunately, the limited availability of human interpreters is a considerable obstacle in recognizing and identifying diverse sign languages. To tackle this issue, the present study aims to undertake a thorough examination of various computational methodologies used in various geographical areas for the purpose of categorizing and identifying discrete sign languages. Among the pool of 587 research papers deemed appropriate for qualitative assessment, a total of 95 studies were specifically focused on the categorization and identification of sign language using artificial intelligence-based techniques. The study examines prior research involving deep learning and machine learning methods for a systematic literature review of Sign Language Recognition (SLR). The categorization is made based on language, and the study investigates several facets, including sign type, signing modes, processing techniques, classification methodologies, and evaluation measures. The study reveals that extensive studies were carried out in Chinese, Arabic, and American sign languages. The findings of this review show that among the machine learning techniques, Support Vector Machine (SVM) exhibited higher performance measures, while Convolutional Neural Networks (CNN) exhibited higher performance among the deep learning techniques.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Real-Time Arabic Sign Language Recognition Using a Hybrid Deep Learning Model

Talal H. Noor,Ayman Noor,Ahmed F. Alharbi,Ahmed Faisal,Rakan Alrashidi,Ahmed S. Alsaedi,Ghada Alharbi,Tawfeeq Alsanoosy,Abdullah Alsaeedi

DOI: https://doi.org/10.3390/s24113683

IF: 3.9

2024-06-07

Sensors

Abstract:Sign language is an essential means of communication for individuals with hearing disabilities. However, there is a significant shortage of sign language interpreters in some languages, especially in Saudi Arabia. This shortage results in a large proportion of the hearing-impaired population being deprived of services, especially in public places. This paper aims to address this gap in accessibility by leveraging technology to develop systems capable of recognizing Arabic Sign Language (ArSL) using deep learning techniques. In this paper, we propose a hybrid model to capture the spatio-temporal aspects of sign language (i.e., letters and words). The hybrid model consists of a Convolutional Neural Network (CNN) classifier to extract spatial features from sign language data and a Long Short-Term Memory (LSTM) classifier to extract spatial and temporal characteristics to handle sequential data (i.e., hand movements). To demonstrate the feasibility of our proposed hybrid model, we created a dataset of 20 different words, resulting in 4000 images for ArSL: 10 static gesture words and 500 videos for 10 dynamic gesture words. Our proposed hybrid model demonstrates promising performance, with the CNN and LSTM classifiers achieving accuracy rates of 94.40% and 82.70%, respectively. These results indicate that our approach can significantly enhance communication accessibility for the hearing-impaired community in Saudi Arabia. Thus, this paper represents a major step toward promoting inclusivity and improving the quality of life for the hearing impaired.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Enhancing Arabic Sign Language Interpretation: Leveraging Convolutional Neural Networks and Transfer Learning

Saad Al Ahmadi,Farah Muhammad,Haya Al Dawsari

DOI: https://doi.org/10.3390/math12060823

IF: 2.4

2024-03-12

Mathematics

Abstract:In a world essentializing communication for human connection, the deaf community encounters distinct barriers. Sign language, their main communication method is rich in hand gestures but not widely understood outside their community, necessitating interpreters. The existing solutions for sign language recognition depend on extensive datasets for model training, risking overfitting with complex models. The scarcity of details on dataset sizes and model specifics in studies complicates the scalability and verification of these technologies. Furthermore, the omission of precise accuracy metrics in some research leaves the effectiveness of gesture recognition by these models in question. The key phases of this study are Data collection, Data preprocessing, Feature extraction using CNN and finally transfer learning-based classification. The purpose of utilizing CNN and transfer learning is to tap into pre-trained neural networks for optimizing performance on new, related tasks by reusing learned patterns, thus accelerating development and improving accuracy. Data preprocessing further involves resizing of images, normalization, standardization, color space conversion, augmentation and noise reduction. This phase is capable enough to prune the image dataset by improving the efficiency of the classifier. In the subsequent phase, feature extraction has been performed that includes the convolution layer, feature mapping, pooling layer and dropout layer to obtain refined features from the images. These refined features are used for classification using ResNet. Three different datasets are utilized for the assessment of proposed model. The ASL-DS-I Dataset includes a total of 5832 images of hand gestures whereas, ASL-DS-II contains 54,049 images and ASL-DS-III dataset includes 7857 images adopted from specified web links. The obtained results have been evaluated by using standard metrics including ROC curve, Precision, Recall and F-measure. Meticulous experimental analysis and comparison with three standard baseline methods demonstrated that the proposed model gives an impressive recognition accuracy of 96.25%, 95.85% and 97.02% on ASL-DS-I, ASL-DS-II and ASL-DS-III, respectively.

mathematics
Human-Computer Interaction with Hand Gesture Recognition Using ResNet and MobileNet

Abeer Alnuaim,Mohammed Zakariah,Wesam Atef Hatamleh,Hussam Tarazi,Vikas Tripathi,Enoch Tetteh Amoatey

DOI: https://doi.org/10.1155/2022/8777355

IF: 3.12

2022-03-26

Computational Intelligence and Neuroscience

Abstract:Sign language is the native language of deaf people, which they use in their daily life, and it facilitates the communication process between deaf people. The problem faced by deaf people is targeted using sign language technique. Sign language refers to the use of the arms and hands to communicate, particularly among those who are deaf. This varies depending on the person and the location from which they come. As a result, there is no standardization about the sign language to be used; for example, American, British, Chinese, and Arab sign languages are all distinct. Here, in this study we trained a model, which will be able to classify the Arabic sign language, which consists of 32 Arabic alphabet sign classes. In images, sign language is detected through the pose of the hand. In this study, we proposed a framework, which consists of two CNN models, and each of them is individually trained on the training set. The final predictions of the two models were ensembled to achieve higher results. The dataset used in this study is released in 2019 and is called as ArSL2018. It is launched at the Prince Mohammad Bin Fahd University, Al Khobar, Saudi Arabia. The main contribution in this study is resizing the images to 64 ∗ 64 pixels, converting from grayscale images to three-channel images, and then applying the median filter to the images, which acts as lowpass filtering in order to smooth the images and reduce noise and to make the model more robust to avoid overfitting. Then, the preprocessed image is fed into two different models, which are ResNet50 and MobileNetV2. ResNet50 and MobileNetV2 architectures were implemented together. The results we achieved on the test set for the whole data are with an accuracy of about 97% after applying many preprocessing techniques and different hyperparameters for each model, and also different data augmentation techniques.

mathematical & computational biology,neurosciences
Endoluminal ultrasound defines anatomy of the anal canal and pelvic floor

J. Tjandra,J. Milsom,V. Stolfi,I. Lavery,J. Oakley,J. Church,V. Fazio

DOI: https://doi.org/10.1007/BF02049404

1992-05-01

Diseases of the Colon & Rectum

Abstract:
Design of Arabic Sign Language Recognition Model

Muhammad Al-Barham,Ahmad Jamal,Musa Al-Yaman

DOI: https://doi.org/10.48550/arXiv.2301.02693

2023-01-06

Computer Vision and Pattern Recognition

Abstract:Deaf people are using sign language for communication, and it is a combination of gestures, movements, postures, and facial expressions that correspond to alphabets and words in spoken languages. The proposed Arabic sign language recognition model helps deaf and hard hearing people communicate effectively with ordinary people. The recognition has four stages of converting the alphabet into letters as follows: Image Loading stage, which loads the images of Arabic sign language alphabets that were used later to train and test the model, a pre-processing stage which applies image processing techniques such as normalization, Image augmentation, resizing, and filtering to extract the features which are necessary to accomplish the recognition perfectly, a training stage which is achieved by deep learning techniques like CNN, a testing stage which demonstrates how effectively the model performs for images did not see it before, and the model was built and tested mainly using PyTorch library. The model is tested on ArASL2018, consisting of 54,000 images for 32 alphabet signs gathered from 40 signers, and the dataset has two sets: training dataset and testing dataset. We had to ensure that the system is reliable in terms of accuracy, time, and flexibility of use explained in detail in this report. Finally, the future work will be a model that converts Arabic sign language into Arabic text.
Sign language recognition system for communicating to people with disabilities

Yulius Obi,Kent Samuel Claudio,Vetri Marvel Budiman,Said Achmad,Aditya Kurniawan

DOI: https://doi.org/10.1016/j.procs.2022.12.106

2023-01-11

Procedia Computer Science

Abstract:Sign language is one of the most reliable ways of communicating with special needs people, as it can be done anywhere. However, most people do not understand sign language. Therefore, we have devised an idea to make a desktop application that can recognize sign language and convert it to text in real time. This research uses American Sign Language (ASL) datasets and the Convolutional Neural Networks (CNN) classification system. In the classification, the hand image is first passed through a filter and after the filter is applied, the hand is passed through a classifier which predicts the class of the hand gestures. This research focuses on the accuracy of the recognition. Our Application resulted in 96,3% accuracy for the 26 letters of the alphabet.
A Comparative Analysis of Techniques and Algorithms for Recognising Sign Language

Rupesh Kumar,Ayush Sinha,Ashutosh Bajpai,S.K Singh

DOI: https://doi.org/10.48550/arXiv.2305.13941

2023-05-24

Abstract:Sign language is a visual language that enhances communication between people and is frequently used as the primary form of communication by people with hearing loss. Even so, not many people with hearing loss use sign language, and they frequently experience social isolation. Therefore, it is necessary to create human-computer interface systems that can offer hearing-impaired people a social platform. Most commercial sign language translation systems now on the market are sensor-based, pricey, and challenging to use. Although vision-based systems are desperately needed, they must first overcome several challenges. Earlier continuous sign language recognition techniques used hidden Markov models, which have a limited ability to include temporal information. To get over these restrictions, several machine learning approaches are being applied to transform hand and sign language motions into spoken or written language. In this study, we compare various deep learning techniques for recognising sign language. Our survey aims to provide a comprehensive overview of the most recent approaches and challenges in this field.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
Automated sign language detection and classification using reptile search algorithm with hybrid deep learning

Hadeel Alsolai,Leen Alsolai,Fahd N Al-Wesabi,Mahmoud Othman,Mohammed Rizwanullah,Amgad Atta Abdelmageed

DOI: https://doi.org/10.1016/j.heliyon.2023.e23252

IF: 3.776

2023-12-08

Heliyon

Abstract:Sign language recognition (SLR) contains the capability to convert sign language gestures into spoken or written language. This technology is helpful for deaf persons or hard of hearing by providing them with a way to interact with people who do not know sign language. It is also be utilized for automatic captioning in live events and videos. There are distinct methods of SLR comprising deep learning (DL), computer vision (CV), and machine learning (ML). One general approach utilises cameras for capturing the signer's hand and body movements and processing the video data for recognizing the gestures. One of challenges with SLR comprises the variability in sign language through various cultures and individuals, the difficulty of certain signs, and require for realtime processing. This study introduces an Automated Sign Language Detection and Classification using Reptile Search Algorithm with Hybrid Deep Learning (SLDC-RSAHDL). The presented SLDC-RSAHDL technique detects and classifies different types of signs using DL and metaheuristic optimizers. In the SLDC-RSAHDL technique, MobileNet feature extractor is utilized to produce feature vectors, and its hyperparameters can be adjusted by manta ray foraging optimization (MRFO) technique. For sign language classification, the SLDC-RSAHDL technique applies HDL model, which incorporates the design of Convolutional Neural Network (CNN) and Long-Short Term Memory (LSTM). At last, the RSA was exploited for the optimal hyperparameter selection of the HDL model, which resulted in an improved detection rate. The experimental result analysis of the SLDC-RSAHDL technique on sign language dataset demonstrates the improved performance of the SLDC-RSAHDL system over other existing DL techniques.
Sign Language Recognition

Harshita Khubchandani,K. T

DOI: https://doi.org/10.1109/ITT59889.2023.10184252

2023-05-24

Abstract:Deaf and hard-of-hearing persons communicate with each other and their communities by using sign language. As this is a natural method for people to interact with computers, many academics are researching it in order to make it simpler and more natural without the use of additional gadgets. So, the main objective of gesture recognition research is to develop systems that can recognise certain human gestures and use them, for instance, to communicate information. Quick, extremely accurate hand detection and real-time gesture identification must be possible with vision-based hand gesture interfaces. Learning sign movements is the first step in creating words and sentences for computer-assisted sign language interpretation. Both static and dynamic sign actions are available. Both types of gesture recognition are crucial to human culture, even if static gesture recognition is easier than dynamic gesture recognition. This paper outlines the processes needed to recognise sign language. The method of gathering data, as well as its preprocessing, transformation, feature extraction, categorization, and outcomes, are all examined. For this area of study, there are also some suggested directions for further research. The visual-manual modality used by sign languages is a collection of established languages. When a hand motion is inputted, the system instantly displays the appropriate recognized character on the monitor screen. In the following, research projects that led to a system that uses convolutional neural networks to identify handwriting on the basis of depth pictures the camera collects.

Computer Science
Signer-Independent Arabic Sign Language Recognition System Using Deep Learning Model

Kanchon Kanti Podder,Maymouna Ezeddin,Muhammad E. H. Chowdhury,Shaheenur Islam Sumon,Anas M. Tahir,Mohamed Arselene Ayari,Proma Dutta,Amith Khandakar,Zaid Bin Mahbub,Muhammad Abdul Kadir,Md. Shaheenur Islam Sumon

DOI: https://doi.org/10.3390/s23167156

IF: 3.9

2023-08-15

Sensors

Abstract:Every one of us has a unique manner of communicating to explore the world, and such communication helps to interpret life. Sign language is the popular language of communication for hearing and speech-disabled people. When a sign language user interacts with a non-sign language user, it becomes difficult for a signer to express themselves to another person. A sign language recognition system can help a signer to interpret the sign of a non-sign language user. This study presents a sign language recognition system that is capable of recognizing Arabic Sign Language from recorded RGB videos. To achieve this, two datasets were considered, such as (1) the raw dataset and (2) the face–hand region-based segmented dataset produced from the raw dataset. Moreover, operational layer-based multi-layer perceptron "SelfMLP" is proposed in this study to build CNN-LSTM-SelfMLP models for Arabic Sign Language recognition. MobileNetV2 and ResNet18-based CNN backbones and three SelfMLPs were used to construct six different models of CNN-LSTM-SelfMLP architecture for performance comparison of Arabic Sign Language recognition. This study examined the signer-independent mode to deal with real-time application circumstances. As a result, MobileNetV2-LSTM-SelfMLP on the segmented dataset achieved the best accuracy of 87.69% with 88.57% precision, 87.69% recall, 87.72% F1 score, and 99.75% specificity. Overall, face–hand region-based segmentation and SelfMLP-infused MobileNetV2-LSTM-SelfMLP surpassed the previous findings on Arabic Sign Language recognition by 10.970% accuracy.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

Surrogate health care laws help hospitals.

Dataset of Pakistan Sign Language and Automatic Recognition of Hand Configuration of Urdu Alphabet through Machine Learning

Enhancing sign language recognition using CNN and SIFT: A case study on Pakistan sign language

A multi-lingual sign language recognition system using machine learning

Recognition of Indian Sign Language (ISL) Using Deep Learning Model

Image-based Indian Sign Language Recognition: A Practical Review using Deep Neural Networks

Sign Language e-Learning system for hearing-impaired community of Pakistan

Sign language recognition using a combination of new vision based features

Indian Sign Language recognition system using SURF with SVM and CNN

BOOK REVIEW: Chimpanzee Politics: Power and Sex Among the Apes.By Frans de Waal. Johns Hopkins University Press, Baltimore, Maryland, 1998, xv = 235 pp., $29.95 (hardback)

Sign language : a systematic review on classification and recognition

Real-Time Arabic Sign Language Recognition Using a Hybrid Deep Learning Model

Enhancing Arabic Sign Language Interpretation: Leveraging Convolutional Neural Networks and Transfer Learning

Human-Computer Interaction with Hand Gesture Recognition Using ResNet and MobileNet

Endoluminal ultrasound defines anatomy of the anal canal and pelvic floor

Design of Arabic Sign Language Recognition Model

Sign language recognition system for communicating to people with disabilities

A Comparative Analysis of Techniques and Algorithms for Recognising Sign Language

Automated sign language detection and classification using reptile search algorithm with hybrid deep learning

Sign Language Recognition

Signer-Independent Arabic Sign Language Recognition System Using Deep Learning Model