Abstract:In a world essentializing communication for human connection, the deaf community encounters distinct barriers. Sign language, their main communication method is rich in hand gestures but not widely understood outside their community, necessitating interpreters. The existing solutions for sign language recognition depend on extensive datasets for model training, risking overfitting with complex models. The scarcity of details on dataset sizes and model specifics in studies complicates the scalability and verification of these technologies. Furthermore, the omission of precise accuracy metrics in some research leaves the effectiveness of gesture recognition by these models in question. The key phases of this study are Data collection, Data preprocessing, Feature extraction using CNN and finally transfer learning-based classification. The purpose of utilizing CNN and transfer learning is to tap into pre-trained neural networks for optimizing performance on new, related tasks by reusing learned patterns, thus accelerating development and improving accuracy. Data preprocessing further involves resizing of images, normalization, standardization, color space conversion, augmentation and noise reduction. This phase is capable enough to prune the image dataset by improving the efficiency of the classifier. In the subsequent phase, feature extraction has been performed that includes the convolution layer, feature mapping, pooling layer and dropout layer to obtain refined features from the images. These refined features are used for classification using ResNet. Three different datasets are utilized for the assessment of proposed model. The ASL-DS-I Dataset includes a total of 5832 images of hand gestures whereas, ASL-DS-II contains 54,049 images and ASL-DS-III dataset includes 7857 images adopted from specified web links. The obtained results have been evaluated by using standard metrics including ROC curve, Precision, Recall and F-measure. Meticulous experimental analysis and comparison with three standard baseline methods demonstrated that the proposed model gives an impressive recognition accuracy of 96.25%, 95.85% and 97.02% on ASL-DS-I, ASL-DS-II and ASL-DS-III, respectively.

Towards A Sign Language Gloss Representation Of Modern Standard Arabic

Arabic sign language intelligent translator

Real-Time Arabic Sign Language Recognition Using a Hybrid Deep Learning Model

Design of Arabic Sign Language Recognition Model

A real-time Arabic avatar for deaf–mute community using attention mechanism

An intelligent system to help deaf students learn Arabic Sign Language

Advanced Arabic Alphabet Sign Language Recognition Using Transfer Learning and Transformer Models

3D gesture segmentation for word-level Arabic sign language using large-scale RGB video sequences and autoencoder convolutional networks

Enhancing Arabic Sign Language Interpretation: Leveraging Convolutional Neural Networks and Transfer Learning

SignsWorld; Deeping Into the Silence World and Hearing Its Signs (State of the Art)

Gesture based Arabic Sign Language Recognition for Impaired People based on Convolution Neural Network

Toward an example-based machine translation from written text to ASL using virtual agent animation

Machine Learning and Deep Learning Approaches for Arabic Sign Language Recognition: A Decade Systematic Literature Review

A Real Time Arabic Sign Language Alphabets (ArSLA) Recognition Model Using Deep Learning Architecture

Design and Implementation of a Virtual 3D Educational Environment to improve Deaf Education

Human-Computer Interaction with Hand Gesture Recognition Using ResNet and MobileNet

All You Need In Sign Language Production

Statistical Sign Language Machine Translation: from English written text to American Sign Language Gloss

Signer-Independent Arabic Sign Language Recognition System Using Deep Learning Model

Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application

Isolated Arabic Sign Language Recognition Using A Transformer-based Model and Landmark Keypoints