Abstract:In a world essentializing communication for human connection, the deaf community encounters distinct barriers. Sign language, their main communication method is rich in hand gestures but not widely understood outside their community, necessitating interpreters. The existing solutions for sign language recognition depend on extensive datasets for model training, risking overfitting with complex models. The scarcity of details on dataset sizes and model specifics in studies complicates the scalability and verification of these technologies. Furthermore, the omission of precise accuracy metrics in some research leaves the effectiveness of gesture recognition by these models in question. The key phases of this study are Data collection, Data preprocessing, Feature extraction using CNN and finally transfer learning-based classification. The purpose of utilizing CNN and transfer learning is to tap into pre-trained neural networks for optimizing performance on new, related tasks by reusing learned patterns, thus accelerating development and improving accuracy. Data preprocessing further involves resizing of images, normalization, standardization, color space conversion, augmentation and noise reduction. This phase is capable enough to prune the image dataset by improving the efficiency of the classifier. In the subsequent phase, feature extraction has been performed that includes the convolution layer, feature mapping, pooling layer and dropout layer to obtain refined features from the images. These refined features are used for classification using ResNet. Three different datasets are utilized for the assessment of proposed model. The ASL-DS-I Dataset includes a total of 5832 images of hand gestures whereas, ASL-DS-II contains 54,049 images and ASL-DS-III dataset includes 7857 images adopted from specified web links. The obtained results have been evaluated by using standard metrics including ROC curve, Precision, Recall and F-measure. Meticulous experimental analysis and comparison with three standard baseline methods demonstrated that the proposed model gives an impressive recognition accuracy of 96.25%, 95.85% and 97.02% on ASL-DS-I, ASL-DS-II and ASL-DS-III, respectively.

A New 27 Class Sign Language Dataset Collected from 173 Individuals

ASL Citizen: A Community-Sourced Dataset for Advancing Isolated Sign Language Recognition

A New Dataset and Proposed Convolutional Neural Network Architecture for Classification of American Sign Language Digits

How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language

ASL-Homework-RGBD Dataset: An annotated dataset of 45 fluent and non-fluent signers performing American Sign Language homeworks

KU-BdSL: An open dataset for Bengali sign language recognition

ASL-Skeleton3D and ASL-Phono: Two Novel Datasets for the American Sign Language

LSA64: An Argentinian Sign Language Dataset

SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmark

Sign language images dataset from Mexican sign language

ADDSL: Hand Gesture Detection and Sign Language Recognition on Annotated Danish Sign Language

SignSpeak: Open-Source Time Series Classification for ASL Translation

The Sem-Lex Benchmark: Modeling ASL Signs and Their Phonemes

AzSLD: Azerbaijani Sign Language Dataset for Fingerspelling, Word, and Sentence Translation with Baseline Software

AUTSL: A Large Scale Multi-modal Turkish Sign Language Dataset and Baseline Methods

BBC-Oxford British Sign Language Dataset

Enhancing Arabic Sign Language Interpretation: Leveraging Convolutional Neural Networks and Transfer Learning

Kenyan Sign Language (KSL) Dataset: Using Artificial Intelligence (AI) in Bridging Communication Barrier among the Deaf Learners

The Serbian Sign Language Alphabet: A Unique Authentic Dataset of Letter Sign Gestures

BdSLW60: A Word-Level Bangla Sign Language Dataset

iSign: A Benchmark for Indian Sign Language Processing