Abstract:In a world essentializing communication for human connection, the deaf community encounters distinct barriers. Sign language, their main communication method is rich in hand gestures but not widely understood outside their community, necessitating interpreters. The existing solutions for sign language recognition depend on extensive datasets for model training, risking overfitting with complex models. The scarcity of details on dataset sizes and model specifics in studies complicates the scalability and verification of these technologies. Furthermore, the omission of precise accuracy metrics in some research leaves the effectiveness of gesture recognition by these models in question. The key phases of this study are Data collection, Data preprocessing, Feature extraction using CNN and finally transfer learning-based classification. The purpose of utilizing CNN and transfer learning is to tap into pre-trained neural networks for optimizing performance on new, related tasks by reusing learned patterns, thus accelerating development and improving accuracy. Data preprocessing further involves resizing of images, normalization, standardization, color space conversion, augmentation and noise reduction. This phase is capable enough to prune the image dataset by improving the efficiency of the classifier. In the subsequent phase, feature extraction has been performed that includes the convolution layer, feature mapping, pooling layer and dropout layer to obtain refined features from the images. These refined features are used for classification using ResNet. Three different datasets are utilized for the assessment of proposed model. The ASL-DS-I Dataset includes a total of 5832 images of hand gestures whereas, ASL-DS-II contains 54,049 images and ASL-DS-III dataset includes 7857 images adopted from specified web links. The obtained results have been evaluated by using standard metrics including ROC curve, Precision, Recall and F-measure. Meticulous experimental analysis and comparison with three standard baseline methods demonstrated that the proposed model gives an impressive recognition accuracy of 96.25%, 95.85% and 97.02% on ASL-DS-I, ASL-DS-II and ASL-DS-III, respectively.

A convolutional neural network to classify American Sign Language fingerspelling from depth and colour images

Hypertuned Deep Convolutional Neural Network for Sign Language Recognition

Real-Time Sign Language Fingerspelling Recognition using Convolutional Neural Network

Sign Language to Text Conversion

Enhancing Arabic Sign Language Interpretation: Leveraging Convolutional Neural Networks and Transfer Learning

Sign Language Detection and Conversion to Text and Speech Conversion

ASL-3DCNN: American sign language recognition technique using 3-D convolutional neural networks

Live American Sign Language Letter Classification with Convolutional Neural Networks

American Sign Language Identification Using Hand Trackpoint Analysis

Automated Sign to Speech Conversion Model using Deep Learning

Sign language recognition based on dual-path background erasure convolutional neural network

Sign Language Recognition from Digital Videos Using Deep Learning Methods

A Deep Learning Approach for ASL Recognition and Text-to-Speech Synthesis using CNN

An Open-Source American Sign Language Fingerspell Recognition and Semantic Pose Retrieval Interface

Sign language recognition system for communicating to people with disabilities

Deepsign: Sign Language Detection and Recognition Using Deep Learning

An eight-layer convolutional neural network with stochastic pooling, batch normalization and dropout for fingerspelling recognition of Chinese sign language

Sign language detection using convolutional neural network

Sign language recognition using a combination of new vision based features

Active convolutional neural networks sign language (ActiveCNN-SL) framework: a paradigm shift in deaf-mute communication

Attention-Based 3D-Cnns for Large-Vocabulary Sign Language Recognition.