Abstract:Real-time speech-to-text and text-to-speech technologies have significantly influenced the accessibility of communication for individuals who are deaf or mute. This research aims to assess the efficacy of these technologies in facilitating communication between deaf or mute individuals and those who are neither deaf nor mute. A mixed-method approach will incorporate qualitative and quantitative data collection and analysis techniques. The study will involve participants from deaf or mute and non-deaf or non-mute communities. The research will scrutinize the precision and efficiency of communication using these technologies and evaluate user experience and satisfaction. Furthermore, the study intends to pinpoint potential obstacles and limitations of these technologies and offer suggestions for enhancing their effectiveness in fostering inclusivity. The study proposes an active learning framework for sign language gesture recognition, termed Active Convolutional Neural Networks—Sign Language (ActiveCNN-SL). ActiveCNN-SL aims to minimize the labeled data required for training and augment the accuracy of sign language gesture recognition through iterative human feedback. This proposed framework holds the potential to enhance communication accessibility for deaf and mute individuals and encourage inclusivity across various environments. The proposed framework is trained using two primary datasets: (i) the Sign Language Gesture Images Dataset and (ii) the American Sign Language Letters (ASL)—v1. The framework employs Resnet50 and YoloV.8 to train the datasets. It has demonstrated high performance in terms of precision and accuracy. The ResNet model achieved a remarkable accuracy rate of 99.98% during training, and it also exhibited a validation accuracy of 100%, surpassing the baseline CNN and RNN models. The YOLOv8 model outperformed previous methods on the ASL alphabet dataset, achieving an overall mean average accuracy for all classes of 97.8%.

A real-time Artificial Intelligence system for learning Sign Language

Artificial Intelligence for Sign Language Translation – A Design Science Research Study

Artificial Intelligence Technologies for Sign Language

Sign Language Recognition and Translation: A Multidisciplined Approach From the Field of Artificial Intelligence

SmartASL

Editorial: Bridging the Gap: AI and Sign Language Recognition– A Path Toward Inclusive Communication

Silent no more: a comprehensive review of artificial intelligence, deep learning, and machine learning in facilitating deaf and mute communication

Bridging the Communication Gap: Artificial Agents Learning Sign Language through Imitation

Recent Advances Of Deep Learning For Sign Language Recognition

ASLRing: American Sign Language Recognition with Meta-Learning on Wearables

Systemic Biases in Sign Language AI Research: A Deaf-Led Call to Reevaluate Research Agendas

Real-Time Multilingual Sign Language Processing

An intelligent system to help deaf students learn Arabic Sign Language

ASL Citizen: A Community-Sourced Dataset for Advancing Isolated Sign Language Recognition

DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation

Active convolutional neural networks sign language (ActiveCNN-SL) framework: a paradigm shift in deaf-mute communication

A Bi-directional Interactive System of Sign Language and Visual Speech Based on Portable Devices.

Sign Language Conversation Interpretation Using Wearable Sensors and Machine Learning

A Lightweight Network-Based Sign Language Robot with Facial Mirroring and Speech System

The FATE Landscape of Sign Language AI Datasets

Translation System for Sign Language Learning