Abstract:In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent challenges in creating such systems. Firstly, it is important to consider as many linguistic parameters as possible in gesture execution to avoid ambiguity between words. Moreover, to facilitate the real-world adoption of the created solution, it is essential to ensure that the chosen technology is realistic, avoiding expensive, intrusive, or low-mobility sensors, as well as very complex deep learning architectures that impose high computational requirements. Based on this, our work aims to propose an efficient sign language recognition system that utilizes low-cost sensors and techniques. To this end, an object detection model was trained specifically for detecting the interpreter's face and hands, ensuring focus on the most relevant regions of the image and generating inputs with higher semantic value for the classifier. Additionally, we introduced a novel approach to obtain features representing hand location and movement by leveraging spatial information derived from centroid positions of bounding boxes, thereby enhancing sign discrimination. The results demonstrate the efficiency of our handcrafted features, increasing accuracy by 7.96% on the AUTSL dataset, while adding fewer than 700 thousand parameters and incurring less than 10 milliseconds of additional inference time. These findings highlight the potential of our technique to strike a favorable balance between computational cost and accuracy, making it a promising approach for practical sign language recognition applications.

A Static Hand Gesture Recognition for Peruvian Sign Language Using Digital Image Processing and Deep Learning

A Recognition Method for Italian Alphabet Gestures Based on Convolutional Neural Network

Indian Sign Language Gesture Recognition using Image Processing and Deep Learning

Peruvian Sign Language Recognition Using a Hybrid Deep Neural Network

Dynamic gesture recognition using hand pose-based neural networks for sign language interpretation

Sign language recognition based on deep learning and low-cost handcrafted descriptors

Automatic American sign language prediction for static and dynamic gestures using KFM-CNN

Sign Language Recognition

Automatic Digit Hand Sign Detection With Hand Landmark

Hand Gesture Detection for Sign Language using Neural Network with Mediapipe

Deepsign: Sign Language Detection and Recognition Using Deep Learning

Hand Gesture Recognition Using Automatic Feature Extraction and Deep Learning Algorithms with Memory

Sign Language Recognition Using Wearable Electronics: Implementing k-Nearest Neighbors with Dynamic Time Warping and Convolutional Neural Network Algorithms

Deep self-supervised learning with visualisation for automatic gesture recognition

Sign language recognition by means of common spatial patterns: An analysis

Sign language recognition system for communicating to people with disabilities

Dynamic Sign Language Recognition Using Mediapipe Library and Modified LSTM Method

Computer Vision-Enabled Character Recognition of Hand Gestures for Patients with Hearing and Speaking Disability

Hand Gesture Control for Human–Computer Interaction with Deep Learning

Hand Gesture Recognition using Image Processing and Feature Extraction Techniques

Exploiting Recurrent Neural Networks and Leap Motion Controller for Sign Language and Semaphoric Gesture Recognition