Abstract:In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent challenges in creating such systems. Firstly, it is important to consider as many linguistic parameters as possible in gesture execution to avoid ambiguity between words. Moreover, to facilitate the real-world adoption of the created solution, it is essential to ensure that the chosen technology is realistic, avoiding expensive, intrusive, or low-mobility sensors, as well as very complex deep learning architectures that impose high computational requirements. Based on this, our work aims to propose an efficient sign language recognition system that utilizes low-cost sensors and techniques. To this end, an object detection model was trained specifically for detecting the interpreter's face and hands, ensuring focus on the most relevant regions of the image and generating inputs with higher semantic value for the classifier. Additionally, we introduced a novel approach to obtain features representing hand location and movement by leveraging spatial information derived from centroid positions of bounding boxes, thereby enhancing sign discrimination. The results demonstrate the efficiency of our handcrafted features, increasing accuracy by 7.96% on the AUTSL dataset, while adding fewer than 700 thousand parameters and incurring less than 10 milliseconds of additional inference time. These findings highlight the potential of our technique to strike a favorable balance between computational cost and accuracy, making it a promising approach for practical sign language recognition applications.

Automatic Digit Hand Sign Detection With Hand Landmark

Recursive Feature Elimination for Improving Learning Points on Hand-Sign Recognition

Automatic Hand Sign Recognition: Identify Unusuality through Latent Cognizance

A New Framework for Sign Language Recognition Based on 3D Handshape Identification and Linguistic Modeling

Sign Language Recognition

American Sign Language Identification Using Hand Trackpoint Analysis

Hand Gesture Detection for Sign Language using Neural Network with Mediapipe

Automatic American sign language prediction for static and dynamic gestures using KFM-CNN

Interpreting Hand gestures using Object Detection and Digits Classification

Sign language recognition based on deep learning and low-cost handcrafted descriptors

Sign Language Detector using cloud

Recent Advances Of Deep Learning For Sign Language Recognition

An Approach Based on 1D Fully Convolutional Network for Continuous Sign Language Recognition and Labeling

Towards Low-Cost Sign Language Gesture Recognition Leveraging Wearables

An accurate estimation of hand gestures using optimal modified convolutional neural network

Deep Learning-Based Standard Sign Language Discrimination

Vietnamese sign language detection using Mediapipe

ADDSL: Hand Gesture Detection and Sign Language Recognition on Annotated Danish Sign Language

Chinese sign language recognition with 3D hand motion trajectories and depth images

Hand-Model-Aware Sign Language Recognition

Dataglove for Sign Language Recognition of People with Hearing and Speech Impairment via Wearable Inertial Sensors