Abstract:In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent challenges in creating such systems. Firstly, it is important to consider as many linguistic parameters as possible in gesture execution to avoid ambiguity between words. Moreover, to facilitate the real-world adoption of the created solution, it is essential to ensure that the chosen technology is realistic, avoiding expensive, intrusive, or low-mobility sensors, as well as very complex deep learning architectures that impose high computational requirements. Based on this, our work aims to propose an efficient sign language recognition system that utilizes low-cost sensors and techniques. To this end, an object detection model was trained specifically for detecting the interpreter's face and hands, ensuring focus on the most relevant regions of the image and generating inputs with higher semantic value for the classifier. Additionally, we introduced a novel approach to obtain features representing hand location and movement by leveraging spatial information derived from centroid positions of bounding boxes, thereby enhancing sign discrimination. The results demonstrate the efficiency of our handcrafted features, increasing accuracy by 7.96% on the AUTSL dataset, while adding fewer than 700 thousand parameters and incurring less than 10 milliseconds of additional inference time. These findings highlight the potential of our technique to strike a favorable balance between computational cost and accuracy, making it a promising approach for practical sign language recognition applications.

A Robust Static Sign Language Recognition System Based on Hand Key Points Estimation

An Isolated Sign Language Recognition System Using RGB-D Sensor with Sparse Coding

A Static Sign Language Recognition Method Enhanced with Self-Attention Mechanisms

Sign Language Recognition Algorithm Based on Depth Image Information

Sign language recognition based on deep learning and low-cost handcrafted descriptors

Static sign Language alphabet recognition based on improved excluded Pseudo-match SURF algorithm

RF-CSign: A Chinese Sign Language Recognition System Based on Large Kernel Convolution and Normalization-Based Attention

Sign Annotation Generation to Alphabets Via Integrating Visual Data with Somatosensory Data from Flexible Strain Sensor-Based Data Glove

Chinese Sign Language Alphabet Recognition Based on Random Forest Algorithm

Sign language recognition system for communicating to people with disabilities

Sign language recognition using a combination of new vision based features

Non-Touch Sign Word Recognition Based on Dynamic Hand Gesture Using Hybrid Segmentation and CNN Feature Fusion

A Sign Language Recognition Method Based on Multi-sensor Information

SignCol: Open-Source Software for Collecting Sign Language Gestures

L-Sign: Large-Vocabulary Sign Gestures Recognition System

Sign Language Recognition Based On Facial Expression and Hand Skeleton

Improved sign language recognition research using depth image information and SLVW

A Simple Sign Language Recognition System Based on Data Glove

Sign Language Recognition Using Microsoft Kinect

Sign Language Recognition Method Based on Palm Definition Model and Multiple Classification

A Fast Sign Word Recognition Method for Chinese Sign Language