Abstract:In recent years, deep learning techniques have been used to develop sign language recognition systems, potentially serving as a communication tool for millions of hearing-impaired individuals worldwide. However, there are inherent challenges in creating such systems. Firstly, it is important to consider as many linguistic parameters as possible in gesture execution to avoid ambiguity between words. Moreover, to facilitate the real-world adoption of the created solution, it is essential to ensure that the chosen technology is realistic, avoiding expensive, intrusive, or low-mobility sensors, as well as very complex deep learning architectures that impose high computational requirements. Based on this, our work aims to propose an efficient sign language recognition system that utilizes low-cost sensors and techniques. To this end, an object detection model was trained specifically for detecting the interpreter's face and hands, ensuring focus on the most relevant regions of the image and generating inputs with higher semantic value for the classifier. Additionally, we introduced a novel approach to obtain features representing hand location and movement by leveraging spatial information derived from centroid positions of bounding boxes, thereby enhancing sign discrimination. The results demonstrate the efficiency of our handcrafted features, increasing accuracy by 7.96% on the AUTSL dataset, while adding fewer than 700 thousand parameters and incurring less than 10 milliseconds of additional inference time. These findings highlight the potential of our technique to strike a favorable balance between computational cost and accuracy, making it a promising approach for practical sign language recognition applications.

Sign Language Recognition Algorithm Based on Depth Image Information

Sign language recognition using a combination of new vision based features

A Robust Static Sign Language Recognition System Based on Hand Key Points Estimation

Sign Language Recognition with Multi-modal Features.

Latent Support Vector Machine Modeling for Sign Language Recognition with Kinect

An Isolated Sign Language Recognition System Using RGB-D Sensor with Sparse Coding

Sign Language Recognition from Digital Videos Using Deep Learning Methods

Sign Language Recognition Using Microsoft Kinect

SignCol: Open-Source Software for Collecting Sign Language Gestures

Indian Sign Language recognition system using SURF with SVM and CNN

Sign language recognition based on deep learning and low-cost handcrafted descriptors

Discriminative exemplar coding for sign language recognition with Kinect.

A new system for Chinese sign language recognition

Sign Language Gesture Recognition and Classification Based on Event Camera with Spiking Neural Networks

Sign Language Recognition

Chinese Sign Language Recognition Based on DTW-Distance-Mapping Features

Attention-Based Sign Language Recognition Network Utilizing Keyframe Sampling and Skeletal Features

An Efficient Sign Language Recognition (SLR) System Using Camshift Tracker and Hidden Markov Model (HMM)

Sign Language Recognition Based On Facial Expression and Hand Skeleton

Indian Sign Language Gesture Recognition using Image Processing and Deep Learning

Robust Sign Language Recognition System Using ToF Depth Cameras