Abstract:Introduction: Hand gestures are an effective communication tool that may convey a wealth of information in a variety of sectors, including medical and education. E-learning has grown significantly in the last several years and is now an essential resource for many businesses. Still, there has not been much research conducted on the use of hand gestures in e-learning. Similar to this, gestures are frequently used by medical professionals to help with diagnosis and treatment. Method: We aim to improve the way instructors, students, and medical professionals receive information by introducing a dynamic method for hand gesture monitoring and recognition. Six modules make up our approach: video-to-frame conversion, preprocessing for quality enhancement, hand skeleton mapping with single shot multibox detector (SSMD) tracking, hand detection using background modeling and convolutional neural network (CNN) bounding box technique, feature extraction using point-based and full-hand coverage techniques, and optimization using a population-based incremental learning algorithm. Next, a 1D CNN classifier is used to identify hand motions. Results: After a lot of trial and error, we were able to obtain a hand tracking accuracy of 83.71% and 85.71% over the Indian Sign Language and WLASL datasets, respectively. Our findings show how well our method works to recognize hand motions. Discussion: Teachers, students, and medical professionals can all efficiently transmit and comprehend information by utilizing our suggested system. The obtained accuracy rates highlight how our method might improve communication and make information exchange easier in various domains.

Skeleton Based Dynamic Hand Gesture Recognition using LSTM and CNN

Dynamic hand gesture recognition using hidden Markov models

Real Time Hand Gesture Recognition Using Leap Motion Controller Based on CNN-SVM Architechture

CNN+RNN Depth and Skeleton based Dynamic Hand Gesture Recognition

Automatic 3D Skeleton-based Dynamic Hand Gesture Recognition Using Multi-Layer Convolutional LSTM.

Skeleton Based Dynamic Hand Gesture Recognition using Short Term Sampling Neural Networks (STSNN).

Skeleton-based Dynamic Hand Gesture Recognition using 3D Depth Data

Dynamic Hand Gesture Recognition Based On 3D Skeleton

Motion Feature Augmented Recurrent Neural Network for Skeleton-based Dynamic Hand Gesture Recognition

Gesture Recognition Based on Skeletonization Algorithm and CNN with ASL Database

Gesture Recognition Matching Based on Dynamic Skeleton

Dynamic Hand Gesture Recognition Based on a Leap Motion Controller and Two-Layer Bidirectional Recurrent Neural Network

Multimodal Gesture Recognition Using 3-D Convolution and Convolutional LSTM

Real-Time Hand Gesture Recognition: Integrating Skeleton-Based Data Fusion and Multi-Stream CNN

Skeleton-Based Gesture Recognition Using Several Fully Connected Layers with Path Signature Features and Temporal Transformer Module.

Dyhand: dynamic hand gesture recognition using BiLSTM and soft attention methods

Innovative healthcare solutions: robust hand gesture recognition of daily life routines using 1D CNN

Spatial-temporal Dynamic Hand Gesture Recognition Via Hybrid Deep Learning Model

An Incremental Learning Framework for Skeletal-based Hand Gesture Recognition with Leap Motion

Real-Time Monocular Skeleton-Based Hand Gesture Recognition Using 3D-Jointsformer

3D dynamic hand gestures recognition using the Leap Motion sensor and convolutional neural networks