Abstract:Hand gesture recognition (HGR) is a vital component in enhancing the human-computer interaction experience, particularly in multimedia applications, such as virtual reality, gaming, smart home automation systems, etc. Users can control and navigate through these applications seamlessly by accurately detecting and recognizing gestures. However, in a real-time scenario, the performance of the gesture recognition system is sometimes affected due to the presence of complex background, low-light illumination, occlusion problems, etc. Another issue is building a fast and robust gesture-controlled human-computer interface (HCI) in the real-time scenario. The overall objective of this paper is to develop an efficient hand gesture detection and classification model using a channel-pruned YOLOv5-small model and utilize the model to build a gesture-controlled HCI with a quick response time (in ms) and higher detection speed (in fps). First, the YOLOv5s model is chosen for the gesture detection task. Next, the model is simplified by using a channel-pruned algorithm. After that, the pruned model is further fine-tuned to ensure detection efficiency. We have compared our suggested scheme with other state-of-the-art works, and it is observed that our model has shown superior results in terms of mAP (mean average precision), precision (\%), recall (\%), and F1-score (\%), fast inference time (in ms), and detection speed (in fps). Our proposed method paves the way for deploying a pruned YOLOv5s model for a real-time gesture-command-based HCI to control some applications, such as the VLC media player, Spotify player, etc., using correctly classified gesture commands in real-time scenarios. The average detection speed of our proposed system has reached more than 60 frames per second (fps) in real-time, which meets the perfect requirement in real-time application control.

Gesture Recognition Controls Image Style Transfer Based on Improved YOLOV5s Algorithm

Computer Interactive Gesture Recognition Model Based on Improved YOLOv5 Algorithm

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Gesture Detection and Recognition Based on Object Detection in Complex Background

Multimodal Gesture Recognition with Spatio-Temporal Features Fusion Based on YOLOv5 and MediaPipe

Object Detection Method for Grasping Robot Based on Improved YOLOv5

Gesture Recognition Algorithm Based on Computer Vision

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

HGR-FYOLO: a robust hand gesture recognition system for the normal and physically impaired person using frozen YOLOv5

Hand Gesture Control for Human–Computer Interaction with Deep Learning

Novel Human Machine Interface via Robust Hand Gesture Recognition System using Channel Pruned YOLOv5s Model

Mixed Hand Gesture Recognition System And Its Application

Control Method of Perceptual Elements Based on Universal Neural Style Transfer

Digital Image Art Style Transfer Algorithm Based on CycleGAN

Interaction and control with the auxiliary of hand gesture

Air-GR: An Over-the-Air Handwritten Character Recognition System Based on Coordinate Correction YOLOv5 Algorithm and LGR-CNN

Visual Hand Gesture Recognition With Convolution Neural Network

Research on Face Recognition Technology Based on Improved YOLO Deep Convolution Neural Network

An Improved Gesture Segmentation Method for Gesture Recognition Based on CNN and YCbCr

Football referee gesture recognition algorithm based on YOLOv8s

An improved YOLOv5 algorithm for obscured target recognition