Gesture Recognition Method Based on Computer Vision and Surface Electromyography : Implementing Intention Recognition of the Healthy Side in the Hand Assessment Process

Chaojie Yang,Longhan Xie
DOI: https://doi.org/10.1109/nnice61279.2024.10498755
2024-01-01
Abstract:With the rapid development of sensing technology, a variety of hand rehabilitation assessment systems have emerged as choices for patients engaged in home-based rehabilitation. However, challenges such as fixed assessment sequences and operational constraints persist. To enhance the efficiency of hand rehabilitation assessment systems, employing gesture recognition to detect the healthy side's movement intent for assisting in the evaluation is a viable solution. In recent years, significant improvements have been made in gesture recognition methods, with some based on computer vision(CV) and surface electromyography(sEMG) demonstrating promising results. This paper explores a gesture recognition method based on both CV and sEMG. Initially, image data and surface electromyographic signals are collected, and joint coordinate data is extracted using the Mediapipe API. Subsequently, both sets of data undergo preprocessing and feature extraction, followed by training random forest(RF) and Convolutional Neural Network(CNN) classifiers separately. A weighted decision-making approach is then employed, achieving a commendable performance in gesture recognition, with an accuracy rate of 96.66%.
What problem does this paper attempt to address?