sEMG-Based Robust Recognition of Grasping Postures with a Machine Learning Approach for Low-Cost Hand Control

Marta C. Mora,José V. García-Ortiz,Joaquín Cerdá-Boluda

DOI: https://doi.org/10.3390/s24072063

IF: 3.9

2024-03-24

Sensors

Abstract:The design and control of artificial hands remains a challenge in engineering. Popular prostheses are bio-mechanically simple with restricted manipulation capabilities, as advanced devices are pricy or abandoned due to their difficult communication with the hand. For social robots, the interpretation of human intention is key for their integration in daily life. This can be achieved with machine learning (ML) algorithms, which are barely used for grasping posture recognition. This work proposes an ML approach to recognize nine hand postures, representing 90% of the activities of daily living in real time using an sEMG human–robot interface (HRI). Data from 20 subjects wearing a Myo armband (8 sEMG signals) were gathered from the NinaPro DS5 and from experimental tests with the YCB Object Set, and they were used jointly in the development of a simple multi-layer perceptron in MATLAB, with a global percentage success of 73% using only two features. GPU-based implementations were run to select the best architecture, with generalization capabilities, robustness-versus-electrode shift, low memory expense, and real-time performance. This architecture enables the implementation of grasping posture recognition in low-cost devices, aimed at the development of affordable functional prostheses and HRI for social robots.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

What problem does this paper attempt to address?

The aim of this paper is to design a machine learning method based on surface electromyography (sEMG) signals to achieve real-time, low-cost hand gesture recognition for controlling advanced prosthetic or robotic hands with multiple degrees of freedom. Specifically, the goal of the paper is to recognize nine grasping gestures, which represent 90% of daily activities, in real-time applications using a simple multilayer perceptron algorithm. The study also focuses on implementing this functionality on low-cost devices to develop affordable functional prosthetics and interactive interfaces for social robots.

The main contributions of the paper include:
- Developing machine learning techniques by combining public datasets and laboratory datasets;
- Calculating only two features from sEMG signals to achieve rapid grasping gesture detection;
- Proposing machine learning techniques robust to electrode displacement and implementing them with GPU acceleration;
- Validating the effectiveness and robustness of the proposed methods under various experimental conditions.