Tactile Perception in Upper Limb Prostheses: Mechanical Characterization, Human Experiments, and Computational Findings

Alessia Silvia Ivani,Manuel G. Catalano,Giorgio Grioli,Matteo Bianchi,Yon Visell,Antonio Bicchi

DOI: https://doi.org/10.1109/TOH.2024.3436827

2024-08-22

Abstract:Our research investigates vibrotactile perception in four prosthetic hands with distinct kinematics and mechanical characteristics. We found that rigid and simple socket-based prosthetic devices can transmit tactile information and surprisingly enable users to identify the stimulated finger with high reliability. This ability decreases with more advanced prosthetic hands with additional articulations and softer mechanics. We conducted experiments to understand the underlying mechanisms. We assessed a prosthetic user's ability to discriminate finger contacts based on vibrations transmitted through the four prosthetic hands. We also performed numerical and mechanical vibration tests on the prostheses and used a machine learning classifier to identify the contacted finger. Our results show that simpler and rigid prosthetic hands facilitate contact discrimination (for instance, a user of a purely cosmetic hand can distinguish a contact on the index finger from other fingers with 83% accuracy), but all tested hands, including soft advanced ones, performed above chance level. Despite advanced hands reducing vibration transmission, a machine learning algorithm still exceeded human performance in discriminating finger contacts. These findings suggest the potential for enhancing vibrotactile feedback in advanced prosthetic hands and lay the groundwork for future integration of such feedback in prosthetic devices.

Robotics,Human-Computer Interaction

What problem does this paper attempt to address?

The paper aims to address the issue of tactile feedback in upper limb prosthetics. Specifically, the research focuses on how to naturally transmit tactile signals through prosthetic devices and explores the impact of this transmission mechanism on user perception. Due to the challenges existing prosthetic devices face in conveying physiological tactile information, users need to adapt to non-physiological signals, which increases cognitive load. However, some prosthetic devices can transmit tactile information through socket vibrations, even for untrained individuals.

The study experimentally validated this observation, demonstrating that even with completely passive decorative prosthetic hands, users could identify the touched fingers. Further experiments found that as the complexity of the prosthetic hand increased, the performance of tactile information transmitted through socket vibrations decreased. To understand the underlying mechanisms, researchers conducted numerical and mechanical vibration tests and used machine learning classifiers to identify the touched fingers based on the measured socket signals. Quantitative results showed that rigid prosthetic hands facilitated contact identification, achieving an accuracy of 83%. Although human identification ability decreased with the use of advanced prosthetic hands, the performance of machine learning surpassed that of humans, indicating that active sensing and actuation could enhance socket vibrations, thereby improving tactile identification between rigid and advanced prosthetic hands.