Abstract:BackgroundMyoelectric pattern recognition systems can decode movement intention to drive upper-limb prostheses. Despite recent advances in academic research, the commercial adoption of such systems remains low. This limitation is mainly due to the lack of classification robustness and a simultaneous requirement for a large number of electromyogram (EMG) electrodes. We propose to address these two issues by using a multi-modal approach which combines surface electromyography (sEMG) with inertial measurements (IMs) and an appropriate training data collection paradigm. We demonstrate that this can significantly improve classification performance as compared to conventional techniques exclusively based on sEMG signals.MethodsWe collected and analyzed a large dataset comprising recordings with 20 able-bodied and two amputee participants executing 40 movements. Additionally, we conducted a novel real-time prosthetic hand control experiment with 11 able-bodied subjects and an amputee by using a state-of-the-art commercial prosthetic hand. A systematic performance comparison was carried out to investigate the potential benefit of incorporating IMs in prosthetic hand control.ResultsThe inclusion of IM data improved performance significantly, by increasing classification accuracy (CA) in the offline analysis and improving completion rates (CRs) in the real-time experiment. Our findings were consistent across able-bodied and amputee subjects. Integrating the sEMG electrodes and IM sensors within a single sensor package enabled us to achieve high-level performance by using on average 4-6 sensors.ConclusionsThe results from our experiments suggest that IMs can form an excellent complimentary source signal for upper-limb myoelectric prostheses. We trust that multi-modal control solutions have the potential of improving the usability of upper-extremity prostheses in real-life applications.

A Prototype System for High Frame Rate Ultrasound Imaging based Prosthetic Arm Control

A Prototype System for High Frame Rate Ultrasound Imaging based Prosthetic Arm Control

A Wearable Ultrasound Interface for Prosthetic Hand Control

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

Wearable Ultrasound Interface for Prosthetic Hand Manipulation

Novel Method for Predicting Dexterous Individual Finger Movements by Imaging Muscle Activity Using a Wearable Ultrasonic System

ProRuka: A highly efficient HMI algorithm for controlling a novel prosthetic hand with 6-DOF using sonomyography

Single-channel surface electromyography (sEMG) based control of a multi-functional prosthetic hand

Biomechatronic Design and Control of an Anthropomorphic Artificial Hand for Prosthetic Applications

Upper-limb prosthetic control using wearable multichannel mechanomyography

Utilizing EEG Signal Data and Motion to Aid in Prosthetic Hand Motion

Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements

A Bio-Mechanical Designed Prosthetic Hand With Multi-Control Strategies

Shared human–robot proportional control of a dexterous myoelectric prosthesis

Non-invasive Human-machine Interface (HMI) Systems with Hybrid On-body Sensors for Controlling Upper-limb Prosthesis: A Review

Towards Sonomyography-Based Real-Time Control of Powered Prosthesis Grasp Synergies

Development and Continuous Control of an Intelligent Upper-Limb Neuroprosthesis for Reach and Grasp Motions Using Biological Signals

Toward an Enhanced Human–Machine Interface for Upper-Limb Prosthesis Control with Combined EMG and NIRS Signals

A Semi-Autonomous Hierarchical Control Framework for Prosthetic Hands Inspired by Dual Streams of Human

Development of a Multisensory Underactuated Prosthetic Hand With Fully Integrated Electronics

Design of a Biomimetic Control System for Tendon-driven Prosthetic Hand