Abstract:Quantitative assessment of hand function can assist therapists in providing appropriate rehabilitation strategies, which plays an essential role in post-stroke rehabilitation. Conventionally, the assessment process relies heavily on clinical experience and lacks quantitative analysis. To quantitatively assess the hand motor function of patients with post-stroke hemiplegia, this study proposes a novel multi-modality fusion assessment framework. This framework includes three components: the kinematic feature extraction based on a graph convolutional network (HAGCN), the surface electromyography (sEMG) signal processing based on a multi-layer long short term memory (LSTM) network, and the quantitative assessment based on the multi-modality fusion. To the best of the authors' knowledge, this is the first study of applying a graph convolution network to assess the hand motor function. We also collect the kinematic data and sEMG data from 70 subjects who completed 28 types of hand movements. Therapists first graded patients using traditional motor assessment scales (Brunnstrom Scale and Fugl-Meyer Assessment Scale) and further refined the patient's motor assessment result by their experience. Then, we trained the HAGCN and LSTM networks and quantitatively assessed each patient based on the proposed assessment framework. Finally, the Spearman correlation coefficient (SC) between the assessment result of this study and the traditional scale are 0.908 and 0.967, demonstrating a significant correlation between the proposed assessment and the traditional scale scores. In addition, the SC value between the score of this study and the refined hand motor function is 0.997, indicating the "ceiling effect" of some traditional scales can be avoided.

An evaluation method on hand function to accomplish specific tasks

AN AUTONOMOUS HAND-EYE CALIBRATION METHOD

Image-recognition-based System for Precise Hand Function Evaluation

A study on human hand motion assessment and evaluation indices

A Home-Based Functional Hand-Extremity Assessment System for Stroke Rehabilitation

New Rehabilitation Assessment Method of the End-Effector Finger Rehabilitation Robot Based on Multi-Sensor Source

Design of Humanoid Robotic Hand Based on Link Underactuation

Evaluation Method of Human Upper Limb Movement Function Based on Fitts′law

Biomechanical Analysis of the Effect of Finger Joint Configuration on Hand Grasping Performance: Rigid vs Flexible

A Systematic Analysis of Hand Movement Functionality: Qualitative Classification and Quantitative Investigation of Hand Grasp Behavior

Development of a gripping comfort evaluation method based on numerical simulations using individual hand finite element models

Blue Hand: A Novel Type of Soft Anthropomorphic Hand Based on Pneumatic Series-Parallel Mechanism

Quantitative Assessment of Hand Motor Function for Post-Stroke Rehabilitation Based on HAGCN and Multimodality Fusion

Posture evaluation for mobile manipulators using manipulation ability, tolerance on grasping, and pose error of end-effector

Verification of Finger Joint Stiffness Estimation Method With Soft Robotic Actuator

Third-party Evaluation of Robotic Hand Designs Using a Mechanical Glove

Development and Evaluation of an Optimization-Based Model for Power-Grip Posture Prediction

Conducting Individualised Hand Therapy Evaluation with Around-Device Hand Movements

Automatic rehabilitation assessment method of upper limb motor function based on posture and distribution force

Interactive Hand Pose Estimation: Boosting accuracy in localizing extended finger joints

Evaluation of Semg on Contralateral Upper Limb Physiological Characteristic Evaluation Methodology