Learning Hand Kinematics for Parkinson's Disease Assessment Using a Multimodal Sensor Glove

Yu Li,Junyi Yin,Shuoyan Liu,Bing Xue,Cyrus Shokoohi,Gang Ge,Menglei Hu,Tenghuan Li,Xue Tao,Zhi Rao,Fanye Meng,Hongfeng Shi,Xiaoqiang Ji,Peyman Servati,Xiao Xiao,Jun Chen
DOI: https://doi.org/10.1002/advs.202206982
IF: 15.1
2023-05-09
Advanced Science
Abstract:This work introduces a glove with multimodal sensors to quantify hand dysfunctions for Parkinson's disease patients. It can capture the hand biomechanical signals and utilizes advanced algorithms for signal processing. The evaluation of the glove's performance demonstrates high reliability, highlighting its potential to aid in devising targeted rehabilitation treatments and enhancing hand recovery efficiency. Hand dysfunctions in Parkinson's disease include rigidity, muscle weakness, and tremor, which can severely affect the patient's daily life. Herein, a multimodal sensor glove is developed for quantifying the severity of Parkinson's disease symptoms in patients' hands while assessing the hands' multifunctionality. Toward signal processing, various algorithms are used to quantify and analyze each signal: Exponentially Weighted Average algorithm and Kalman filter are used to filter out noise, normalization to process bending signals, K‐Means Cluster Analysis to classify muscle strength grades, and Back Propagation Neural Network to identify and classify tremor signals with an accuracy of 95.83%. Given the compelling features, the flexibility, muscle strength, and stability assessed by the glove and the clinical observations are proved to be highly consistent with Kappa values of 0.833, 0.867, and 0.937, respectively. The intraclass correlation coefficients obtained by reliability evaluation experiments for the three assessments are greater than 0.9, indicating that the system is reliable. The glove can be applied to assist in formulating targeted rehabilitation treatments and improve hand recovery efficiency.
materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
What problem does this paper attempt to address?
This paper attempts to solve the problem of imprecise assessment of hand dysfunction in patients with Parkinson's Disease (PD). Specifically, currently, the assessment of hand function in Parkinson's disease patients mainly depends on clinical scales, which are easily affected by the patient's state and individual disease characteristics and lack objectivity and accuracy, especially in the early stage of the disease. Therefore, this article proposes a multi - modal - sensor - based glove for quantifying and evaluating various functions of the hands of Parkinson's disease patients, including finger dexterity, hand muscle strength, and hand stability. ### Main problems: 1. **Lack of unified standards**: At present, there are no unified standard tests or biomarkers to track the progress of Parkinson's disease, and the symptoms and signs of different patients vary greatly. 2. **Limitations of clinical scales**: Although existing clinical scales such as UPDRS are widely used, they are easily affected by the patient's state and individual differences and lack objectivity. 3. **Difficulty in early assessment**: In the early stage of Parkinson's disease, hand dysfunction may be relatively mild, and traditional assessment methods are difficult to accurately capture these subtle changes. ### Solutions: This article has developed a multi - modal - sensor glove. By integrating multiple sensors (such as flexible bending sensors, thin - film pressure sensors, and Inertial Measurement Unit (IMU)), it can monitor and analyze the motion signals of the hands of Parkinson's disease patients in real - time. Specifically: - **Assessment of finger dexterity**: Measure the bending angle of fingers through flexible bending sensors, and combine the completion of hand gestures to assess the flexibility and coordination of fingers. - **Assessment of hand muscle strength**: Measure the strength of hand muscles through thin - film pressure sensors, especially the strength changes during grasping, pinching, and clicking actions. - **Assessment of hand stability**: Measure the acceleration signals of the hand through IMU sensors, and combine the BP neural network algorithm to identify and classify tremor signals to assess the stability of the hand. ### Results: This system has been verified through a large number of experiments, proving its high precision and reliability in assessing the hand function of Parkinson's disease patients. Compared with the clinical assessment results, the Kappa values of the system are 0.833, 0.867, and 0.937 respectively, indicating that the system assessment results are highly consistent with the doctor's clinical observations. In addition, the reliability evaluation experiment of the system also shows its good repeatability and reliability. ### Significance: This research provides an objective and effective tool for the hand function assessment of Parkinson's disease patients, which helps doctors more accurately assess the patient's disease progress and formulate personalized rehabilitation treatment plans. At the same time, this system can also be used to monitor the progress of patients after receiving rehabilitation training and guide doctors to adjust the treatment plan in a timely manner.