Abstract:Background and Objectives : Parkinson's Disease (PD) is a devastating chronic neurological condition. Machine learning (ML) techniques have been used in the early prediction of PD progression. Fusion of heterogeneous data modalities proved its capability to improve the performance of ML models. Time series data fusion supports the tracking of the disease over time. In addition, the trustworthiness of the resulting models is improved by adding model explainability features. The literature on PD has not sufficiently explored these three points. Methods : In this work, we proposed an ML pipeline for predicting the progression of PD that is both accurate and explainable. We explore the fusion of different combinations of five time series modalities from the Parkinson's Progression Markers Initiative (PPMI) real-world dataset, including patient characteristics, biosamples, medication history, motor, and non-motor function data. Each patient has six visits. The problem has been formulated in two ways: ❶ a three-class based progression prediction with 953 patients in each time series modality, and ❷ a four-class based progression prediction with 1,060 patients in each time series modality. The statistical features of these six visits were calculated from each modality and diverse feature selection methods were applied to select the most informative feature sets. The extracted features were used to train a set of well-known ML models including Support vector machines (SVM), random forests (RF), extra tree classifier (ETC), light gradient boosting machines (LGBM), and stochastic gradient descent (SGD). We examined a number of data-balancing strategies in the pipeline with different combinations of modalities. ML models have been optimized using the Bayesian optimizer. A comprehensive evaluation of various ML methods has been conducted, and the best models have been extended to provide different explainability features. Results : We compare the performance of ML models before and after optimization and using and without using feature selection. In the three-class experiment and with various modality fusions, the LGBM model produced the most accurate results with a 10-fold cross-validation (10-CV) accuracy of 90.73% using non-motor function modality. RF produced the best results in the four-class experiment with various modality fusions with a 10-CV accuracy of 94.57% using non-motor modality. With the fused dataset of non-motor and motor function modalities, the LGBM model outperformed the other ML models in both the 3-class and 4-class experiments (i.e., 10-CV accuracy of 94.89% and 93.73%, respectively). Using the Shapely Additive Explanations (SHAP) framework, we employed global and instance-based explanations to explain the behavior of each ML classifier. Moreover, we extended the explainability by implementing the LIME and SHAPASH local explainers. The consistency of these explainers has been explored. The resultant classifiers were accurate, explainable, and thus medically more relevant and applicable. Conclusions : The select modalities and feature sets were confirmed by the literature and medical experts. The various explainers suggest that the bradykinesia (NP3BRADY) feature was the most dominant and consistent. By providing thorough insights into the influence of multiple modalities on the disease risk, the suggested approach is expected to help improve the clinical knowledge of PD progression processes.

Multimodal Reinforcement Learning for Embedding Networks and Medication Recommendation in Parkinson's Disease

Reinforcement Learning-Based Adaptive Classification for Medication State Monitoring in Parkinson's Disease

Medication recommendation for Parkinson's disease based on dynamics of symptom progression

Optimizing Parkinson's Disease Diagnosis with Multimodal Data Fusion Techniques

Explainable Machine Learning Models based on Multimodal Time-Series Data for the Early Detection of Parkinson's Disease

Learning-Based Computer-Aided Prescription Model for Parkinson's Disease: A Data-Driven Perspective

Identification of Parkinson’s Disease PACE Subtypes and Repurposing Treatments Through Integrative Analyses of Multimodal Data

Personalized Progression Modelling and Prediction in Parkinson’s Disease with a Novel Multi-Modal Graph Approach

Remote Medication Status Prediction for Individuals with Parkinson's Disease using Time-series Data from Smartphones

Supervised Reinforcement Learning with Recurrent Neural Network for Dynamic Treatment Recommendation

A Comprehensive Multi-Functional Approach for Measuring Parkinson's Disease Severity

PROMISE: A pre-trained knowledge-infused multimodal representation learning framework for medication recommendation

Deep Learning Prediction of Parkinson's Disease using Remotely Collected Structured Mouse Trace Data

Enhancing early Parkinson's disease detection through multimodal deep learning and explainable AI: insights from the PPMI database

Dynamic Prediction for Multiple Repeated Measures and Event Time Data: An Application to Parkinson's Disease

A decision support system based on recurrent neural networks to predict medication dosage for patients with Parkinson's disease

Personalized Multimorbidity Management for Patients with Type 2 Diabetes Using Reinforcement Learning of Electronic Health Records

Multimodal Indoor Localisation in Parkinson's Disease for Detecting Medication Use: Observational Pilot Study in a Free-Living Setting

Application of Deep Learning Models for Automated Identification of Parkinson’s Disease: A Review (2011–2021)

Machine Learning for Early Detection of Cognitive Decline in Parkinson's Disease Using Multimodal Biomarker and Clinical Data

Wearable sensor devices can automatically identify the ON-OFF status of patients with Parkinson's disease through an interpretable machine learning model