Abstract:Abstract Alzheimer’s disease (AD) is the most common type of dementia. Its diagnosis and progression detection have been intensively studied. Nevertheless, research studies often have little effect on clinical practice mainly due to the following reasons: (1) Most studies depend mainly on a single modality, especially neuroimaging; (2) diagnosis and progression detection are usually studied separately as two independent problems; and (3) current studies concentrate mainly on optimizing the performance of complex machine learning models, while disregarding their explainability. As a result, physicians struggle to interpret these models, and feel it is hard to trust them. In this paper, we carefully develop an accurate and interpretable AD diagnosis and progression detection model. This model provides physicians with accurate decisions along with a set of explanations for every decision. Specifically, the model integrates 11 modalities of 1048 subjects from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) real-world dataset: 294 cognitively normal, 254 stable mild cognitive impairment (MCI), 232 progressive MCI, and 268 AD. It is actually a two-layer model with random forest (RF) as classifier algorithm. In the first layer, the model carries out a multi-class classification for the early diagnosis of AD patients. In the second layer, the model applies binary classification to detect possible MCI-to-AD progression within three years from a baseline diagnosis. The performance of the model is optimized with key markers selected from a large set of biological and clinical measures. Regarding explainability, we provide, for each layer, global and instance-based explanations of the RF classifier by using the SHapley Additive exPlanations (SHAP) feature attribution framework. In addition, we implement 22 explainers based on decision trees and fuzzy rule-based systems to provide complementary justifications for every RF decision in each layer. Furthermore, these explanations are represented in natural language form to help physicians understand the predictions. The designed model achieves a cross-validation accuracy of 93.95% and an F1-score of 93.94% in the first layer, while it achieves a cross-validation accuracy of 87.08% and an F1-Score of 87.09% in the second layer. The resulting system is not only accurate, but also trustworthy, accountable, and medically applicable, thanks to the provided explanations which are broadly consistent with each other and with the AD medical literature. The proposed system can help to enhance the clinical understanding of AD diagnosis and progression processes by providing detailed insights into the effect of different modalities on the disease risk.

A unique color-coded visualization system with multimodal information fusion and deep learning in a longitudinal study of Alzheimer's disease

Prediction of Alzheimer's Progression based on Multimodal Deep-Learning-based Fusion and Visual Explainability of Time-Series Data

Multimodal Neuroimaging Fusion for Alzheimer's Disease: An Image Colorization Approach With Mobile Vision Transformer

A multilayer multimodal detection and prediction model based on explainable artificial intelligence for Alzheimer’s disease

Patch-based Interpretable Deep Learning Framework for Alzheimer’s Disease Diagnosis Using Multimodal Data

Visualizing Alzheimer's Disease Progression in Low Dimensional Manifolds.

Convolutional neural network based data interpretable framework for Alzheimer’s treatment planning

Alzheimer’s Disease Diagnosis Via Multimodal Feature Fusion

DeepAD: A Robust Deep Learning Model of Alzheimer's Disease Progression for Real-World Clinical Applications

Machine Learning for Diagnosis of AD and Prediction of MCI Progression From Brain MRI Using Brain Anatomical Analysis Using Diffeomorphic Deformation

A Multi-modal Data Platform for Diagnosis and Prediction of Alzheimer’s Disease Using Machine Learning Methods

Development and validation of a deep learning framework for Alzheimer’s disease classification

3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer's Disease Diagnosis

Machine learning on longitudinal multi-modal data enabling the understanding and prognosis of Alzheimer’s disease progression

Toward Robust Early Detection of Alzheimer's Disease via an Integrated Multimodal Learning Approach

Development and validation of an interpretable deep learning framework for Alzheimer's disease classification

3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer’s Disease Diagnosis

Transfer Learning with intelligent training data selection for prediction of Alzheimer's Disease

Convolutional neural network to identify symptomatic Alzheimer’s disease using multimodal retinal imaging

A deep generative multimodal imaging genomics framework for Alzheimer's disease prediction

Dominating Alzheimer's disease diagnosis with deep learning on sMRI and DTI-MD