Abstract:Parkinson's disease (PD) is a central nervous system neurodegenerative illness. Its symptoms include poor motor skills, speech, cognition, and memory. The condition is incurable, although evidence shows that early identification and therapy reduce symptoms. A lack of medical facilities and personnel hinders PD identification. PD is a common chronic degenerative neurological dyskinesia that threatens the elderly. Multi-modal data fusion may reveal more about PD pathophysiology. This study aims to contribute to the evaluation of PD by introducing a novel multimodal deep-learning technique for distinguishing individuals with PD from those without PD. This study utilizes resting functional magnetic resonance imaging (rfMRI) and gene data obtained from the Parkinson's Progression Markers Initiative (PPMI) and Alzheimer's Disease Neuroimaging Initiative (ADNI) databases. The primary objective is to predict the specific pathological brain regions and identify the risk genes associated with PD. The authors want to learn more about the genetic components and underlying procedures by analyzing these datasets. Contributing to the development and progression of PD. In this study, we present our findings that demonstrate the superior recital of our proposed multimodal method compared to both unimodal approaches and other existing multimodal methods. Our evaluation is based on an extensive dataset consisting of real patients. Specifically, our proposed method stacked deep learning classifiers (SDLC) achieves an impressive F1-score of 0.99 and an accuracy of 99.4%, surpassing the performance of both unimodal approaches and other multimodal methods. These results highlight the efficiency and potential of our method in enhancing the accuracy and reliability of patient data analysis. In this study, we demonstrate that our proposed method consistently surpasses alternative approaches in terms of performance, as indicated by a higher average increase in F1-score. This finding highlights the advantage of training on multiple modalities, even when a particular modality is absent during inference.

Image Encoding and Fusion of Multi-modal Data Enhance Depression Diagnosis in Parkinson's Disease Patients

An Intra- and Inter-Emotion Transformer-Based Fusion Model with Homogeneous and Diverse Constraints Using Multi-Emotional Audiovisual Features for Depression Detection.

Automatic Depression Prediction Via Cross-Modal Attention-Based Multi-Modal Fusion in Social Networks

Optimizing Parkinson's Disease Diagnosis with Multimodal Data Fusion Techniques

Depression Diagnosis and Analysis via Multimodal Multi-order Factor Fusion

Transformer-based multimodal feature enhancement networks for multimodal depression detection integrating video, audio and remote photoplethysmograph signals

Multi-modal Depression Estimation based on Sub-attentional Fusion

IIFDD: Intra and inter-modal fusion for depression detection with multi-modal information from Internet of Medical Things

2 8 A ug 2 00 6 Invariant Subspaces of Nilpotent Linear Operators

Multimodal Measurement of Depression Using Deep Learning Models

A Fully Automatic Framework for Parkinson’s Disease Diagnosis by Multi-Modality Images

Multimodal Sensing for Depression Risk Detection: Integrating Audio, Video, and Text Data

Feature-level fusion approaches based on multimodal EEG data for depression recognition

Automatic Diagnosis of Major Depressive Disorder Using a High- and Low-Frequency Feature Fusion Framework

Multimodal Depression Detection based on Factorized Representation

Parkinson's Disease Classification Using Contrastive Graph Cross-View Learning with Multimodal Fusion of SPECT Images and Clinical Features

Multimodal Spatiotemporal Representation for Automatic Depression Level Detection

Multi-Modal Adaptive Fusion Transformer Network for the Estimation of Depression Level

Multi Fine-Grained Fusion Network for Depression Detection

DepMamba: Progressive Fusion Mamba for Multimodal Depression Detection

Spatio-temporal scale information fusion of functional near-infrared spectroscopy signal for depression detection