Abstract:Introduction: Diagnosing Alzheimer's disease (AD) lesions via visual examination of Electroencephalography (EEG) signals poses a considerable challenge. This has prompted the exploration of deep learning techniques, such as Convolutional Neural Networks (CNNs) and Visual Transformers (ViTs), for AD prediction. However, the classification performance of CNN-based methods has often been deemed inadequate. This is primarily attributed to CNNs struggling with extracting meaningful lesion signals from the complex and noisy EEG data. Methods: In contrast, ViTs have demonstrated proficiency in capturing global signal patterns. In light of these observations, we propose a novel approach to enhance AD risk assessment. Our proposition involves a hybrid architecture, merging the strengths of CNNs and ViTs to compensate for their respective feature extraction limitations. Our proposed Dual-Branch Feature Fusion Network (DBN) leverages both CNN and ViT components to acquire texture features and global semantic information from EEG signals. These elements are pivotal in capturing dynamic electrical signal changes in the cerebral cortex. Additionally, we introduce Spatial Attention (SA) and Channel Attention (CA) blocks within the network architecture. These attention mechanisms bolster the model's capacity to discern abnormal EEG signal patterns from the amalgamated features. To make well-informed predictions, we employ a two-factor decision-making mechanism. Specifically, we conduct correlation analysis on predicted EEG signals from the same subject to establish consistency. Results: This is then combined with results from the Clinical Neuropsychological Scale (MMSE) assessment to comprehensively evaluate the subject's susceptibility to AD. Our experimental validation on the publicly available OpenNeuro database underscores the efficacy of our approach. Notably, our proposed method attains an impressive 80.23% classification accuracy in distinguishing between AD, Frontotemporal dementia (FTD), and Normal Control (NC) subjects. Discussion: This outcome outperforms prevailing state-of-the-art methodologies in EEG-based AD prediction. Furthermore, our methodology enables the visualization of salient regions within pathological images, providing invaluable insights for interpreting and analyzing AD predictions.

Automatic Detection of Alzheimer's Disease with Multi-Modal Fusion of Clinical MRI Scans

Early Diagnosis of Alzheimer's Disease Using Deep Learning

Multimodal deep learning models for early detection of Alzheimer’s disease stage

Automated detection of Alzheimer's disease: a multi-modal approach with 3D MRI and amyloid PET

Multimodal Cross Enhanced Fusion Network for Diagnosis of Alzheimer's Disease and Subjective Memory Complaints.

A Hybrid Multi-Scale Attention Convolution and Aging Transformer Network for Alzheimer's Disease Diagnosis.

Diagnosing Alzheimer's Disease using Early-Late Multimodal Data Fusion with Jacobian Maps

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis

Multi-feature fusion learning for Alzheimer's disease prediction using EEG signals in resting state

Multi-modal data Alzheimer’s disease detection based on 3D convolution

Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease

An Effective Multimodal Image Fusion Method Using MRI and PET for Alzheimer's Disease Diagnosis

HAMMF: Hierarchical Attention-Based Multi-Task and Multi-Modal Fusion Model for Computer-Aided Diagnosis of Alzheimer’s Disease

Patch-based Interpretable Deep Learning Framework for Alzheimer’s Disease Diagnosis Using Multimodal Data

Prediction of Alzheimer's Progression based on Multimodal Deep-Learning-based Fusion and Visual Explainability of Time-Series Data

Multimodal cross enhanced fusion network for diagnosis of Alzheimer?s disease and

3D CNN-based classification using sMRI and MD-DTI images for Alzheimer disease studies

Hybrid Multimodality Fusion with Cross-Domain Knowledge Transfer to Forecast Progression Trajectories in Cognitive Decline

Use of multimodality imaging and artificial intelligence for diagnosis and prognosis of early stages of Alzheimer's disease

Alzheimer's disease classification algorithm based on fusion of channel attention and densely connected networks

Alzheimer's Disease Diagnosis With Brain Structural MRI Using Multiview-Slice Attention and 3D Convolution Neural Network