Abstract:Introduction: Diagnosing Alzheimer's disease (AD) lesions via visual examination of Electroencephalography (EEG) signals poses a considerable challenge. This has prompted the exploration of deep learning techniques, such as Convolutional Neural Networks (CNNs) and Visual Transformers (ViTs), for AD prediction. However, the classification performance of CNN-based methods has often been deemed inadequate. This is primarily attributed to CNNs struggling with extracting meaningful lesion signals from the complex and noisy EEG data. Methods: In contrast, ViTs have demonstrated proficiency in capturing global signal patterns. In light of these observations, we propose a novel approach to enhance AD risk assessment. Our proposition involves a hybrid architecture, merging the strengths of CNNs and ViTs to compensate for their respective feature extraction limitations. Our proposed Dual-Branch Feature Fusion Network (DBN) leverages both CNN and ViT components to acquire texture features and global semantic information from EEG signals. These elements are pivotal in capturing dynamic electrical signal changes in the cerebral cortex. Additionally, we introduce Spatial Attention (SA) and Channel Attention (CA) blocks within the network architecture. These attention mechanisms bolster the model's capacity to discern abnormal EEG signal patterns from the amalgamated features. To make well-informed predictions, we employ a two-factor decision-making mechanism. Specifically, we conduct correlation analysis on predicted EEG signals from the same subject to establish consistency. Results: This is then combined with results from the Clinical Neuropsychological Scale (MMSE) assessment to comprehensively evaluate the subject's susceptibility to AD. Our experimental validation on the publicly available OpenNeuro database underscores the efficacy of our approach. Notably, our proposed method attains an impressive 80.23% classification accuracy in distinguishing between AD, Frontotemporal dementia (FTD), and Normal Control (NC) subjects. Discussion: This outcome outperforms prevailing state-of-the-art methodologies in EEG-based AD prediction. Furthermore, our methodology enables the visualization of salient regions within pathological images, providing invaluable insights for interpreting and analyzing AD predictions.

Dual attention based fusion network for MCI Conversion Prediction

Attention-based and Micro Designed EfficientNetB2 for Diagnosis of Alzheimer’s Disease

Multi-level fusion network for mild cognitive impairment identification using multi-modal neuroimages

A deep feature fusion network with global context and cross-dimensional dependencies for classification of mild cognitive impairment from brain MRI

Double-attention Assisted Multi-task Learning for the Alzheimer’s Disease Prediction from Mild Cognitive Impairment*

Multimodal Neuroimaging Attention-Based architecture for Cognitive Decline Prediction

Alzheimer's disease classification algorithm based on fusion of channel attention and densely connected networks

Regional Brain Fusion: Graph Convolutional Network for Alzheimer's Disease Prediction and Analysis

Heterogeneous data fusion for predicting mild cognitive impairment conversion

Multi-view imputation and cross-attention network based on incomplete longitudinal and multimodal data for conversion prediction of mild cognitive impairment

An End-to-end Multimodal 3D CNN Framework with Multi-level Features for the Prediction of Mild Cognitive Impairment

A Transformer-based Multi-features Fusion Model for Prediction of Conversion in Mild Cognitive Impairment

MMTFN: Multi‐modal multi‐scale transformer fusion network for Alzheimer's disease diagnosis

Predicting conversion from MCI to AD by integration of rs-fMRI and clinical information using 3D-convolutional neural network

Multi-Task Weakly-Supervised Attention Network for Dementia Status Estimation With Structural MRI

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data

Multimodal ensemble model for Alzheimer's disease conversion prediction from Early Mild Cognitive Impairment subjects

Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis

A multi-model deep convolutional neural network for automatic hippocampus segmentation and classification in Alzheimer’s disease

Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease

Multi-feature fusion learning for Alzheimer's disease prediction using EEG signals in resting state