Abstract:Introduction: Diagnosing Alzheimer's disease (AD) lesions via visual examination of Electroencephalography (EEG) signals poses a considerable challenge. This has prompted the exploration of deep learning techniques, such as Convolutional Neural Networks (CNNs) and Visual Transformers (ViTs), for AD prediction. However, the classification performance of CNN-based methods has often been deemed inadequate. This is primarily attributed to CNNs struggling with extracting meaningful lesion signals from the complex and noisy EEG data. Methods: In contrast, ViTs have demonstrated proficiency in capturing global signal patterns. In light of these observations, we propose a novel approach to enhance AD risk assessment. Our proposition involves a hybrid architecture, merging the strengths of CNNs and ViTs to compensate for their respective feature extraction limitations. Our proposed Dual-Branch Feature Fusion Network (DBN) leverages both CNN and ViT components to acquire texture features and global semantic information from EEG signals. These elements are pivotal in capturing dynamic electrical signal changes in the cerebral cortex. Additionally, we introduce Spatial Attention (SA) and Channel Attention (CA) blocks within the network architecture. These attention mechanisms bolster the model's capacity to discern abnormal EEG signal patterns from the amalgamated features. To make well-informed predictions, we employ a two-factor decision-making mechanism. Specifically, we conduct correlation analysis on predicted EEG signals from the same subject to establish consistency. Results: This is then combined with results from the Clinical Neuropsychological Scale (MMSE) assessment to comprehensively evaluate the subject's susceptibility to AD. Our experimental validation on the publicly available OpenNeuro database underscores the efficacy of our approach. Notably, our proposed method attains an impressive 80.23% classification accuracy in distinguishing between AD, Frontotemporal dementia (FTD), and Normal Control (NC) subjects. Discussion: This outcome outperforms prevailing state-of-the-art methodologies in EEG-based AD prediction. Furthermore, our methodology enables the visualization of salient regions within pathological images, providing invaluable insights for interpreting and analyzing AD predictions.

Temporal attention fusion network with custom loss function for EEG--fNIRS classification

Temporal Convolutional Network-Enhanced Real-Time Implicit Emotion Recognition with an Innovative Wearable fNIRS-EEG Dual-Modal System

Simultaneous EEG-fNIRS Data Classification Through Selective Channel Representation and Spectrogram Imaging

TACNet: Task-aware Electroencephalogram Classification for Brain-Computer Interface Through A Novel Temporal Attention Convolutional Network.

Temporal Fusion Dynamically Separable Graph Convolutional Network for EEG Motion Intention Decoding Based on Source Information Extraction

Classification Algorithm for fNIRS-based Brain Signals Using Convolutional Neural Network with Spatiotemporal Feature Extraction Mechanism

FoME: A Foundation Model for EEG using Adaptive Temporal-Lateral Attention Scaling

An EEG-based attention recognition method: fusion of time domain, frequency domain, and non-linear dynamics features

T-A-MFFNet: Multi-feature fusion network for EEG analysis and driving fatigue detection based on time domain network and attention network

Classification of hand movements from EEG using a FusionNet based LSTM network

A Hybrid EEG-fNIRS Brain-Computer Interface Based on Dynamic Functional Connectivity and Long Short-Term Memory

Dual Attentive Fusion for EEG-based Brain-Computer Interfaces

Multi-feature fusion learning for Alzheimer's disease prediction using EEG signals in resting state

Multi-band Network Fusion for Alzheimer’s Disease Identification with Functional MRI

Attention-based convolutional neural network with multi-modal temporal information fusion for motor imagery EEG decoding

A Temporal Multi-view Fuzzy Classifier for Fusion Identification on Epileptic Brain Network

Multilayer-Aggregation Functional Network for Identifying Brain Fatigue and Diseases

EISATC-Fusion: Inception Self-Attention Temporal Convolutional Network Fusion for Motor Imagery EEG Decoding

Improved Classification Performance of EEG-fNIRS Multimodal Brain-Computer Interface Based on Multi-Domain Features and Multi-Level Progressive Learning

TCACNet: Temporal and channel attention convolutional network for motor imagery classification of EEG-based BCI

Brainnetformer: Decoding Brain Cognitive States with Spatial-Temporal Cross Attention