Abstract:Background and objective: Alzheimer's disease (AD) is a dreaded degenerative disease that results in a profound decline in human cognition and memory. Due to its intricate pathogenesis and the lack of effective therapeutic interventions, early diagnosis plays a paramount role in AD. Recent research based on neuroimaging has shown that the application of deep learning methods by multimodal neural images can effectively detect AD. However, these methods only concatenate and fuse the high-level features extracted from different modalities, ignoring the fusion and interaction of low-level features across modalities. It consequently leads to unsatisfactory classification performance. Method: In this paper, we propose a novel multi-scale attention and cross-enhanced fusion network, MACFNet, which enables the interaction of multi-stage low-level features between inputs to learn shared feature representations. We first construct a novel Cross-Enhanced Fusion Module (CEFM), which fuses low-level features from different modalities through a multi-stage cross-structure. In addition, an Efficient Spatial Channel Attention (ECSA) module is proposed, which is able to focus on important AD-related features in images more efficiently and achieve feature enhancement from different modalities through two-stage residual concatenation. Finally, we also propose a multiscale attention guiding block (MSAG) based on dilated convolution, which can obtain rich receptive fields without increasing model parameters and computation, and effectively improve the efficiency of multiscale feature extraction. Results: Experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset demonstrate that our MACFNet has better classification performance than existing multimodal methods, with classification accuracies of 99.59 %, 98.85 %, 99.61 %, and 98.23 % for AD vs. CN, AD vs. MCI, CN vs. MCI and AD vs. CN vs. MCI, respectively, and specificity of 98.92 %, 97.07 %, 99.58 % and 99.04 %, and sensitivity of 99.91 %, 99.89 %, 99.63 % and 97.75 %, respectively. Conclusions: The proposed MACFNet is a high-accuracy multimodal AD diagnostic framework. Through the cross mechanism and efficient attention, MACFNet can make full use of the low-level features of different modal medical images and effectively pay attention to the local and global information of the images. This work provides a valuable reference for multi-mode AD diagnosis.

DeepNFT: Towards Precise Neurofibrillary Tangle Detection Via Improving Multi-scale Feature Fusion and Adversary

Learning precise segmentation of neurofibrillary tangles from rapid manual point annotations

Artificial intelligence in neuropathology: deep learning-based assessment of tauopathy

Early Diagnosis of Alzheimer's Disease Using Deep Learning

Multi-feature fusion learning for Alzheimer's disease prediction using EEG signals in resting state

Leveraging Bi-Focal Perspectives and Granular Feature Integration for Accurate Reliable Early Alzheimer's Detection

Detection of individual brain tau deposition in Alzheimer's disease based on latent feature-enhanced generative adversarial network

Multi-Layer Fusion Neural Network for Deepfake Detection.

MMTFN: Multi‐modal multi‐scale transformer fusion network for Alzheimer's disease diagnosis

MACFNet: Detection of Alzheimer's disease via multiscale attention and cross-enhancement fusion network

Deep Self-Reconstruction Fusion Similarity Hashing for the Diagnosis of Alzheimer's Disease on Multi-Modal Data

Differential Diagnosis of Frontotemporal Dementia, Alzheimer's Disease, and Normal Aging Using a Multi-Scale Multi-Type Feature Generative Adversarial Deep Neural Network on Structural Magnetic Resonance Images

Deep Multi-Modal Discriminative and Interpretability Network for Alzheimer's Disease Diagnosis

Improved Neural Network with Multi-Task Learning for Alzheimer's Disease Classification

Automated deep learning segmentation of neuritic plaques and neurofibrillary tangles in Alzheimer disease brain sections using a proprietary software

3D Global Fourier Network for Alzheimer's Disease Diagnosis Using Structural MRI

Early Diagnosis of Alzheimer's Disease by Ensemble Deep Learning Using FDG-PET

FECC-Net: A Novel Feature Enhancement and Context Capture Network Based on Brain MRI Images for Lesion Segmentation

Alzheimer's detection using various feature extraction approaches using a multimodal multi‐class deep learning model

Toward Robust Early Detection of Alzheimer's Disease via an Integrated Multimodal Learning Approach

Patch-based Interpretable Deep Learning Framework for Alzheimer’s Disease Diagnosis Using Multimodal Data