Abstract:Background and objective: Alzheimer's disease (AD) is a dreaded degenerative disease that results in a profound decline in human cognition and memory. Due to its intricate pathogenesis and the lack of effective therapeutic interventions, early diagnosis plays a paramount role in AD. Recent research based on neuroimaging has shown that the application of deep learning methods by multimodal neural images can effectively detect AD. However, these methods only concatenate and fuse the high-level features extracted from different modalities, ignoring the fusion and interaction of low-level features across modalities. It consequently leads to unsatisfactory classification performance. Method: In this paper, we propose a novel multi-scale attention and cross-enhanced fusion network, MACFNet, which enables the interaction of multi-stage low-level features between inputs to learn shared feature representations. We first construct a novel Cross-Enhanced Fusion Module (CEFM), which fuses low-level features from different modalities through a multi-stage cross-structure. In addition, an Efficient Spatial Channel Attention (ECSA) module is proposed, which is able to focus on important AD-related features in images more efficiently and achieve feature enhancement from different modalities through two-stage residual concatenation. Finally, we also propose a multiscale attention guiding block (MSAG) based on dilated convolution, which can obtain rich receptive fields without increasing model parameters and computation, and effectively improve the efficiency of multiscale feature extraction. Results: Experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset demonstrate that our MACFNet has better classification performance than existing multimodal methods, with classification accuracies of 99.59 %, 98.85 %, 99.61 %, and 98.23 % for AD vs. CN, AD vs. MCI, CN vs. MCI and AD vs. CN vs. MCI, respectively, and specificity of 98.92 %, 97.07 %, 99.58 % and 99.04 %, and sensitivity of 99.91 %, 99.89 %, 99.63 % and 97.75 %, respectively. Conclusions: The proposed MACFNet is a high-accuracy multimodal AD diagnostic framework. Through the cross mechanism and efficient attention, MACFNet can make full use of the low-level features of different modal medical images and effectively pay attention to the local and global information of the images. This work provides a valuable reference for multi-mode AD diagnosis.

MMTFN: Multi‐modal multi‐scale transformer fusion network for Alzheimer's disease diagnosis

Regional Brain Fusion: Graph Convolutional Network for Alzheimer's Disease Prediction and Analysis

HAMMF: Hierarchical attention-based multi-task and multi-modal fusion model for computer-aided diagnosis of Alzheimer's disease

An Effective Multimodal Image Fusion Method Using MRI and PET for Alzheimer's Disease Diagnosis

Multi-level fusion network for mild cognitive impairment identification using multi-modal neuroimages

Deep Multi-Modal Discriminative and Interpretability Network for Alzheimer's Disease Diagnosis

A transformer-based unified multimodal framework for Alzheimer's disease assessment

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data

MACFNet: Detection of Alzheimer's disease via multiscale attention and cross-enhancement fusion network

Multi-modal data Alzheimer’s disease detection based on 3D convolution

Multi-feature fusion learning for Alzheimer's disease prediction using EEG signals in resting state

Multimodal transformer network for incomplete image generation and diagnosis of Alzheimer's disease

Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease

Multimodal diagnosis model of Alzheimer's disease based on improved Transformer

Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer's Disease using structural MR and FDG-PET images

3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer’s Disease Diagnosis

Cascaded Multi-Modal Mixing Transformers for Alzheimer's Disease Classification with Incomplete Data

Multimodal Representations Learning and Adversarial Hypergraph Fusion for Early Alzheimer's Disease Prediction

A multi-slice attention fusion and multi-view personalized fusion lightweight network for Alzheimer's disease diagnosis

Multi-task multi-level feature adversarial network for joint Alzheimer’s disease diagnosis and atrophy localization using sMRI

Diagnosis of Alzheimer's Disease via Multi-modality 3D Convolutional Neural Network