Abstract:Background and objective: Alzheimer's disease (AD) is a dreaded degenerative disease that results in a profound decline in human cognition and memory. Due to its intricate pathogenesis and the lack of effective therapeutic interventions, early diagnosis plays a paramount role in AD. Recent research based on neuroimaging has shown that the application of deep learning methods by multimodal neural images can effectively detect AD. However, these methods only concatenate and fuse the high-level features extracted from different modalities, ignoring the fusion and interaction of low-level features across modalities. It consequently leads to unsatisfactory classification performance. Method: In this paper, we propose a novel multi-scale attention and cross-enhanced fusion network, MACFNet, which enables the interaction of multi-stage low-level features between inputs to learn shared feature representations. We first construct a novel Cross-Enhanced Fusion Module (CEFM), which fuses low-level features from different modalities through a multi-stage cross-structure. In addition, an Efficient Spatial Channel Attention (ECSA) module is proposed, which is able to focus on important AD-related features in images more efficiently and achieve feature enhancement from different modalities through two-stage residual concatenation. Finally, we also propose a multiscale attention guiding block (MSAG) based on dilated convolution, which can obtain rich receptive fields without increasing model parameters and computation, and effectively improve the efficiency of multiscale feature extraction. Results: Experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset demonstrate that our MACFNet has better classification performance than existing multimodal methods, with classification accuracies of 99.59 %, 98.85 %, 99.61 %, and 98.23 % for AD vs. CN, AD vs. MCI, CN vs. MCI and AD vs. CN vs. MCI, respectively, and specificity of 98.92 %, 97.07 %, 99.58 % and 99.04 %, and sensitivity of 99.91 %, 99.89 %, 99.63 % and 97.75 %, respectively. Conclusions: The proposed MACFNet is a high-accuracy multimodal AD diagnostic framework. Through the cross mechanism and efficient attention, MACFNet can make full use of the low-level features of different modal medical images and effectively pay attention to the local and global information of the images. This work provides a valuable reference for multi-mode AD diagnosis.

MACFNet: Detection of Alzheimer's disease via multiscale attention and cross-enhancement fusion network

Attention-based and Micro Designed EfficientNetB2 for Diagnosis of Alzheimer’s Disease

MMTFN: Multi‐modal multi‐scale transformer fusion network for Alzheimer's disease diagnosis

CsAGP: Detecting Alzheimer's disease from multimodal images via dual-transformer with cross-attention and graph pooling

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data

Multimodal Cross Enhanced Fusion Network for Diagnosis of Alzheimer's Disease and Subjective Memory Complaints.

Multimodal cross enhanced fusion network for diagnosis of Alzheimer?s disease and

Multi-level fusion network for mild cognitive impairment identification using multi-modal neuroimages

Diagnosis of Alzheimer’s disease via an attention-based multi-scale convolutional neural network

Alzheimer's disease classification algorithm based on fusion of channel attention and densely connected networks

Multi-scale multimodal deep learning framework for Alzheimer's disease diagnosis

HAMMF: Hierarchical attention-based multi-task and multi-modal fusion model for computer-aided diagnosis of Alzheimer's disease

HAMMF: Hierarchical Attention-Based Multi-Task and Multi-Modal Fusion Model for Computer-Aided Diagnosis of Alzheimer’s Disease

MDMA: Multimodal Data and Multi-attention Based Deep Learning Model for Alzheimer’s Disease Diagnosis

Alzheimer’s Disease Diagnosis Via Multimodal Feature Fusion

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis

An Attention-Based 3D CNN With Multi-Scale Integration Block for Alzheimer's Disease Classification

Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease

A Hybrid Multi-Scale Attention Convolution and Aging Transformer Network for Alzheimer's Disease Diagnosis.

Multimodal Fusion Diagnosis of Alzheimer’s Disease Based on FDG-PET Generation

A Feature-Aware Multimodal Framework with Auto-Fusion for Alzheimer’s Disease Diagnosis