Abstract:Background and objective: Alzheimer's disease (AD) is a dreaded degenerative disease that results in a profound decline in human cognition and memory. Due to its intricate pathogenesis and the lack of effective therapeutic interventions, early diagnosis plays a paramount role in AD. Recent research based on neuroimaging has shown that the application of deep learning methods by multimodal neural images can effectively detect AD. However, these methods only concatenate and fuse the high-level features extracted from different modalities, ignoring the fusion and interaction of low-level features across modalities. It consequently leads to unsatisfactory classification performance. Method: In this paper, we propose a novel multi-scale attention and cross-enhanced fusion network, MACFNet, which enables the interaction of multi-stage low-level features between inputs to learn shared feature representations. We first construct a novel Cross-Enhanced Fusion Module (CEFM), which fuses low-level features from different modalities through a multi-stage cross-structure. In addition, an Efficient Spatial Channel Attention (ECSA) module is proposed, which is able to focus on important AD-related features in images more efficiently and achieve feature enhancement from different modalities through two-stage residual concatenation. Finally, we also propose a multiscale attention guiding block (MSAG) based on dilated convolution, which can obtain rich receptive fields without increasing model parameters and computation, and effectively improve the efficiency of multiscale feature extraction. Results: Experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset demonstrate that our MACFNet has better classification performance than existing multimodal methods, with classification accuracies of 99.59 %, 98.85 %, 99.61 %, and 98.23 % for AD vs. CN, AD vs. MCI, CN vs. MCI and AD vs. CN vs. MCI, respectively, and specificity of 98.92 %, 97.07 %, 99.58 % and 99.04 %, and sensitivity of 99.91 %, 99.89 %, 99.63 % and 97.75 %, respectively. Conclusions: The proposed MACFNet is a high-accuracy multimodal AD diagnostic framework. Through the cross mechanism and efficient attention, MACFNet can make full use of the low-level features of different modal medical images and effectively pay attention to the local and global information of the images. This work provides a valuable reference for multi-mode AD diagnosis.

CsAGP: Detecting Alzheimer's disease from multimodal images via dual-transformer with cross-attention and graph pooling

MACFNet: Detection of Alzheimer's disease via multiscale attention and cross-enhancement fusion network

Alzheimer’s Disease Diagnosis Via Multimodal Feature Fusion

A Hybrid Multi-Scale Attention Convolution and Aging Transformer Network for Alzheimer's Disease Diagnosis.

A Feature-Aware Multimodal Framework with Auto-Fusion for Alzheimer’s Disease Diagnosis

A feature-aware multimodal framework with auto-fusion for Alzheimer's disease diagnosis

Multi-feature fusion learning for Alzheimer's disease prediction using EEG signals in resting state

Multimodal Fusion Diagnosis of Alzheimer’s Disease Based on FDG-PET Generation

MMTFN: Multi‐modal multi‐scale transformer fusion network for Alzheimer's disease diagnosis

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer’s Disease Diagnosis

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data

An Effective Multimodal Image Fusion Method Using MRI and PET for Alzheimer's Disease Diagnosis

HAMMF: Hierarchical Attention-Based Multi-Task and Multi-Modal Fusion Model for Computer-Aided Diagnosis of Alzheimer’s Disease

A Multi-Scale Feature Selection Module Based Architecture for the Diagnosis of Alzheimer’s Disease on [18F]FDG PET

Multimodal cross enhanced fusion network for diagnosis of Alzheimer?s disease and

MDMA: Multimodal Data and Multi-attention Based Deep Learning Model for Alzheimer’s Disease Diagnosis

Improve 3D Feature Extraction and Fusion for Stage Diagnosis of Alzheimer’s Disease

Multimodal Cross Enhanced Fusion Network for Diagnosis of Alzheimer's Disease and Subjective Memory Complaints.

Diagnosis of Alzheimer's Disease via Multi-modality 3D Convolutional Neural Network

HAMMF: Hierarchical attention-based multi-task and multi-modal fusion model for computer-aided diagnosis of Alzheimer's disease

A multi-scale feature selection module based architecture for the diagnosis of Alzheimer's disease on [18F]FDG PET