Abstract:The classification of mild cognitive impairment (MCI), which is a early stage of Alzheimer’s disease and is associated with brain structural and functional changes, is still a challenging task. Recent studies have shown great promise for improving the performance of MCI classification by combining multiple structural and functional features, such as grey matter volume and clustering coefficient. However, extracting which features and how to combine multiple features to improve the performance of MCI classification have always been challenging problems. To address these problems, in this study we propose a new method to enhance the feature representation of multi-modal MRI data by combining multi-view information to improve the performance of MCI classification. Firstly, we extract two structural features (including grey matter volume and cortical thickness) and two functional features (including clustering coefficient and shortest path length) of each cortical brain region based on automated anatomical labeling (AAL) atlas from both T1w MRI and rs-fMRI data of each subject. Then, in order to obtain features that are more helpful in distinguishing MCI subjects, an improved multi-task feature selection method, namely MTFS-gLASSO-TTR, is proposed. Finally, a multi-kernel learning algorithm is adopted to combine multiple features to perform the MCI classification task. Our proposed MCI classification method is evaluated on 315 subjects (including 105 LMCI subjects, 105 EMCI subjects and 105 NCs) with both T1w MRI and rs-fMRI data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. Experimental results show that our proposed method achieves an accuracy of 88.5% and an area under the receiver operating characteristic (ROC) curve (AUC) of 0.897 for LMCI/NC classification, an accuracy of 82.7% and an AUC of 0.832 for EMCI/NC classification, and an accuracy of 79.6% and an AUC of 0.803 for LMCI/EMCI classification, respectively. In addition, by comparison, the accuracy and AUC values of our proposed method are better than those of some existing state-of-the-art methods in MCI classification. Overall, our proposed MCI classification method is effective and promising for automatic diagnosis of MCI in clinical practice.

M 3: using mask-attention and multi-scale for multi-modal brain MRI classification

M3: using mask-attention and multi-scale for multi-modal brain MRI classification

M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities

Multimodal 3D Convolutional Neural Networks for Classification of Brain Disease Using Structural MR and FDG-PET Images.

Cross-modality Guidance-aided Multi-modal Learning with Dual Attention for MRI Brain Tumor Grading

A 3D Multiscale View Convolutional Neural Network with Attention for Mental Disease Diagnosis on MRI Images.

Multi-modal Brain Tumor Segmentation via Missing Modality Synthesis and Modality-level Attention Fusion

MCE: Medical Cognition Embedded in 3D MRI feature extraction for advancing glioma staging

Brain MR Image Classification for Alzheimer’s Disease Diagnosis Based on Multifeature Fusion

Multi-site MRI Harmonization Via Attention-Guided Deep Domain Adaptation for Brain Disorder Identification.

An Attentive Multi-Modal CNN for Brain Tumor Radiogenomic Classification

Discriminative analysis of early Alzheimer's disease using multi-modal imaging and multi-level characterization with multi-classifier (M3).

Enhancing the Feature Representation of Multi-Modal MRI Data by Combining Multi-View Information for MCI Classification

MVSI-Net: Multi-view attention and multi-scale feature interaction for brain tumor segmentation

MMM: Classification of Schizophrenia Using Multi-Modality Multi-Atlas Feature Representation and Multi-Kernel Learning.

Multimodal Triplet Attention Network for Brain Disease Diagnosis

Cross-modality Attention Adapter: A Glioma Segmentation Fine-tuning Method for SAM Using Multimodal Brain MR Images

Enhanced Multimodal Brain Tumor Classification in MR Images Using 2D ResNet As Backbone with Explicit Tumor Size Information

Towards Effective Classification of Amci Based on Resting-State Multiscale Brain Features and Machine Learning Approaches

Multi-modal data Alzheimer’s disease detection based on 3D convolution

M2GCNet: Multi-Modal Graph Convolution Network for Precise Brain Tumor Segmentation Across Multiple MRI Sequences