Development and validation of a multimodal deep learning framework for vascular cognitive impairment diagnosis

Fan Fan,Hao Song,Jiu Jiang,Haoying He,Dong Sun,Zhipeng Xu,Sisi Peng,Ran Zhang,Tian Li,Jing Cao,Juan Xu,Xiaoxiang Peng,Ming Lei,Chu He,Junjian Zhang
DOI: https://doi.org/10.1016/j.isci.2024.110945
IF: 5.8
2024-09-13
iScience
Abstract:Cerebrovascular disease (CVD) is the second leading cause of dementia worldwide. The accurate detection of vascular cognitive impairment (VCI) in CVD patients remains an unresolved challenge. We collected the clinical non-imaging data and neuroimaging data from 307 subjects with CVD. Using these data, we developed a multimodal deep learning framework that combined the vision transformer and extreme gradient boosting algorithms. The final hybrid model within the framework included only two neuroimaging features and six clinical features, demonstrating robust performance across both internal and external datasets. Furthermore, the diagnostic performance of our model on a specific dataset was demonstrated to be comparable to that of expert clinicians. Notably, our model can identify the brain regions and clinical features that significantly contribute to the VCI diagnosis, thereby enhancing transparency and interpretability. We developed an accurate and explainable clinical decision support tool to identify the presence of VCI in patients with CVD.
What problem does this paper attempt to address?