Deep Learning in Neuroimaging: Promises and challenges
Weizheng Yan,Gang Qu,Wenxing Hu,Anees Abrol,Biao Cai,Chen Qiao,Sergey M. Plis,Yu-Ping Wang,Jing Sui,Vince D. Calhoun
DOI: https://doi.org/10.1109/msp.2021.3128348
IF: 15.204
2022-03-01
IEEE Signal Processing Magazine
Abstract:Deep learning (DL) has been extremely successful when applied to the analysis of natural images. By contrast, analyzing neuroimaging data presents some unique challenges, including higher dimensionality, smaller sample sizes, multiple heterogeneous modalities, and a limited ground truth. In this article, we discuss DL methods in the context of four diverse and important categories in the neuroimaging field: classification/prediction, dynamic activity/connectivity, multimodal fusion, and interpretation/visualization. We highlight recent progress in each of these categories, discuss the benefits of combining data characteristics and model architectures, and derive guidelines for the use of DL in neuroimaging data. For each category, we also assess promising applications and major challenges to overcome. Finally, we discuss future directions of neuroimaging DL for clinical applications, a topic of great interest, touching on all four categories.
engineering, electrical & electronic