Abstract:BACKGROUND AND PURPOSE: Accurate and reliable detection of white matter hyperintensities and their volume quantification can provide valuable clinical information to assess neurologic disease progression. In this work, a stacked generalization ensemble of orthogonal 3D convolutional neural networks, StackGen-Net, is explored for improving automated detection of white matter hyperintensities in 3D T2-FLAIR images. MATERIALS AND METHODS: Individual convolutional neural networks in StackGen-Net were trained on 2.5D patches from orthogonal reformatting of 3D-FLAIR ( n = 21) to yield white matter hyperintensity posteriors. A meta convolutional neural network was trained to learn the functional mapping from orthogonal white matter hyperintensity posteriors to the final white matter hyperintensity prediction. The impact of training data and architecture choices on white matter hyperintensity segmentation performance was systematically evaluated on a test cohort ( n = 9). The segmentation performance of StackGen-Net was compared with state-of-the-art convolutional neural network techniques on an independent test cohort from the Alzheimer's Disease Neuroimaging Initiative-3 ( n = 20). RESULTS: StackGen-Net outperformed individual convolutional neural networks in the ensemble and their combination using averaging or majority voting. In a comparison with state-of-the-art white matter hyperintensity segmentation techniques, StackGen-Net achieved a significantly higher Dice score (0.76 [SD, 0.08], F1-lesion (0.74 [SD, 0.13]), and area under precision-recall curve (0.84 [SD, 0.09]), and the lowest absolute volume difference (13.3% [SD, 9.1%]). StackGen-Net performance in Dice scores (median = 0.74) did not significantly differ ( P = .22) from interobserver (median = 0.73) variability between 2 experienced neuroradiologists. We found no significant difference ( P = .15) in white matter hyperintensity lesion volumes from StackGen-Net predictions and ground truth annotations. CONCLUSIONS: A stacked generalization of convolutional neural networks, utilizing multiplanar lesion information using 2.5D spatial context, greatly improved the segmentation performance of StackGen-Net compared with traditional ensemble techniques and some state-of-the-art deep learning models for 3D-FLAIR.

Predicting Fluid Intelligence of Children using T1-weighted MR Images and a StackNet

Ensemble of 3D CNN regressors with data fusion for fluid intelligence prediction

ABCD Neurocognitive Prediction Challenge 2019: Predicting individual residual fluid intelligence scores from cortical grey matter morphology

Prediction of Adolescents' Fluid Intelligence Scores Based on Deep Learning with Reconstruction Regularization

ABCD Neurocognitive Prediction Challenge 2019: Predicting individual fluid intelligence scores from structural MRI using probabilistic segmentation and kernel ridge regression

Weighted Ensemble-model and Network Analysis: A method to predict fluid intelligence via naturalistic functional connectivity

Discriminative-Region-Aware Residual Network for Adolescent Brain Structure and Cognitive Development Analysis.

Sex differences in predicting fluid intelligence of adolescent brain from T1-weighted MRIs

A Combined Deep Learning-Gradient Boosting Machine Framework for Fluid Intelligence Prediction

A multicohort geometric deep learning study of age dependent cortical and subcortical morphologic interactions for fluid intelligence prediction

Brain Networks and Intelligence: A Graph Neural Network Based Approach to Resting State fMRI Data

A Stacked Generalization of 3D Orthogonal Deep Learning Convolutional Neural Networks for Improved Detection of White Matter Hyperintensities in 3D FLAIR Images

Deep learning of structural MRI predicts fluid, crystallized, and general intelligence

Brain Age Prediction of Children Using Routine Brain MR Images via Deep Learning

Brain Age Estimation From MRI Using Cascade Networks with Ranking Loss

BAENET: A Brain Age Estimation Network with 3D Skipping and Outlier Constraint Loss.

Brain age prediction via cross-stratified ensemble learning

Alternating Diffusion Map Based Fusion of Multimodal Brain Connectivity Networks for IQ Prediction

TW-Net: Transformer Weighted Network for Neonatal Brain MRI Segmentation

StageNet: Stage-Aware Neural Networks for Health Risk Prediction