Automatic brain extraction from 3D fetal MR image with deep learning-based multi-step framework

Jian Chen,Zhenghan Fang,Guofu Zhang,Lei Ling,Gang Li,He Zhang,Li Wang

DOI: https://doi.org/10.1016/j.compmedimag.2020.101848

IF: 7.422

2021-03-01

Computerized Medical Imaging and Graphics

Abstract:<p>Brain extraction is a fundamental prerequisite step in neuroimage analysis for fetus. Due to surrounding maternal tissues and unpredictable movement, brain extraction from fetal Magnetic Resonance (MR) images is a challenging task. In this paper, we propose a novel deep learning-based multi-step framework for brain extraction from 3D fetal MR images. In the first step, a global localization network is applied to estimate probability maps for brain candidates. Connected-component labeling algorithm is applied to eliminate small erroneous components and accurately locate the candidate brain area. In the second step, a local refinement network is implemented in the brain candidate area to obtain fine-grained probability maps. Final extraction results are derived by a fusion network with the two cascaded probability maps obtained from previous two steps. Experimental results demonstrate that our proposed method has superior performance compared with existing deep learning-based methods.</p>

engineering, biomedical,radiology, nuclear medicine & medical imaging

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenge of automatically extracting brain regions in fetal magnetic resonance imaging (MRI). Specifically, due to factors such as the complexity of the maternal tissue surrounding the fetus, the unpredictability of fetal movement, and the rapid development of the fetal brain, automatically extracting the brain from 3D fetal MRI images is a very challenging task. These problems lead to the fact that traditional manual annotation methods are not only time - consuming but also susceptible to inter - observer variability. Therefore, an efficient and accurate automated technique needs to be developed to solve this problem.

The paper proposes a multi - step framework based on deep learning, aiming to solve the above challenges through the following steps:
1. **Global Localization Network**: First, apply a global localization network to estimate the probability map of brain candidate regions. Then, use the connected component labeling algorithm to eliminate small error components and accurately locate the candidate brain regions.
2. **Local Refinement Network**: Based on the first step, implement a local refinement network within the candidate brain regions to obtain a more refined probability map.
3. **Fusion Network**: Finally, input the probability maps obtained in the previous two steps into a fusion network to generate the final brain extraction results.

Through this method, the paper aims to improve the accuracy and robustness of automatic fetal brain extraction, thereby providing a reliable basis for fetal neuroimaging analysis. The experimental results show that, compared with the existing deep - learning methods, the proposed framework has superior performance.