Abstract:Accurate measurement of brain structures is essential for the evaluation of neonatal brain growth and development. The conventional methods use manual segmentation to measure brain tissues, which is very time-consuming and inefficient. Recent deep learning achieves excellent performance in computer vision, but it is still unsatisfactory for segmenting magnetic resonance images of neonatal brains because they are immature with unique attributes. In this paper, we propose a novel attention-modulated multi-branch convolutional neural network for neonatal brain tissue segmentation. The proposed network is built on the encoder-decoder framework by introducing both multi-scale convolutions in the encoding path and multi-branch attention modules in the decoding path. Multi-scale convolutions with different kernels are used to extract rich semantic features across large receptive fields in the encoding path. Multi-branch attention modules are used to capture abundant contextual information in the decoding path for segmenting brain tissues by fusing both local features and their corresponding global dependencies. Spatial attention connections between the encoding and decoding paths are designed to increase feature propagation for both avoiding information loss during downsampling and accelerating model training convergence. The proposed network was implemented in comparison with baseline methods on three neonatal brain datasets. Our network achieves the average Dice similarity coefficients/the average Hausdorff distances of 0.9116/8.1289, 0.9367/9.8212 and 0.8931/8.1612 on the customized dCBP2021 dataset, 0.8786/11.7863, 0.8965/13.4296 and 0.8539/10.462 on the public NBAtlas dataset, as well as 0.9253/7.7968, 0.9448/9.5472 and 0.9132/7.5877 on the public dHCP2017 dataset in partitioning the brain into gray matter, white matter and cerebrospinal fluid, respectively. The experimental results show that the proposed method achieves competitive state-of-the-art performance in neonatal brain tissue segmentation. The code and pre-trained models are available at https://github.com/zhangyongqin/AMCNN.

Baby head circumference CT image automatic measurement method based on convolutional neural network

A new approach to automatic measure fetal head circumference in ultrasound images using convolutional neural networks

RDHCformer: Fusing ResDCN and Transformers for Fetal Head Circumference Automatic Measurement in 2D Ultrasound Images

Human-level Performance On Automatic Head Biometrics In Fetal Ultrasound Using Fully Convolutional Neural Networks

Attention-modulated Multi-Branch Convolutional Neural Networks for Neonatal Brain Tissue Segmentation

Evaluation of Fetal Head Circumference (HC) and Biparietal Diameter (BPD (Biparietal Diameter)) in Ultrasound Images Using Multi-Task Deep Convolutional Neural Network

Evaluate Fine-tuning Strategies for Fetal Head Ultrasound Image Segmentation with U-Net

CT image organ segmentation method based on convolutional neural network multi-dimensional fusion

Automatic breast cancer image recognition method based on convolutional neural network model integration

NHBS-Net: A Feature Fusion Attention Network for Ultrasound Neonatal Hip Bone Segmentation

US-CT image segmentation method, system and device based on deep neural network

Deep Learning-Based Approach for the Automatic Segmentation of Adult and Pediatric Temporal Bone Computed Tomography Images

Kidney segmentation method in CT image based on deep learning

Automatic Segmentation of Temporal Bone Structures from Clinical Conventional CT Using a CNN Approach

Automatic quality assessment for 2D fetal sonographic standard plane based on multi-task learning

Fetal Ultrasound Image Segmentation for Measuring Biometric Parameters Using Multi-Task Deep Learning

Automatic Recognition of Fetal Heart Standard Section Based on Fast-RCNN

Automatic Semicircular Canal Segmentation of CT Volumes Using Improved 3D U-Net with Attention Mechanism

Automatic segmentation of 15 critical anatomical labels and measurements of cardiac axis and cardiothoracic ratio in fetal four chambers using nnU-NetV2

Localization of Fetal Head in Ultrasound Images by Multiscale View and Deep Neural Networks

Hybrid attention for automatic segmentation of whole fetal head in prenatal ultrasound volumes