Abstract:Accurate measurement of brain structures is essential for the evaluation of neonatal brain growth and development. The conventional methods use manual segmentation to measure brain tissues, which is very time-consuming and inefficient. Recent deep learning achieves excellent performance in computer vision, but it is still unsatisfactory for segmenting magnetic resonance images of neonatal brains because they are immature with unique attributes. In this paper, we propose a novel attention-modulated multi-branch convolutional neural network for neonatal brain tissue segmentation. The proposed network is built on the encoder-decoder framework by introducing both multi-scale convolutions in the encoding path and multi-branch attention modules in the decoding path. Multi-scale convolutions with different kernels are used to extract rich semantic features across large receptive fields in the encoding path. Multi-branch attention modules are used to capture abundant contextual information in the decoding path for segmenting brain tissues by fusing both local features and their corresponding global dependencies. Spatial attention connections between the encoding and decoding paths are designed to increase feature propagation for both avoiding information loss during downsampling and accelerating model training convergence. The proposed network was implemented in comparison with baseline methods on three neonatal brain datasets. Our network achieves the average Dice similarity coefficients/the average Hausdorff distances of 0.9116/8.1289, 0.9367/9.8212 and 0.8931/8.1612 on the customized dCBP2021 dataset, 0.8786/11.7863, 0.8965/13.4296 and 0.8539/10.462 on the public NBAtlas dataset, as well as 0.9253/7.7968, 0.9448/9.5472 and 0.9132/7.5877 on the public dHCP2017 dataset in partitioning the brain into gray matter, white matter and cerebrospinal fluid, respectively. The experimental results show that the proposed method achieves competitive state-of-the-art performance in neonatal brain tissue segmentation. The code and pre-trained models are available at https://github.com/zhangyongqin/AMCNN.

NHBS-Net: A Feature Fusion Attention Network for Ultrasound Neonatal Hip Bone Segmentation

CCMT: Cross Collaboration Mult-Task Network for Neonatal Hip Bone Intelligent Diagnosis

Femoral Head Segmentation Based on Improved Fully Convolutional Neural Network for Ultrasound Images.

Simultaneous Segmentation of Fetal Hearts and Lungs for Medical Ultrasound Images Via an Efficient Multi-scale Model Integrated with Attention Mechanism

Fetal Head and Pubic Symphysis Segmentation in Intrapartum Ultrasound Image Using a Dual-Path Boundary-Guided Residual Network

DBF-Net: A Dual-Branch Network with Feature Fusion for Ultrasound Image Segmentation

Attention-modulated Multi-Branch Convolutional Neural Networks for Neonatal Brain Tissue Segmentation

EBTNet: Efficient Bilateral Token Mixer Network for Fetal Cardiac Ultrasound Image Segmentation

Joint Landmark and Structure Learning for Automatic Evaluation of Developmental Dysplasia of the Hip

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

A YOLOX-Based Deep Instance Segmentation Neural Network for Cardiac Anatomical Structures in Fetal Ultrasound Images

FHUSP-NET: A Multi-task model for fetal heart ultrasound standard plane recognition and key anatomical structures detection

Pubic Symphysis-Fetal Head Segmentation Network Using BiFormer Attention Mechanism and Multipath Dilated Convolution

Segmentation of Skeleton Ultrasound Images Based on MMA-SUISNet

Automatic Recognition of Fetal Heart Standard Section Based on Fast-RCNN

Fetal Ultrasound Image Segmentation for Automatic Head Circumference Biometry Using Deeply Supervised Attention-Gated V-Net.

Joint Segmentation and Landmark Localization of Fetal Femur in Ultrasound Volumes

Automatic quality assessment for 2D fetal sonographic standard plane based on multi-task learning

Intrapartum Ultrasound Image Segmentation of Pubic Symphysis and Fetal Head Using Dual Student-Teacher Framework with CNN-ViT Collaborative Learning

MobileUNet-FPN: A Semantic Segmentation Model for Fetal Ultrasound Four-Chamber Segmentation in Edge Computing Environments

RTSeg-Net: A Lightweight Network for Real-time Segmentation of Fetal Head and Pubic Symphysis from Intrapartum Ultrasound Images