Abstract:Accurate neonatal brain MRI segmentation is valuable for investigating brain growth patterns and tracking the progression of neurodevelopmental disorders. However, it is a challenging task to use intensity-based methods to segment neonatal brain structures because of small contrast differences between brain regions caused by the inherent myelination process. Although convolutional neural networks offer the potential to segment brain structures in an intensity-independent manner, they suffer from lack of in-plane long-range dependency which is essential for the segmentation. To solve this problem, we propose a novel Transformer-Weighted network (TW-Net) to incorporate in-plane long-range dependency information. TW-Net employs a conventional encoder-decoder architecture with a Transformer module in the middle. The Transformer module uses a rotate-and-flip layer to better calculate the similarity between two patches in a slice to leverage similar patterns of geometrical and texture features within brain structures. In addition, a deep supervision module and squeeze-and-excitation blocks are introduced to incorporate boundary information of brain structures. Compared with state-of-the-art deep learning algorithms, TW-Net outperforms these methods for multiple-label tasks in 2D and 2.5D configurations on two independent public datasets, demonstrating that TW-Net is a promising method for neonatal brain MRI segmentation.

What problem does this paper attempt to address?

This paper attempts to address the challenging problem of neonatal brain MRI segmentation. Specifically, the authors point out that due to the low contrast between different regions of the neonatal brain in MRI images, intensity-based methods are ineffective in segmenting neonatal brain structures. Additionally, although convolutional neural networks (CNNs) can partially overcome the limitations of intensity-based methods, they are insufficient in capturing long-range dependencies within the plane, which is crucial for manually segmenting neonatal brain structures. To tackle these issues, the authors propose a novel Transformer Weighted Network (TW-Net), which aims to capture long-range dependency information within the plane by introducing a Transformer module. TW-Net adopts the traditional encoder-decoder architecture and incorporates the Transformer module in the middle. The Transformer module enhances the similarity calculation between two patches through Rotation and Flip layers (RF layers), thereby better utilizing geometric and texture features. Additionally, a deep supervision module and Squeeze-and-Excitation blocks (SE blocks) are introduced to integrate boundary information of brain structures. Overall, the main contribution of this paper lies in proposing a novel network architecture that can effectively segment neonatal brain MRI, particularly excelling in multi-label tasks. Experimental results demonstrate that TW-Net outperforms existing state-of-the-art deep learning algorithms on multiple independent public datasets.

TW-Net: Transformer Weighted Network for Neonatal Brain MRI Segmentation