Abstract:Purpose: In neonatal brain Magnetic Resonance Image(MRI) segmentation, the model we trained on the training set(source domain) often performs poorly in clinical practice(target domain). Since the label of target-domain images is unavailable, this cross-domain segmentation needs unsupervised domain adaptation(UDA) to make the model adapt to the target domain. However, the shape and intensity distribution of neonatal brain MRI images across the domains are largely different from adults'. Current UDA methods aim to make synthesized images similar to the target domain as a whole. But it is impossible to synthesize images with intra-class similarity, because of the regional misalignment caused by the cross-domain difference. This will result in generating intra-classly incorrect intensity information from target-domain images. To address this issue, we propose an IAS-NET(joint Intra-classly Adaptive GAN and Segmentation) framework to bridge the gap between the two domains for intra-class alignment.Methods: Our proposed IAS-NET is an elegant learning framework that transfers the appearance of images across the domains from both image and feature perspectives. It consists of the proposed intra-classly adaptive GAN(IA-NET) and a segmentation network(S-NET). The proposed IA-NET is a GAN-based adaptive network, which contains one generator(including two encoders and one shared decoder) and four discriminators for cross-domain transfer. The two encoders are implemented to extract original image, mean, and variance features from source and target domains. The proposed Local Adaptive Instance Normalization (LAdaIN) algorithm is used to performs intra-class feature alignment to the target domain in the feature-map level. S-NET is a U-net structure network, which is used to provide semantic constraint by a segmentation loss for the training of IA-NET. Meanwhile it offers pseudo-label images for calculating intra-class features of the target domain. Source code (in Tensorflow) is available at: https://github.com/lb-whu/RAS-NET/.Results: Extensive experiments are carried out on two different data sets(NeoBrainS12 and dHCP) respectively. There exist great differences in the shape, size, and intensity distribution of MR images in the two databases. Compared to baseline, we improve the average dice score of all tissues on NeoBrains12 by 6% through adaptive training with unlabeled dHCP images. Besides, we also conduct experiments on dHCP and improved the average dice score by 4%. The quantitative analysis of the mean and variance of the synthesized images shows that the synthesized image by the proposed is closer to the target domain both in the full brain or within each class than that of the compared methods.Conclusions: In this paper, the proposed IAS-NET can improve the performance of the segmentation network effectively by its intra-class feature alignment in the target domain. Compared to the current UDA methods, the synthesized images by IAS-NET are more intra-classly similar to the target domain for neonatal brain MR images. Therefore, it achieves state-of-the-art results in the compared UDA models for the segmentation task.This article is protected by copyright. All rights reserved

SynSeg-Net: Synthetic Segmentation Without Target Modality Ground Truth

SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retraining

Anatomy-Constrained Contrastive Learning for Synthetic Segmentation without Ground-truth

TISS-Net: Brain Tumor Image Synthesis and Segmentation Using Cascaded Dual-Task Networks and Error-Prediction Consistency

Syn_SegNet: A Joint Deep Neural Network for Ultrahigh-Field 7T MRI Synthesis and Hippocampal Subfield Segmentation in Routine 3T MRI.

Towards cross-modal organ translation and segmentation: A cycle- and shape-consistent generative adversarial network

Syn_SegNet: A Joint Deep Neural Network for Ultrahigh-Field 7 T MRI Synthesis and Hippocampal Subfield Segmentation in Routine 3 T MRI

CM-SegNet: A Deep Learning-Based Automatic Segmentation Approach for Medical Images by Combining Convolution and Multilayer Perceptron

Instance Segmentation of Unlabeled Modalities via Cyclic Segmentation GAN

IAS‐NET: Joint intraclassly adaptive GAN and segmentation network for unsupervised cross‐domain in neonatal brain MRI segmentation

Domain Composition and Attention Network Trained with Synthesized Unlabeled Images for Generalizable Medical Image Segmentation

SegAN: Adversarial Network with Multi-scale $L_1$ Loss for Medical Image Segmentation

Towards annotation-efficient segmentation via image-to-image translation

MI-SegNet: Mutual Information-Based US Segmentation for Unseen Domain Generalization

Robust Segmentation of Brain MRI in the Wild with Hierarchical CNNs and no Retraining

CellSegNet: an Adaptive Multi-Resolution Hybrid Network for Cell Segmentation

Shape-Consistent Generative Adversarial Networks for Multi-Modal Medical Segmentation Maps

DIT-NET: Joint Deformable Network and Intra-class Transfer GAN for Cross-domain 3D Neonatal Brain MRI Segmentation

CiT-Net: Convolutional Neural Networks Hand in Hand with Vision Transformers for Medical Image Segmentation

CycleSeg: Simultaneous synthetic CT generation and unsupervised segmentation for MR‐only radiotherapy treatment planning of prostate cancer

CNS - CycleGAN-Assisted Neonatal Segmentation Model for Cross-Datasets.