Abstract:Background: Accurate 3D semantic segmentation models are essential for many clinical applications. To train a model for 3D segmentation, voxel-level annotation is necessary, which is expensive to obtain due to laborious work and privacy protection. To accurately annotate 3D medical data, such as MRI, a common practice is to annotate the volumetric data in a slice-by-slice contouring way along principal axes. Purpose: In order to reduce the annotation effort in slices, weakly supervised learning with a bounding box (Bbox) was proposed to leverage the discriminating information via a tightness prior assumption. Nevertheless, this method requests accurate and tight Bboxes, which will significantly drop the performance when tightness is not held, that is when a relaxed Bbox is applied. Therefore, there is a need to train a stable model based on relaxed Bbox annotation. Methods: This paper presents a mixed-supervised training strategy to reduce the annotation effort for 3D segmentation tasks. In the proposed approach, a fully annotated contour is only required for a single slice of the volume. In contrast, the rest of the slices with targets are annotated with relaxed Bboxes. This mixed-supervised method adopts fully supervised learning, relaxed Bbox prior, and contrastive learning during the training, which ensures the network exploits the discriminative information of the training volumes properly. The proposed method was evaluated on two public 3D medical imaging datasets (MRI prostate dataset and Vestibular Schwannoma [VS] dataset). Results: The proposed method obtained a high segmentation Dice score of 85.3% on an MRI prostate dataset and 83.3% on a VS dataset with relaxed Bbox annotation, which are close to a fully supervised model. Moreover, with the same relaxed Bbox annotations, the proposed method outperforms the state-of-the-art methods. More importantly, the model performance is stable when the accuracy of Bbox annotation varies. Conclusions: The presented study proposes a method based on a mixed-supervised learning method in 3D medical imaging. The benefit will be stable segmentation of the target in 3D images with low accurate annotation requirement, which leads to easier model training on large-scale datasets.

Iterative Learning for Maxillary Sinus Segmentation Based on Bounding Box Annotations

BE-FNet: 3D Bounding Box Estimation Feature Pyramid Network for Accurate and Efficient Maxillary Sinus Segmentation

Automatic CT Image Segmentation of Maxillary Sinus Based on VGG Network and Improved V-Net.

Automatic Segmentation Method for Cone-Beam Computed Tomography Image of the Bone Graft Region Within Maxillary Sinus Based on the Atrous Spatial Pyramid Convolution Network

Automatic CT Segmentation from Bounding Box Annotations using Convolutional Neural Networks

Deep learning-based fully automatic segmentation of the maxillary sinus on cone-beam computed tomographic images

Automatic segmentation of the maxillary sinus on cone beam computed tomographic images with U-Net deep learning model

Deep Learning-Based Automatic Segmentation of Bone Graft Material after Maxillary Sinus Augmentation

3D-BoxSup: Positive-Unlabeled Learning of Brain Tumor Segmentation Networks from 3D Bounding Boxes

Odontogenic cystic lesion segmentation on cone-beam CT using an auto-adapting multi-scaled UNet

Iterative Label Denoising Network: Segmenting Male Pelvic Organs in CT From 3D Bounding Box Annotations

A Label-Efficient Framework for Automated Sinonasal CT Segmentation in Image-Guided Surgery

Confidence-Enhanced Semi-supervised Learning for Mediastinal Neoplasm Segmentation

Light mixed-supervised segmentation for 3D medical image data

A Weakly Supervised Inpainting-Based Learning Method for Lung CT Image Segmentation

MSU-Net: Automatic Segmentation of Lung Infection Boundaries and Small Lesions in CT Images

A Deep-Learning Model with Learnable Group Convolution and Deep Supervision for Brain Tumor Segmentation

Collaborative Learning for Annotation-Efficient Volumetric MR Image Segmentation

Semi-Supervised and Self-Supervised Collaborative Learning for Prostate 3D MR Image Segmentation

Multi-scale adversarial learning with difficult region supervision learning models for primary tumor segmentation

A continuous learning approach to brain tumor segmentation: integrating multi-scale spatial distillation and pseudo-labeling strategies