Abstract:Objective. This work aims to develop an automated segmentation method for the prostate and its surrounding organs-at-risk in pelvic computed tomography to facilitate prostate radiation treatment planning. Approach. In this work, we propose a novel deep learning algorithm combining a U-shaped convolutional neural network (CNN) and vision transformer (VIT) for multi-organ (i.e. bladder, prostate, rectum, left and right femoral heads) segmentation in male pelvic CT images. The U-shaped model consists of three components: a CNN-based encoder for local feature extraction, a token-based VIT for capturing global dependencies from the CNN features, and a CNN-based decoder for predicting the segmentation outcome from the VIT's output. The novelty of our network is a token-based multi-head self-attention mechanism used in the transformer, which encourages long-range dependencies and forwards informative high-resolution feature maps from the encoder to the decoder. In addition, a knowledge distillation strategy is deployed to further enhance the learning capability of the proposed network. Main results. We evaluated the network using: (1) a dataset collected from 94 patients with prostate cancer; (2) and a public dataset CT-ORG. A quantitative evaluation of the proposed network's performance was performed on each organ based on (1) volume similarity between the segmented contours and ground truth using Dice score, segmentation sensitivity, and precision, (2) surface similarity evaluated by Hausdorff distance (HD), mean surface distance (MSD) and residual mean square distance (RMS), (3) and percentage volume difference (PVD). The performance was then compared against other state-of-art methods. Average volume similarity measures obtained by the network overall organs were Dice score = 0.91, sensitivity = 0.90, precision = 0.92, average surface similarities were HD = 3.78 mm, MSD = 1.24 mm, RMS = 2.03 mm; average percentage volume difference was PVD = 9.9% on the first dataset. The network also obtained Dice score = 0.93, sensitivity = 0.93, precision = 0.93, average surface similarities were HD = 5.82 mm, MSD = 1.16 mm, RMS = 1.24 mm; average percentage volume difference was PVD = 6.6% on the CT-ORG dataset. Significance. In summary, we propose a token-based transformer network with knowledge distillation for multi-organ segmentation using CT images. This method provides accurate and reliable segmentation results for each organ using CT imaging, facilitating the prostate radiation clinical workflow.

Male Pelvic CT Multi-Organ Segmentation Using Synthetic MRI-aided Dual Pyramid Networks

Multi-organ Segmentation of Male Pelvic CT using Dual Attention Networks

Multi-organ Segmentation in Pelvic CT Images with CT-based Synthetic MRI

Male Pelvic Multi-Organ Segmentation Aided by CBCT-based Synthetic MRI

Male Pelvic Multi-Organ Segmentation Using V-transformer Network.

Daily Cone-Beam CT Multi-Organ Segmentation for Prostate Adaptive Radiotherapy.

Synthetic MRI-aided Pelvic Multi-Organ Segmentation in Cone-Beam Computed Tomography.

Male Pelvic Multi-Organ Segmentation Using Token-Based Transformer Vnet.

Multi-scale discriminative network for prostate cancer lesion segmentation in multiparametric MR images

Male Pelvic Multi-Organ Segmentation on Transrectal Ultrasound Using Anchor-free Mask CNN.

Synthetic CT-aided Multiorgan Segmentation for CBCT-guided Adaptive Pancreatic Radiotherapy

Automatic multiorgan segmentation in CT images of the male pelvis using region-specific hierarchical appearance cluster models

CT Prostate Segmentation Based on Synthetic MRI-aided Deep Attention Fully Convolution Network.

Synthetic MRI-aided multi-organ segmentation on male pelvic CT using cycle consistent deep attention network.

Automatic Segmentation of Prostate Magnetic Resonance Imaging Using Generative Adversarial Networks

Synthetic MRI-aided Multi-Organ Segmentation in Head-and-neck Cone Beam CT

Region Proposal Network for Multi-Organ Segmentation in CT for Pancreatic Radiotherapy

CT Male Pelvic Organ Segmentation Using Fully Convolutional Networks with Boundary Sensitive Representation

3D Multi-Scale Discriminative Network with Multi-Directional Edge Loss for Prostate Zonal Segmentation in Bi-Parametric MR Images

Multi-task edge-recalibrated network for male pelvic multi-organ segmentation on CT images