Abstract:Objective. This work aims to develop an automated segmentation method for the prostate and its surrounding organs-at-risk in pelvic computed tomography to facilitate prostate radiation treatment planning. Approach. In this work, we propose a novel deep learning algorithm combining a U-shaped convolutional neural network (CNN) and vision transformer (VIT) for multi-organ (i.e. bladder, prostate, rectum, left and right femoral heads) segmentation in male pelvic CT images. The U-shaped model consists of three components: a CNN-based encoder for local feature extraction, a token-based VIT for capturing global dependencies from the CNN features, and a CNN-based decoder for predicting the segmentation outcome from the VIT's output. The novelty of our network is a token-based multi-head self-attention mechanism used in the transformer, which encourages long-range dependencies and forwards informative high-resolution feature maps from the encoder to the decoder. In addition, a knowledge distillation strategy is deployed to further enhance the learning capability of the proposed network. Main results. We evaluated the network using: (1) a dataset collected from 94 patients with prostate cancer; (2) and a public dataset CT-ORG. A quantitative evaluation of the proposed network's performance was performed on each organ based on (1) volume similarity between the segmented contours and ground truth using Dice score, segmentation sensitivity, and precision, (2) surface similarity evaluated by Hausdorff distance (HD), mean surface distance (MSD) and residual mean square distance (RMS), (3) and percentage volume difference (PVD). The performance was then compared against other state-of-art methods. Average volume similarity measures obtained by the network overall organs were Dice score = 0.91, sensitivity = 0.90, precision = 0.92, average surface similarities were HD = 3.78 mm, MSD = 1.24 mm, RMS = 2.03 mm; average percentage volume difference was PVD = 9.9% on the first dataset. The network also obtained Dice score = 0.93, sensitivity = 0.93, precision = 0.93, average surface similarities were HD = 5.82 mm, MSD = 1.16 mm, RMS = 1.24 mm; average percentage volume difference was PVD = 6.6% on the CT-ORG dataset. Significance. In summary, we propose a token-based transformer network with knowledge distillation for multi-organ segmentation using CT images. This method provides accurate and reliable segmentation results for each organ using CT imaging, facilitating the prostate radiation clinical workflow.

Hierarchical Representation for Ct Prostate Segmentation.

CT Male Pelvic Organ Segmentation Using Fully Convolutional Networks with Boundary Sensitive Representation

Pelvic Organ Segmentation Using Distinctive Curve Guided Fully Convolutional Networks

Multi-scale discriminative network for prostate cancer lesion segmentation in multiparametric MR images

HF-UNet: Learning Hierarchically Inter-Task Relevance in Multi-Task U-Net for Accurate Prostate Segmentation in CT Images

Automated Prostate Segmentation of Volumetric CT Images Using 3D Deeply Supervised Dilated FCN.

Automatic Segmentation of the Prostate on CT Images Using Deep Learning and Multi-Atlas Fusion

Does Manual Delineation Only Provide the Side Information in CT Prostate Segmentation?

Multi-stage Fully Convolutional Network for Precise Prostate Segmentation in Ultrasound Images

Semi-Automatic Segmentation of Prostate in CT Images Via Coupled Feature Representation and Spatial-Constrained Transductive Lasso

A Learning-Based CT Prostate Segmentation Method Via Joint Transductive Feature Selection and Regression

Boundary Coding Representation for Organ Segmentation in Prostate Cancer Radiotherapy

Male Pelvic CT Multi-Organ Segmentation Using Synthetic MRI-aided Dual Pyramid Networks

A Combined Learning Algorithm for Prostate Segmentation on 3D CT Images

Combining Population and Patient-Specific Characteristics for Prostate Segmentation on 3D CT Images.

Prostate and Tumor Segmentation on PET/CT Using Dual Mask R-CNN

Automatic MRI Prostate Segmentation Using 3D Deeply Supervised FCN with Concatenated Atrous Convolution

Male Pelvic Multi-Organ Segmentation Using V-transformer Network.

Multi-organ Segmentation of Male Pelvic CT using Dual Attention Networks

Male Pelvic Multi-Organ Segmentation Using Token-Based Transformer Vnet.

Multi-organ Segmentation in Pelvic CT Images with CT-based Synthetic MRI