Abstract:Quantitative Cone Beam CT (CBCT) is the foundation for image-guided radiation therapy (RT) techniques. In addition to the current application of patient setup during pancreatic RT, CBCT has the potential to be further employed to assess inter-fraction variability in organs-at-risk (OARs) caused by patient motion, weight loss, and other factors. Accurate segmentations of OARs with on-board CBCT could help online dose evaluation for avoiding severe gastrointestinal toxicity given varying proximity of sensitive OARs to high dose regions; however manual segmentation on daily CBCTs is labor-intensive. Image quality of CBCT is usually far inferior to simulation CT scans, making automated segmentation extremely difficult. This study aims to develop deep-learning-based CBCT segmentation aided by synthetic CT (sCT) to facilitate accurate, automated OAR delineation during CBCT-guided adaptive RT. Forty patients who received RT for pancreatic carcinoma had their OARs contoured on a CBCT scan from their RT. A multi-task deep learning-based method was used to first enhance the CBCT image quality and then simultaneously segment multiple organs. To enhance the CBCT image quality, a cycle-consistent generative adversarial network (CycleGAN) was used to generate high-quality sCT from CBCT. The aligned CT image was used as learning target of CBCT image. To learn the specific difference between CBCT and CT and thus reduce the scatter artifact, nine residual blocks were integrated into the CycleGAN. A deep attention fully convolution network took sCT as input, and output the multi-channel binary mask of OARs, each channel denoted one OAR. Deep attention strategy was used via involved attention gates to automatically highlight the significant features that accurately represent the different organs. We performed five-fold cross-validation experiments to evaluate our method. Dice similarity coefficient (DSC), mean surface distance (MSD) and percentage volume difference (PVD) were used to quantify the differences between our segmentation and manual contour (ground truth). The averaged DSC, MSD and PVD are 0.80±0.20, 1.95±2.37mm and 10.81±9.28% for duodenum, 0.87±0.05, 1.33±0.58mm and 4.06±4.43% for small bowel, 0.88±0.07, 2.10±2.21mm and 4.68±6.16% for large bowel, 0.91±0.08, 1.59±1.92 mm and 6.09±7.37% for stomach, 0.93±0.05, 2.90±4.77 mm and 4.31±5.68% for liver, 0.92±0.05, 2.05±4.71 mm and 5.20±5.35% for left kidney, 0.93±0.04, 2.09±3.40mm and 2.58±5.06% for right kidney and 0.88±0.07, 0.75±0.50 mm and 7.20±9.58% for spinal cord. All OARs were segmented within several seconds. This study demonstrated that a novel sCT-aided deep learning method for multi-organ segmentation is capable of reliably and rapidly segmenting multiple OARs for adaptive RT of pancreatic cancer. The accurate sCT-based pancreatic OAR delineation warrants further development of a CBCT-guided adaptive RT workflow for pancreatic cancer.

Multi-organ Segmentation of Male Pelvic CT using Dual Attention Networks

Male Pelvic CT Multi-Organ Segmentation Using Synthetic MRI-aided Dual Pyramid Networks

Multi-organ Segmentation in Pelvic CT Images with CT-based Synthetic MRI

Daily Cone-Beam CT Multi-Organ Segmentation for Prostate Adaptive Radiotherapy.

Male Pelvic Multi-Organ Segmentation Using V-transformer Network.

Male Pelvic Multi-Organ Segmentation Aided by CBCT-based Synthetic MRI

Male Pelvic Multi-Organ Segmentation on Transrectal Ultrasound Using Anchor-free Mask CNN.

Synthetic MRI-aided multi-organ segmentation on male pelvic CT using cycle consistent deep attention network.

Synthetic MRI-aided Pelvic Multi-Organ Segmentation in Cone-Beam Computed Tomography.

Synthetic CT-aided Multiorgan Segmentation for CBCT-guided Adaptive Pancreatic Radiotherapy

Male Pelvic Multi-Organ Segmentation Using Token-Based Transformer Vnet.

CT Male Pelvic Organ Segmentation Using Fully Convolutional Networks with Boundary Sensitive Representation

Region Proposal Network for Multi-Organ Segmentation in CT for Pancreatic Radiotherapy

CT-based Multi-Organ Segmentation Using a 3D Self-Attention U-net Network for Pancreatic Radiotherapy

Segmentation of the prostate and organs at risk in male pelvic CT images using deep learning

Multi-task edge-recalibrated network for male pelvic multi-organ segmentation on CT images

CT Prostate Segmentation Based on Synthetic MRI-aided Deep Attention Fully Convolution Network.

Synthetic CT-aided Online CBCT Multi-Organ Segmentation for CBCT-guided Adaptive Radiotherapy of Pancreatic Cancer

Prostate and Tumor Segmentation on PET/CT Using Dual Mask R-CNN

Synthetic MRI-aided Multi-Organ Segmentation in Head-and-neck Cone Beam CT

Attention-guided multi-scale learning network for automatic prostate and tumor segmentation on MRI