Abstract:Quantitative Cone Beam CT (CBCT) is the foundation for image-guided radiation therapy (RT) techniques. In addition to the current application of patient setup during pancreatic RT, CBCT has the potential to be further employed to assess inter-fraction variability in organs-at-risk (OARs) caused by patient motion, weight loss, and other factors. Accurate segmentations of OARs with on-board CBCT could help online dose evaluation for avoiding severe gastrointestinal toxicity given varying proximity of sensitive OARs to high dose regions; however manual segmentation on daily CBCTs is labor-intensive. Image quality of CBCT is usually far inferior to simulation CT scans, making automated segmentation extremely difficult. This study aims to develop deep-learning-based CBCT segmentation aided by synthetic CT (sCT) to facilitate accurate, automated OAR delineation during CBCT-guided adaptive RT. Forty patients who received RT for pancreatic carcinoma had their OARs contoured on a CBCT scan from their RT. A multi-task deep learning-based method was used to first enhance the CBCT image quality and then simultaneously segment multiple organs. To enhance the CBCT image quality, a cycle-consistent generative adversarial network (CycleGAN) was used to generate high-quality sCT from CBCT. The aligned CT image was used as learning target of CBCT image. To learn the specific difference between CBCT and CT and thus reduce the scatter artifact, nine residual blocks were integrated into the CycleGAN. A deep attention fully convolution network took sCT as input, and output the multi-channel binary mask of OARs, each channel denoted one OAR. Deep attention strategy was used via involved attention gates to automatically highlight the significant features that accurately represent the different organs. We performed five-fold cross-validation experiments to evaluate our method. Dice similarity coefficient (DSC), mean surface distance (MSD) and percentage volume difference (PVD) were used to quantify the differences between our segmentation and manual contour (ground truth). The averaged DSC, MSD and PVD are 0.80±0.20, 1.95±2.37mm and 10.81±9.28% for duodenum, 0.87±0.05, 1.33±0.58mm and 4.06±4.43% for small bowel, 0.88±0.07, 2.10±2.21mm and 4.68±6.16% for large bowel, 0.91±0.08, 1.59±1.92 mm and 6.09±7.37% for stomach, 0.93±0.05, 2.90±4.77 mm and 4.31±5.68% for liver, 0.92±0.05, 2.05±4.71 mm and 5.20±5.35% for left kidney, 0.93±0.04, 2.09±3.40mm and 2.58±5.06% for right kidney and 0.88±0.07, 0.75±0.50 mm and 7.20±9.58% for spinal cord. All OARs were segmented within several seconds. This study demonstrated that a novel sCT-aided deep learning method for multi-organ segmentation is capable of reliably and rapidly segmenting multiple OARs for adaptive RT of pancreatic cancer. The accurate sCT-based pancreatic OAR delineation warrants further development of a CBCT-guided adaptive RT workflow for pancreatic cancer.

CycleSeg: Simultaneous synthetic CT generation and unsupervised segmentation for MR‐only radiotherapy treatment planning of prostate cancer

Automatic Segmentation of Prostate Magnetic Resonance Imaging Using Generative Adversarial Networks

Multi-organ Segmentation in Pelvic CT Images with CT-based Synthetic MRI

SynSeg-Net: Synthetic Segmentation Without Target Modality Ground Truth

Synthetic CT-aided Online CBCT Multi-Organ Segmentation for CBCT-guided Adaptive Radiotherapy of Pancreatic Cancer

Cbct-Guided Prostate Adaptive Radiotherapy With Cbct-Based Synthetic Mri And Ct

Channel-Spatial Attention Guided CycleGAN for CBCT-Based Synthetic CT Generation to Enable Adaptive Radiotherapy

Multi-organ Segmentation of Male Pelvic CT using Dual Attention Networks

Daily Cone-Beam CT Multi-Organ Segmentation for Prostate Adaptive Radiotherapy.

MRI-only Based Synthetic CT Generation Using Dense Cycle Consistent Generative Adversarial Networks.

Male Pelvic CT Multi-Organ Segmentation Using Synthetic MRI-aided Dual Pyramid Networks

Male Pelvic Multi-Organ Segmentation Aided by CBCT-based Synthetic MRI

MRI-based Proton Radiotherapy for Prostate Cancer Using Deep Convolutional Neural Networks

Semi-Automatic Segmentation of Prostate in CT Images Via Coupled Feature Representation and Spatial-Constrained Transductive Lasso

A Novel Perceptual Constrained cycleGAN With Attention Mechanisms for Unsupervised MR‐to‐CT Synthesis

Spatially Invariant and Frequency-Aware CycleGAN for Unsupervised MR-to-CT Synthesis

Development of an Unsupervised Cycle Contrastive Unpaired Translation Network for MRI‐to‐CT Synthesis

Anatomy-constrained synthesis for spleen segmentation improvement in unpaired mouse micro-CT scans with 3D CycleGAN

Synthetic MRI-aided Pelvic Multi-Organ Segmentation in Cone-Beam Computed Tomography.

Region of interest focused MRI to synthetic CT translation using regression and segmentation multi-task network