Abstract:Pancreatic cancer has dismal prognosis with five-year survival of ∼5%. Although surgery is considered the most effective treatment, only 10-20% of the patients present with resectable disease. Stereotactic body radiation therapy (SBRT) with simultaneous integrated boost (SIB) to tumor sub-volumes abutting major vessels has the potential to sterilize the tumor sub-volumes and down-stage patients for subsequent successful resection. However, abdominal tumor and organs are mobile. SBRT-SIB to small tumor sub-volumes is greatly challenged by ventilation induced tumor and organ motion, making it difficult to define treatment margins. 4D imaging has been used to assess tumor motion in radiation therapy. In a 4D image set, 5 to 10 3D volumetric images are usually generated, making manual segmentation of involved vessels time-consuming and not practical in real clinical setting. The purpose of this study is to apply a novel deep-learning method, two-scale convolutional neural network (CNN) followed by distance and contour regularized level set evolution (DCRLSE), on pancreas 4D-MR data sets to automatically delineate vessels limiting surgery. The 4D-MR images of ten patients were used. Each patient has 10 3D respiration-resolved image sets. For each 3D image set, there are approximately 40 2D axial slices that include vessels limiting surgery. For each patient’s 4D-MRI data-set, 300 image frames were analyzed. The proposed transferred CNN routine is composed of two tasks. In the source task, a relatively large amount of data is used to train the paired CNN. In the target task, a relatively small amount of data is used to fine-tune the network. In the test phase, Paired CNN is used to locate and roughly segment the vessel. Small holes in the segmentation are filled using morphological operation. The DCRLSE model is then used to refine the contours. Transferred learning is used to improve the performance by exploiting the similarity among different patients. After the binary mask is trained on one patient, the network weights are transferred to initialize the CNN training of the second patient’s network. The weights are fine-tuned on selected breathing phases to find the minimal number of images needed for the new segmentation task. A widely used segmentation method, level-set, was used for comparison. Manual segmentation was used as ground truth. The segmentation results were evaluated visually, as well as quantitatively using four metrics: sensitivity, specificity, dice similarity coefficient (DSC) and modified Hausdorff distance (HD). CNN-DCRLSE method visually showed more consistent segmentation results comparing to level-set method. It was able to achieve average sensitivity of 0.876±0.070 (mean±σ), specificity of 0.999±0.001, DSC of 0.863±0.081, and HD (mm) of 0.099±0.059. The CNN-DCRLSE method was successfully implemented on 4D-MR images to automatically segment major blood vessels that limit surgery for pancreatic cancer patients.

CT-based Pancreatic Multi-organ Segmentation by a 3D Deep Attention U-Net Network

CT-based Multi-Organ Segmentation Using a 3D Self-Attention U-net Network for Pancreatic Radiotherapy

Region Proposal Network for Multi-Organ Segmentation in CT for Pancreatic Radiotherapy

Multi-organ segmentation of abdominal structures from non-contrast and contrast enhanced CT images

Synthetic CT-aided Online CBCT Multi-Organ Segmentation for CBCT-guided Adaptive Radiotherapy of Pancreatic Cancer

Harnessing 2D Networks and 3D Features for Automated Pancreas Segmentation from Volumetric CT Images

Synthetic CT-aided Multiorgan Segmentation for CBCT-guided Adaptive Pancreatic Radiotherapy

Synthetic CT-based Multi-Organ Segmentation in Cone Beam CT for Adaptive Pancreatic Radiotherapy.

Pancreas segmentation in CT based on RC-3DUNet with SOM

Multi-organ segmentation network for abdominal CT images based on spatial attention and deformable convolution

Automated Vessel Segmentation in Pancreas 4D-MRI Using a Novel Transferred Convolutional Neural Network

Robust Pancreatic Ductal Adenocarcinoma Segmentation with Multi-institutional Multi-phase Partially-Annotated CT Scans

Fully Automated Pancreas Segmentation with Two-stage 3D Convolutional Neural Networks

View Adaptive Learning for Pancreas Segmentation

Learning a Discriminative Feature Attention Network for Pancreas CT Segmentation

Multi-organ Segmentation of Male Pelvic CT using Dual Attention Networks

Comprehensive evaluation of a deep learning model for automatic organs at risk segmentation on heterogeneous computed tomography images for abdominal radiotherapy

nnU-Net-Based Pancreas Segmentation and Volume Measurement on CT Imaging in Patients with Pancreatic Cancer

Incorporating Multi-Stage Spatial Visual Cues and Active Localization Offset for Pancreas Segmentation.

Attention-guided duplex adversarial U-net for pancreatic segmentation from computed tomography images

Prior Attention Enhanced Convolutional Neural Network Based Automatic Segmentation of Organs at Risk for Head and Neck Cancer Radiotherapy.