Abstract:BackgroundIntrafraction motion monitoring in External Beam Radiation Therapy (EBRT) is usually accomplished by establishing a correlation between the tumor and the surrogates such as an external infrared reflector, implanted fiducial markers, or patient skin surface. These techniques either have unstable surrogate-tumor correlation or are invasive. Markerless real-time onboard imaging is a noninvasive alternative that directly images the target motion. However, the low target visibility due to overlapping tissues along the X-ray projection path makes tumor tracking challenging. PurposeTo enhance the target visibility in projection images, a patient-specific model was trained to synthesize the Target Specific Digitally Reconstructed Radiograph (TS-DRR). MethodsPatient-specific models were built using a conditional Generative Adversarial Network (cGAN) to map the onboard projection images to TS-DRR. The standard Pix2Pix network was adopted as our cGAN model. We synthesized the TS-DRR based on the onboard projection images using phantom and patient studies for spine tumors and lung tumors. Using previously acquired CT images, we generated DRR and its corresponding TS-DRR to train the network. For data augmentation, random translations were applied to the CT volume when generating the training images. For the spine, separate models were trained for an anthropomorphic phantom and a patient treated with paraspinal stereotactic body radiation therapy (SBRT). For lung, separate models were trained for a phantom with a spherical tumor insert and a patient treated with free-breathing SBRT. The models were tested using Intrafraction Review Images (IMR) for the spine and CBCT projection images for the lung. The performance of the models was validated using phantom studies with known couch shifts for the spine and known tumor deformation for the lung. ResultsBoth the patient and phantom studies showed that the proposed method can effectively enhance the target visibility of the projection images by mapping them into synthetic TS-DRR (sTS-DRR). For the spine phantom with known shifts of 1 mm, 2 mm, 3 mm, and 4 mm, the absolute mean errors for tumor tracking were 0.11 & PLUSMN; 0.05 mm in the x direction and 0.25 & PLUSMN; 0.08 mm in the y direction. For the lung phantom with known tumor motion of 1.8 mm, 5.8 mm, and 9 mm superiorly, the absolute mean errors for the registration between the sTS-DRR and ground truth are 0.1 & PLUSMN; 0.3 mm in both the x and y directions. Compared to the projection images, the sTS-DRR has increased the image correlation with the ground truth by around 83% and increased the structural similarity index measure with the ground truth by around 75% for the lung phantom. ConclusionsThe sTS-DRR can greatly enhance the target visibility in the onboard projection images for both the spine and lung tumors. The proposed method could be used to improve the markerless tumor tracking accuracy for EBRT.

Deep learning-based synthetization of real-time in-treatment 4D images using surface motion and pretreatment images: A proof-of-concept study.

CT respiratory motion synthesis using joint supervised and adversarial learning

Synthetic cranial MRI from 3D optical surface scans using deep learning for radiation therapy treatment planning

On-board synthetic 4D MRI generation from 4D CBCT for radiotherapy of abdominal tumors: A feasibility study

Deep learning-based Real-time Volumetric Imaging for Lung Stereotactic Body Radiation Therapy: A Proof of Concept Study

Real-time Prediction of Soft Tissue Deformations Using Data-driven Nonlinear Presurgical Simulations

Patient-specific deep learning for 3D protoacoustic image reconstruction and dose verification in proton therapy

Data-Driven Volumetric Computed Tomography Image Generation From Surface Structures Using a Patient-Specific Deep Leaning Model

A model that predicts a Real-Time tumour surface using Intra-Treatment skin surface and end-of-Expiration and end-of-Inhalation planning CT images

A Real-Time Four-Dimensional Reconstruction Algorithm of Cine-Magnetic Resonance Imaging (Cine-MRI) Using Deep Learning

Real-Time 2D-3D Deformable Registration with Deep Learning and Application to Lung Radiotherapy Targeting

Improving accelerated 3D imaging in MRI-guided radiotherapy for prostate cancer using a deep learning method

Hybrid-supervised deep learning for domain transfer 3D protoacoustic image reconstruction

Real-time liver tumor localization via a single x-ray projection using deep graph neural network-assisted biomechanical modeling

Deep learning-based motion tracking using ultrasound images

Enhancing the Target Visibility with Synthetic Target Specific Digitally Reconstructed Radiograph for Intrafraction Motion Monitoring: A Proof-of-concept Study

Deep Learning Based Automatic Internal Gross Target Volume Delineation from 4D-CT of Hepatocellular Carcinoma Patients

A Deep Learning Approach to Transform Two Orthogonal X-ray Images to Volumetric Images for Image-Guided Proton Therapy.

Deep learning-based image reconstruction and motion estimation from undersampled radial k-space for real-time MRI-guided radiotherapy

A novel approach for estimating lung tumor motion based on dynamic features in 4D-CT