Abstract:Background: Real-time tumor tracking is one motion management method to address motion-induced uncertainty. To date, fiducial markers are often required to reliably track lung tumors with X-ray imaging, which carries risks of complications and leads to prolonged treatment time. A markerless tracking approach is thus desirable. Deep learning-based approaches have shown promise for markerless tracking, but systematic evaluation and procedures to investigate applicability in individual cases are missing. Moreover, few efforts have been made to provide bounding box prediction and mask segmentation simultaneously, which could allow either rigid or deformable multi-leaf collimator tracking. Purpose: The purpose of this study was to implement a deep learning-based markerless lung tumor tracking model exploiting patient-specific training which outputs both a bounding box and a mask segmentation simultaneously. We also aimed to compare the two kinds of predictions and to implement a specific procedure to understand the feasibility of markerless tracking on individual cases. Methods: We first trained a Retina U-Net baseline model on digitally reconstructed radiographs (DRRs) generated from a public dataset containing 875 CT scans and corresponding lung nodule annotations. Afterwards, we used an independent cohort of 97 lung patients to develop a patient-specific refinement procedure. In order to determine the optimal hyperparameters for automatic patient-specific training, we selected 13 patients for validation where the baseline model predicted a bounding box on planning CT (PCT)-DRR with intersection over union (IoU) with the ground-truth higher than 0.7. The final test set contained the remaining 84 patients with varying PCT-DRR IoU. For each testing patient, the baseline model was refined on the PCT-DRR to generate a patient-specific model, which was then tested on a separate 10-phase 4DCT-DRR to mimic the intrafraction motion during treatment. A template matching algorithm served as benchmark model. The testing results were evaluated by four metrics: the center of mass (COM) error and the Dice similarity coefficient (DSC) for segmentation masks, and the center of box (COB) error and the DSC for bounding box detections. Performance was compared to the benchmark model including statistical testing for significance. Results: A PCT-DRR IoU value of 0.2 was shown to be the threshold dividing inconsistent (68%) and consistent (100%) success (defined as mean bounding box DSC > 0.6) of PS models on 4DCT-DRRs. Thirty-seven out of the eighty-four testing cases had a PCT-DRR IoU above 0.2. For these 37 cases, the mean COM error was 2.6 mm, the mean segmentation DSC was 0.78, the mean COB error was 2.7 mm, and the mean box DSC was 0.83. Including the validation cases, the model was applicable to 50 out of 97 patients when using the PCT-DRR IoU threshold of 0.2. The inference time per frame was 170 ms. The model outperformed the benchmark model on all metrics, and the comparison was significant (p < 0.001) over the 37 PCT-DRR IoU > 0.2 cases, but not over the undifferentiated 84 testing cases. Conclusions: The implemented patient-specific refinement approach based on a pre-trained baseline model was shown to be applicable to markerless tumor tracking in simulated radiographs for lung cases.

Tumor aware recurrent inter-patient deformable image registration of computed tomography scans with lung cancer

Automated Clinical Target Volume Delineation Using Deep 3D Neural Networks in Radiation Therapy of Non-small Cell Lung Cancer

Deep‐learning based fast and accurate 3D CT deformable image registration in lung cancer

Deformable MRI-TRUS Registration Using Biomechanically Constrained Deep Learning Model for Tumor-Targeted Prostate Brachytherapy

Deformable Image Registration using Unsupervised Deep Learning for CBCT-guided Abdominal Radiotherapy

Inter-fraction Deformable Image Registration Using Unsupervised Deep Learning for CBCT-guided Abdominal Radiotherapy

Unsupervised Deformable Image Registration with Absent Correspondences in Pre-operative and Post-Recurrence Brain Tumor MRI Scans

Diffeomorphic transformer‐based abdomen MRI‐CT deformable image registration

CT-based Volumetric Strain Imaging Via a Deep Learning Registration Framework

Deformable Image Registration of Chest CT Using Deep Cycle Network.

Deep-Learning-based Fast and Accurate 3D CT Deformable Image Registration in Lung Cancer

NIMG-84. COMPARISON OF TRADITIONAL AND ADVANCED DEEP-LEARNING PATIENT SPECIFIC REGISTRATION METHODS IN PRESERVING TUMOR HABITAT IN GLIOBLASTOMA TUMORS: A PRELIMINARY STUDY

Deep Learning-Based Deformable Image Registration of Inter-Fraction CBCT Images for Adaptive Radiation Therapy

Deformable CT Image Registration Via a Dual Feasible Neural Network

Utilization of a Hybrid Finite-Element Based Registration Method to Quantify Heterogeneous Tumor Response for Adaptive Treatment for Lung Cancer Patients

Deep learning-based deformable image registration with bilateral pyramid to align pre-operative and follow-up magnetic resonance imaging (MRI) scans

Enhancing the Target Visibility with Synthetic Target Specific Digitally Reconstructed Radiograph for Intrafraction Motion Monitoring: A Proof-of-concept Study

Simultaneous object detection and segmentation for patient-specific markerless lung tumor tracking in simulated radiographs with deep learning

Real-Time 2D-3D Deformable Registration with Deep Learning and Application to Lung Radiotherapy Targeting

Creating Patient-Specific Digital Phantoms with a Longitudinal Atlas for Evaluating Deformable CT-CBCT Registration in Adaptive Lung Radiotherapy

Enhanced Super-Resolution Reconstruction Of T1w Time-Resolved 4dmri In Low-Contrast Tissue Using 2-Step Hybrid Deformable Image Registration