Abstract:Background: Real-time tumor tracking is one motion management method to address motion-induced uncertainty. To date, fiducial markers are often required to reliably track lung tumors with X-ray imaging, which carries risks of complications and leads to prolonged treatment time. A markerless tracking approach is thus desirable. Deep learning-based approaches have shown promise for markerless tracking, but systematic evaluation and procedures to investigate applicability in individual cases are missing. Moreover, few efforts have been made to provide bounding box prediction and mask segmentation simultaneously, which could allow either rigid or deformable multi-leaf collimator tracking. Purpose: The purpose of this study was to implement a deep learning-based markerless lung tumor tracking model exploiting patient-specific training which outputs both a bounding box and a mask segmentation simultaneously. We also aimed to compare the two kinds of predictions and to implement a specific procedure to understand the feasibility of markerless tracking on individual cases. Methods: We first trained a Retina U-Net baseline model on digitally reconstructed radiographs (DRRs) generated from a public dataset containing 875 CT scans and corresponding lung nodule annotations. Afterwards, we used an independent cohort of 97 lung patients to develop a patient-specific refinement procedure. In order to determine the optimal hyperparameters for automatic patient-specific training, we selected 13 patients for validation where the baseline model predicted a bounding box on planning CT (PCT)-DRR with intersection over union (IoU) with the ground-truth higher than 0.7. The final test set contained the remaining 84 patients with varying PCT-DRR IoU. For each testing patient, the baseline model was refined on the PCT-DRR to generate a patient-specific model, which was then tested on a separate 10-phase 4DCT-DRR to mimic the intrafraction motion during treatment. A template matching algorithm served as benchmark model. The testing results were evaluated by four metrics: the center of mass (COM) error and the Dice similarity coefficient (DSC) for segmentation masks, and the center of box (COB) error and the DSC for bounding box detections. Performance was compared to the benchmark model including statistical testing for significance. Results: A PCT-DRR IoU value of 0.2 was shown to be the threshold dividing inconsistent (68%) and consistent (100%) success (defined as mean bounding box DSC > 0.6) of PS models on 4DCT-DRRs. Thirty-seven out of the eighty-four testing cases had a PCT-DRR IoU above 0.2. For these 37 cases, the mean COM error was 2.6 mm, the mean segmentation DSC was 0.78, the mean COB error was 2.7 mm, and the mean box DSC was 0.83. Including the validation cases, the model was applicable to 50 out of 97 patients when using the PCT-DRR IoU threshold of 0.2. The inference time per frame was 170 ms. The model outperformed the benchmark model on all metrics, and the comparison was significant (p < 0.001) over the 37 PCT-DRR IoU > 0.2 cases, but not over the undifferentiated 84 testing cases. Conclusions: The implemented patient-specific refinement approach based on a pre-trained baseline model was shown to be applicable to markerless tumor tracking in simulated radiographs for lung cases.

Real-time Marker Tracking for MV Treatment Beam Imaging

Real-time automatic fiducial marker tracking in low contrast cine-MV images

Design and Validation of a MV/kV Imaging-Based Markerless Tracking System for Assessing Real-Time Lung Tumor Motion

A Novel Marker-Less Tumor Tracking Strategyonlow-Rank Fluoroscopic Images for Image-Guided Lung Cancer Radiotherapy

Deep learning enables MV-based real-time image guided radiation therapy for prostate cancer patients

Markerless motion tracking with simultaneous MV and kV imaging in spine SBRT treatment-a feasibility study

A markerless beam's eye view tumor tracking algorithm based on unsupervised deformable registration learning framework of VoxelMorph in medical image with partial data

TH‐E‐17A‐11: Tracking Tumor’s Boundary in MV Image Sequences for Image‐Guided Radiation Therapy

Markerless tracking of tumor and tissues: A motion model approach

Automatic target positioning and tracking for image-guided radiotherapy without implanted fiducials

Deep-learning-based Markerless Tumor Localization Using 2D KV/MV Image.

Automated target tracking in kilovoltage images using dynamic templates of fiducial marker clusters

WE-AB-303-08: Direct Lung Tumor Tracking Using Short Imaging Arcs

MA13.01 Markerless Tumor Tracking During Lung Radiotherapy Using Intrafraction X-Ray Imaging

A markerless beam's eye view motion monitoring algorithm based on structure conversion and demons registration in medical image with partial data

Markerless Tumor Tracking Using Short Kilovoltage Imaging Arcs for Lung Image-Guided Radiotherapy

Development of Automated Real-time Tracking and Localizing System in Radiotherapy

A Novel Automatic Real-time Motion Tracking Method for Magnetic Resonance Imaging-guided Radiotherapy: Leveraging the Enhanced Tracking-Learning-Detection Framework with Automatic Segmentation

Real-Time Markerless Tracking of Lung Tumors Based on 2-D Fluoroscopy Imaging Using Convolutional LSTM

Simultaneous object detection and segmentation for patient-specific markerless lung tumor tracking in simulated radiographs with deep learning

SU-E-J-61: Monitoring Tumor Motion in Real-Time with EPID Imaging During Cervical Cancer Treatment