Abstract:Background: Artificial intelligence (AI) based radiotherapy treatment planning tools have gained interest in automating the treatment planning process. It is essential to understand their overall robustness in various clinical scenarios. This is an existing gap between many AI based tools and their actual clinical deployment. This study works to fill the gap for AI based treatment planning by investigating a clinical robustness assessment (CRA) tool for the AI based planning methods using a phantom simulation approach. Methods: A cylindrical phantom was created in the treatment planning system (TPS) with the axial dimension of 30 cm by 18 cm. Key structures involved in pancreas stereotactic body radiation therapy (SBRT) including PTV25, PTV33, C-Loop, stomach, bowel and liver were created within the phantom. Several simulation scenarios were created to mimic multiple scenarios of anatomical changes, including displacement, expansion, rotation and combination of three. The goal of treatment planning was to deliver 25 Gy to PTV25 and 33 Gy to PTV33 in 5 fractions in simultaneous integral boost (SIB) manner while limiting luminal organ-at-risk (OAR) max dose to be under 29 Gy. A previously developed deep learning based AI treatment planning tool for pancreas SBRT was identified as the validation object. For each scenario, the anatomy information was fed into the AI tool and the final fluence map associated to the plan was generated, which was subsequently sent to TPS for leaf sequencing and dose calculation. The final auto plan's quality was analyzed against the treatment planning constraint. The final plans' quality was further analyzed to evaluate potential correlation with anatomical changes using the Manhattan plot. Results: A total of 32 scenarios were simulated in this study. For all scenarios, the mean PTV25 V25Gy of the AI based auto plans was 96.7% while mean PTV33 V33Gy was 82.2%. Large variation (16.3%) in PTV33 V33Gy was observed due to anatomical variations, a.k.a. proximity of luminal structure to PTV33. Mean max dose was 28.55, 27.68 and 24.63 Gy for C-Loop, bowel and stomach, respectively. Using D0.03cc as max dose surrogate, the value was 28.03, 27.12 and 23.84 Gy for C-Loop, bowel and stomach, respectively. Max dose constraint of 29 Gy was achieved for 81.3% cases for C-Loop and stomach, and 78.1% for bowel. Using D0.03cc as max dose surrogate, the passing rate was 90.6% for C-Loop, and 81.3% for bowel and stomach. Manhattan plot revealed high correlation between the OAR over dose and the minimal distance between the PTV33 and OAR. Conclusions: The results showed promising robustness of the pancreas SBRT AI tool, providing important evidence of its readiness for clinical implementation. The established workflow could guide the process of assuring clinical readiness of future AI based treatment planning tools.

Clinical implementation and evaluation of deep learning-assisted automatic radiotherapy treatment planning for lung cancer

Dosimetric Analysis of Radiation Treatment Plans Based on a Deep Learning Auto Contouring Model for Patients with Localized Prostate Cancer

Automated Clinical Target Volume Delineation Using Deep 3D Neural Networks in Radiation Therapy of Non-small Cell Lung Cancer

Approach and assessment of automated stereotactic radiotherapy planning for early stage non-small-cell lung cancer

Automated plan generation for prostate radiotherapy patients using deep learning and scripted optimization

Understanding and modeling human-AI interaction of artificial intelligence tool in radiation oncology clinic using deep neural network: a feasibility study using three year prospective data

Automation of radiation treatment planning for rectal cancer

Assessment of clinical feasibility:offline adaptive radiotherapy for lung cancer utilizing kV iCBCT and UNet++ based deep learning model

Deep Learning Improved Clinical Target Volume Contouring Quality and Efficiency for Postoperative Radiation Therapy in Non-small Cell Lung Cancer

Technical Note: A feasibility study on deep learning-based radiotherapy dose calculation

An Artificial Intelligence-Based Full-Process Solution for Radiotherapy: A Proof of Concept Study on Rectal Cancer

Artificial Intelligence-Assisted Delineation for Postoperative Radiotherapy in Patients with Lung Cancer: A Prospective, Multi-Center, Cohort Study

Machine learning automated treatment planning for online magnetic resonance guided adaptive radiotherapy of prostate cancer

Automatic Treatment Planning Based on Three-Dimensional Dose Distribution Predicted from Deep Learning Technique.

Artificial Intelligence-Based Automated Treatment Planning of Postmastectomy Volumetric Modulated Arc Radiotherapy

Quantitative Evaluation of a Fully Automated Planning Solution for Prostate-Only and Whole-Pelvic Radiotherapy

Assessing the robustness of artificial intelligence powered planning tools in radiotherapy clinical settings-a phantom simulation approach

Fully automatic volumetric modulated arc therapy planning based on dose prediction combined with an iterative optimization algorithm

A comparative study on automatic treatment planning for online adaptive proton therapy of esophageal cancer: Which combination of deformable registration and deep learning planning tools performs the best?

A patient-specific auto-planning method for MRI-guided adaptive radiotherapy in prostate cancer