Abstract:Background: Artificial intelligence (AI) based radiotherapy treatment planning tools have gained interest in automating the treatment planning process. It is essential to understand their overall robustness in various clinical scenarios. This is an existing gap between many AI based tools and their actual clinical deployment. This study works to fill the gap for AI based treatment planning by investigating a clinical robustness assessment (CRA) tool for the AI based planning methods using a phantom simulation approach. Methods: A cylindrical phantom was created in the treatment planning system (TPS) with the axial dimension of 30 cm by 18 cm. Key structures involved in pancreas stereotactic body radiation therapy (SBRT) including PTV25, PTV33, C-Loop, stomach, bowel and liver were created within the phantom. Several simulation scenarios were created to mimic multiple scenarios of anatomical changes, including displacement, expansion, rotation and combination of three. The goal of treatment planning was to deliver 25 Gy to PTV25 and 33 Gy to PTV33 in 5 fractions in simultaneous integral boost (SIB) manner while limiting luminal organ-at-risk (OAR) max dose to be under 29 Gy. A previously developed deep learning based AI treatment planning tool for pancreas SBRT was identified as the validation object. For each scenario, the anatomy information was fed into the AI tool and the final fluence map associated to the plan was generated, which was subsequently sent to TPS for leaf sequencing and dose calculation. The final auto plan's quality was analyzed against the treatment planning constraint. The final plans' quality was further analyzed to evaluate potential correlation with anatomical changes using the Manhattan plot. Results: A total of 32 scenarios were simulated in this study. For all scenarios, the mean PTV25 V25Gy of the AI based auto plans was 96.7% while mean PTV33 V33Gy was 82.2%. Large variation (16.3%) in PTV33 V33Gy was observed due to anatomical variations, a.k.a. proximity of luminal structure to PTV33. Mean max dose was 28.55, 27.68 and 24.63 Gy for C-Loop, bowel and stomach, respectively. Using D0.03cc as max dose surrogate, the value was 28.03, 27.12 and 23.84 Gy for C-Loop, bowel and stomach, respectively. Max dose constraint of 29 Gy was achieved for 81.3% cases for C-Loop and stomach, and 78.1% for bowel. Using D0.03cc as max dose surrogate, the passing rate was 90.6% for C-Loop, and 81.3% for bowel and stomach. Manhattan plot revealed high correlation between the OAR over dose and the minimal distance between the PTV33 and OAR. Conclusions: The results showed promising robustness of the pancreas SBRT AI tool, providing important evidence of its readiness for clinical implementation. The established workflow could guide the process of assuring clinical readiness of future AI based treatment planning tools.

Artificial Intelligence-guided Prediction of Dental Dosesprior Toplanning of Head and Neck Radiotherapy: Technical Development and Pilot Study of Feasibility

App-based Interactive AI Guiding Physicians in Real Time to Avoid Radiation Treatment Complications

Artificial intelligence to predict outcomes of head and neck radiotherapy

Understanding and modeling human-AI interaction of artificial intelligence tool in radiation oncology clinic using deep neural network: a feasibility study using three year prospective data

Assessing the robustness of artificial intelligence powered planning tools in radiotherapy clinical settings-a phantom simulation approach

Dose-Distribution-Driven PET Image-Based Outcome Prediction (DDD-PIOP): A Deep Learning Study for Oropharyngeal Cancer IMRT Application

Evaluation of deep learning based dose prediction in head and neck cancer patients using two different types of input contours

Deep Learning-Based Dose Prediction for Automated, Individualized Quality Assurance of Head and Neck Radiation Therapy Plans

Proof‐of‐concept study of artificial intelligence‐assisted review of CBCT image guidance

Assessing population‐based to personalized planning strategies for head and neck adaptive radiotherapy

In silico evaluation and feasibility of near margin-less head and neck daily adaptive radiotherapy

A Preliminary Simulation Study of Dose-Guided Adaptive Radiotherapy Based on Halcyon MV Cone-Beam CT Images With Retrospective Data From a Phase II Clinical Trial

SU-HH-AUD C-03: Machine Learning Tools for Predicting Clinical Complications in a Multi-Plan IMRT Framework

Voxel-Based Dose Prediction with Multi-Patient Atlas Selection for Automated Radiotherapy Treatment Planning

Prediction of Need for Proton Adaptive Plan in Head and Neck Cancers Using Clinical and Radiographic Features

Precision radiotherapy via information integration of expert human knowledge and AI recommendation to optimize clinical decision making

Clinical commissioning and introduction of an in‐house artificial intelligence (AI) platform for automated head and neck intensity modulated radiation therapy (IMRT) treatment planning

Deep learning-based dose prediction for magnetic resonance-guided prostate radiotherapy

Dose prediction via distance-guided deep learning: Initial development for nasopharyngeal carcinoma radiotherapy

Artificial Intelligence-Assisted Delineation for Postoperative Radiotherapy in Patients with Lung Cancer: A Prospective, Multi-Center, Cohort Study