Abstract:Purpose/objective s: Due to manual OAR contouring challenges, various automatic contouring solutions have been introduced. Historically, common clinical auto-segmentation algorithms used were atlas-based, which required maintaining a library of self-made contours. Searching the collection was computationally intensive and could take several minutes to complete. Deep learning approaches have shown significant benefits compared to atlas-based methods in improving segmentation accuracy and efficiency in auto-segmentation algorithms. This work represents the first multi-institutional study to describe and evaluate an AI algorithm for the auto-segmentation of organs at risk (OARs) based on a deep image-to-image network (DI2IN). Materials/methods: The AI-Rad Companion Organs RT (AIRC) algorithm (Siemens Healthineers, Erlangen, Germany) uses a two-step approach for segmentation. In the first step, the target organ region in the optimal input image is extracted using a trained deep reinforcement learning network (DRL), which is then used as input to create the contours in the second step based on DI2IN. The study was initially designed as a prospective single-center evaluation. The automated contours generated by AIRC were evaluated by three experienced board-certified radiation oncologists using a four-point scale where 4 is clinically usable and 1 requires re-contouring. After seeing favorable results in a single-center pilot study, we decided to expand the study to six additional institutions, encompassing eight additional evaluators for a total of 11 physician evaluators across seven institutions. Results: One hundred and fifty-six patients and 1366 contours were prospectively evaluated. The five most commonly contoured organs were the lung (136 contours, average rating = 4.0), spinal cord (106 contours, average rating = 3.1), eye globe (80 contours, average rating = 3.9), lens (77 contours, average rating = 3.9), and optic nerve (75 contours, average rating = 4.0). The average rating per evaluator per contour was 3.6. On average, 124 contours were evaluated by each evaluator. 65% of the contours were rated as 4, and 31% were rated as 3. Only 4% of contours were rated as 1 or 2. Thirty-three organs were evaluated in the study, with 19 structures having a 3.5 or above average rating (ribs, abdominopelvic cavity, skeleton, larynx, lung, aorta, brachial plexus, lens, eye globe, glottis, heart, parotid glands, bladder, kidneys, supraglottic larynx, submandibular glands, esophagus, optic nerve, oral cavity) and the remaining organs having a rating of 3.0 or greater (female breast, proximal femur, seminal vesicles, rectum, sternum, brainstem, prostate, brain, lips, mandible, liver, optic chiasm, spinal cord, spleen). No organ had an average rating below 3. Conclusion: AIRC performed well with greater than 95% of contours accepted by treating physicians with no or minor edits. It supported a fully automated workflow with the potential for time savings and increased standardization with the use of AI-powered algorithms for high-quality OAR contouring.

Deep Learning Algorithm Performance in Contouring Head and Neck Organs at Risk: a Systematic Review and Single-Arm Meta-Analysis

Comprehensive and Clinically Accurate Head and Neck Organs at Risk Delineation Via Stratified Deep Learning: A Large-scale Multi-Institutional Study

Comprehensive and Clinically Accurate Head and Neck Cancer Organs-at-risk Delineation on a Multi-Institutional Study

Comparative Clinical Evaluation of Deep-Learning-Based Algorithms in Auto-Segmentation of Organs-At-Risk for Head and Neck Cancers

Dosimetry Validation Study for Automated Head and Neck Cancer Organs at Risk Segmentation Using Stratified Learning and Neural Architecture Search

Automated Delineation of Head and Neck Organs at Risk Using Synthetic MRI-aided Mask Scoring Regional Convolutional Neural Network

A Deep Learning Based Automatic Segmentation Approach for Anatomical Structures in Intensity Modulation Radiotherapy

Young Oncologists Benefit More Than Experts from Deep Learning-Based Organs-at-risk Contouring Modeling in Nasopharyngeal Carcinoma Radiotherapy: A Multi-Institution Clinical Study Exploring Working Experience and Institute Group Style Factor

Dosimetric impact of contour editing on CT and MRI deep‐learning autosegmentation for brain OARs

Clinically Applicable Deep Learning Framework for Organs at Risk Delineation in CT Images

Systematic review and meta-analysis of deep learning applications in computed tomography lung cancer segmentation

AI Model of Using Stratified Deep Learning to Delineate the Organs at Risk (oars) for Thoracic Radiation Therapy

A multi-modal vision-language pipeline strategy for contour quality assurance and adaptive optimization

Evaluation of a deep image-to-image network (DI2IN) auto-segmentation algorithm across a network of cancer centers

Deep Learning Improved Clinical Target Volume Contouring Quality and Efficiency for Postoperative Radiation Therapy in Non-small Cell Lung Cancer

Investigation on performance of multiple AI-based auto-contouring systems in organs at risks (OARs) delineation

Deep-learning magnetic resonance imaging-based automatic segmentation for organs-at-risk in the brain: Accuracy and impact on dose distribution

Artificial Intelligence-Assisted Delineation for Postoperative Radiotherapy in Patients with Lung Cancer: A Prospective, Multi-Center, Cohort Study

Evaluation of Intra-Observer Variation for Deep Learning Generated Head and Neck Organs at Risk Segmentation

Head-and-neck Organs-at-risk Auto-Delineation Using Dual Pyramid Networks for CBCT-guided Adaptive Radiotherapy

Machine Learning-Based Quality Assurance for Automatic Segmentation of Head-and-Neck Organs-at-Risk in Radiotherapy