Abstract:Purpose/objective s: Due to manual OAR contouring challenges, various automatic contouring solutions have been introduced. Historically, common clinical auto-segmentation algorithms used were atlas-based, which required maintaining a library of self-made contours. Searching the collection was computationally intensive and could take several minutes to complete. Deep learning approaches have shown significant benefits compared to atlas-based methods in improving segmentation accuracy and efficiency in auto-segmentation algorithms. This work represents the first multi-institutional study to describe and evaluate an AI algorithm for the auto-segmentation of organs at risk (OARs) based on a deep image-to-image network (DI2IN). Materials/methods: The AI-Rad Companion Organs RT (AIRC) algorithm (Siemens Healthineers, Erlangen, Germany) uses a two-step approach for segmentation. In the first step, the target organ region in the optimal input image is extracted using a trained deep reinforcement learning network (DRL), which is then used as input to create the contours in the second step based on DI2IN. The study was initially designed as a prospective single-center evaluation. The automated contours generated by AIRC were evaluated by three experienced board-certified radiation oncologists using a four-point scale where 4 is clinically usable and 1 requires re-contouring. After seeing favorable results in a single-center pilot study, we decided to expand the study to six additional institutions, encompassing eight additional evaluators for a total of 11 physician evaluators across seven institutions. Results: One hundred and fifty-six patients and 1366 contours were prospectively evaluated. The five most commonly contoured organs were the lung (136 contours, average rating = 4.0), spinal cord (106 contours, average rating = 3.1), eye globe (80 contours, average rating = 3.9), lens (77 contours, average rating = 3.9), and optic nerve (75 contours, average rating = 4.0). The average rating per evaluator per contour was 3.6. On average, 124 contours were evaluated by each evaluator. 65% of the contours were rated as 4, and 31% were rated as 3. Only 4% of contours were rated as 1 or 2. Thirty-three organs were evaluated in the study, with 19 structures having a 3.5 or above average rating (ribs, abdominopelvic cavity, skeleton, larynx, lung, aorta, brachial plexus, lens, eye globe, glottis, heart, parotid glands, bladder, kidneys, supraglottic larynx, submandibular glands, esophagus, optic nerve, oral cavity) and the remaining organs having a rating of 3.0 or greater (female breast, proximal femur, seminal vesicles, rectum, sternum, brainstem, prostate, brain, lips, mandible, liver, optic chiasm, spinal cord, spleen). No organ had an average rating below 3. Conclusion: AIRC performed well with greater than 95% of contours accepted by treating physicians with no or minor edits. It supported a fully automated workflow with the potential for time savings and increased standardization with the use of AI-powered algorithms for high-quality OAR contouring.

Deep learning for contour quality assurance for RTOG 0933: In-silico evaluation

Comparative Clinical Evaluation of Deep-Learning-Based Algorithms in Auto-Segmentation of Organs-At-Risk for Head and Neck Cancers

Validation of a Deep Learning Model for Traumatic Brain Injury Detection and NIRIS Grading on Non-Contrast CT: a Multi-Reader Study with Promising Results and Opportunities for Improvement.

Deep learning-based automatic contour quality assurance for auto-segmented abdominal MR-Linac contours

Deep learning-based automatic delineation of the hippocampus by MRI: geometric and dosimetric evaluation

Toward Clinically Trustworthy Deep Learning: Applying Conformal Prediction to Intracranial Hemorrhage Detection

Auto-segmentation of Adult-Type Diffuse Gliomas: Comparison of Transfer Learning-Based Convolutional Neural Network Model Vs. Radiologists

Deep Learning Segmentation and Reconstruction for CT of Chronic Total Coronary Occlusion

Dosimetric impact of contour editing on CT and MRI deep‐learning autosegmentation for brain OARs

Comprehensive Clinical Usability-oriented Contour Quality Evaluation for Deep learning Auto-segmentation: Combining Multiple Quantitative Metrics through Machine Learning

Automatic segmentation of Organs at Risk in Head and Neck cancer patients from CT and MRI scans

A multi-modal vision-language pipeline strategy for contour quality assurance and adaptive optimization

A deep image-to-image network organ segmentation algorithm for radiation treatment planning: principles and evaluation

Evaluating the relationship between magnetic resonance image quality metrics and deep learning-based segmentation accuracy of brain tumors

Handling missing MRI sequences in deep learning segmentation of brain metastases: a multicenter study

Deep Learning Algorithm Performance in Contouring Head and Neck Organs at Risk: a Systematic Review and Single-Arm Meta-Analysis

Deep Learning for Fully Automated Segmentation and Volumetry of Couinaud Liver Segments and Future Liver Remnants Shown with CT Before Major Hepatectomy: a Validation Study of a Predictive Model

Evaluation of a deep image-to-image network (DI2IN) auto-segmentation algorithm across a network of cancer centers

Patient-specific daily updated deep learning auto-segmentation for MRI-guided adaptive radiotherapy

A Proof-of-Concept Study of Artificial Intelligence Assisted Contour Revision

Deep neural network ensemble for on-the-fly quality control-driven segmentation of cardiac MRI T1 mapping