Abstract:This IRB-approved study evaluated the quality of contours auto-generated by two deep learning (DL) contouring algorithms for organs-at-risk (OAR) volumes in head and neck cancers. Eleven consecutive head and neck (HandN) patients treated by Tomotherapy were selected for evaluation. Dose prescriptions ranged from 60-70Gy in 30-35 fractions. Each patient had three sets of OAR volumes generated, one clinically used and drawn by humans (physician and dosimetrist) and two auto-generated with DL contouring solutions, trained using convolutional neural network algorithms in large external datasets. The two DL models used for comparison were a HandN model (DLCExpert, Mirada Medical, Oxford, UK) and a Ua-Net model (DeepVoxel Inc, Irvine, CA). Using human-generated volumes as the ground truth, we evaluated the performance of these two models using 3 spatial overlap based metrics (Dice coefficient, Jaccard index(JAC) and True positive rate sensitivity(TPR)), 2 surface distance metrics (95% Hausdorff distance(HD) and average distance(AD)), and 1 volume matrix (volume similarity index(VS)). Seventeen common OAR structures were evaluated including brachial plexus, brainstem, esophagus, eyes, larynx, lenses, mandible, optical nerves and chiasm, oral cavity, parotids, pharyngeal constrictors (PC), submandibular glands (SMGs), spinal cord and trachea. Both DL models offered a feasible solution to delineate structures from CT images. The Mirada model had only 10 common organs for comparison. As shown in Table 1, both models produced comparable results while the DeepVoxel matched human contour better in most OARs. Different image segmentation metrics showed consistent results. DL contours were most similar to human generated contours for brainstem, esophagus, eyes, larynx, lens, mandible, parotids, SMGs, spinal cord and trachea where Dice, JAC, TPR, HD, AD, VS in DeepVoxel model were 0.80(range 0.68-0.91), 0.68(0.53-0.84), 0.78(0.67-0.94), 5.1(2.1-11.4), 1.9mm(1.0-3.9) and 0.88(0.76-0.97) respectively. Brachial plexus, optical nerves and chiasm, oral cavity and PC still needed improvement, partly due to the differences in organ definition. For example, teeth were included in DeepVoxel's oral cavity but not in Mirada and human-generated contours. Those discrepancies will be corrected in our next DL model. DL auto-generated contours from two different models showed high similarity to human generated ones for a variety of OARs in the head and neck, with potential to be adopted in routine clinical practice. In contrast with atlas-based or active shape model approaches, DL models are capable of producing contours with a high level of clinical acceptance and show promise to be indistinguishable from human generated ones. Table1: Quality of DL generated contours evaluated by various image segmentation metrics using human generated contours as the ground truth. All metrics showed consistent results across the organs. (Truncated)

Interobserver variation in organs at risk contouring in head and neck cancer according to the DAHANCA guidelines

Comprehensive and Clinically Accurate Head and Neck Cancer Organs-at-risk Delineation on a Multi-Institutional Study

Comprehensive and Clinically Accurate Head and Neck Organs at Risk Delineation Via Stratified Deep Learning: A Large-scale Multi-Institutional Study

Volumetric and Dosimetric Variations in Radiation Treatment Planning Using CT Images Based on Different Reconstructed Field-of-view

vOARiability: Interobserver and intermodality variability analysis in OAR contouring from head and neck CT and MR images

Contouring of emerging organs-at-risk (OARS) of the female pelvis and interobserver variability: A study by the Italian association of radiotherapy and clinical oncology (AIRO)

The emerging role of radiation therapists in the contouring of organs at risk in radiotherapy: analysis of inter-observer variability with radiation oncologists for the chest and upper abdomen

Automatic Segmentation of Organs at Risk for Nasopharyngeal Carcinoma with Smart Segmentation and MIM Atlas

Interobserver variability in target volume delineation in definitive radiotherapy for thoracic esophageal cancer: a multi-center study from China

Investigation on performance of multiple AI-based auto-contouring systems in organs at risks (OARs) delineation

Multi-subject atlas-based auto-segmentation reduces interobserver variation and improves dosimetric parameter consistency for organs at risk in nasopharyngeal carcinoma: A multi-institution clinical study

Knowledge-based quality assurance of a comprehensive set of organ at risk contours for head and neck radiotherapy

Divergent Clinical Equivalence Findings from DVH and NTCP Metrics for Alternative OAR Delineations with Increasing Setup Variability in Head-and-Neck Radiotherapy

Inter-observer variation in gross tumour volume delineation of oesophageal cancer on MR, CT and PET/CT

Inter- and Intrarater Reliability and Agreement Among Danish Head and Neck Pathologists Assessing Extranodal Extension in Lymph Node Metastases from Oropharyngeal Squamous Cell Carcinomas

Artificial intelligence-generated targets and inter-observer variation in online adaptive radiotherapy of bladder cancer

Comparative Clinical Evaluation of Deep-Learning-Based Algorithms in Auto-Segmentation of Organs-At-Risk for Head and Neck Cancers

Heart atlas for retrospective cardiac dosimetry: a multi-institutional study on interobserver contouring variations and their dosimetric impact

P29.03 Thoracic Organs at Risk (OARs) Contouring Variations and Consensus in Radiation Therapy for Non-Small Cell Lung Cancer

Interobserver variation in tumor delineation of liver metastases using Magnetic Resonance Imaging

Multi-centre evaluation of variation in cumulative dose assessment in reirradiation scenarios