Abstract:Abstract Introduction: Precise segmentation of rectal tumors on pre-treatment MRI is critical for in vivo clinical staging and treatment selection. While automated deep learning models can help alleviate laborious manual annotation, these require significant expertise and time commitment. Towards addressing these issues, we present initial results of an integrated human-in-the-loop refinement learning model for semi-automated segmentation of rectal tumors across multiple acquisition planes (axial, coronal) on pre-treatment MRI scans. Methods: This retrospective study accrued baseline MRI scans from rectal cancer patients at four different institutions. A deep learning (DL) nnUNet tumor segmentation model was first trained on both axial plane and coronal plane T2w MRIs from two institutions, with segregated training and internal validation cohorts based on available radiologist annotations. The DL model outputs tumor delineations on both axial and coronal MRI scans in a separate human-in-the-loop (HITL) optimization cohort. Two rounds of HITL refinement learning were then conducted, where in each round model-generated segmentations were refined by two novice radiology readers. Refined annotations were then used to re-optimize the nnUnet model to yield final tumor segmentations. Model-generated segmentations were evaluated before HITL as well as after each round of HITL against “ground truth” radiologist annotations obtained for an external validation cohort, with performance quantified via dice similarity coefficient (DSC) as well as time taken for human annotation of MRIs. Statistical significance was determined via Wilcoxon rank-sum testing. Results: A total of 381 MRI scans from 231 rectal cancer patients were considered. After one round of HITL refinement, DL-based segmentations yielded the best overall performance on the external validation cohort (N=20, two institutions) for both axial (DSC = 0.76) and coronal scans (DSC=0.75). A second round of HITL refinement did not yield significantly different model performance. By comparison, the pre-HITL DL segmentation model yielded significantly worse performance on both axial (DSC=0.60, p=0.0362) and coronal (DSC=0.62, p=0.0186) MRI scans. HITL refinement for rectal tumor annotation was also found to significantly improve reader efficiency by requiring only 18 minutes/scan compared to manual “ground truth” de novo annotations which took up to 38 minutes/scan (p<0.001). Conclusion: Human-in-the-loop deep learning models can help generate accurate rectal tumor segmentations on pre-treatment MRI scans across both axial and coronal acquisition planes. Improvements to model generalizability, model efficacy, and reader efficiency suggest the potential for HITL-based semi-automated segmentation schemes for other medical imaging tasks. Citation Format: Michael Kong, Thomas DeSilvio, Leo Bao, Brennan Flannery, Benjamin N. Parker, Stephen Tang, Gregory O'Connor, Amit Gupta, Emily Steinhagen, Andrei S. Purysko, Eric L. Marderstein, Aaron Carroll, Marka Crittenden, Michael Gough, Kristina Young, Satish E. Viswanath. Multi-plane rectal tumor segmentation on pre-treatment MRI via human-in-the-loop deep learning [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 7386.

Abstract 5427: Improving non-small cell lung cancer segmentation on a challenging dataset

Abstract 887: Fast, interactive, AI-assisted 3D lung tumour segmentation

Abstract 7386: Multi-plane rectal tumor segmentation on pre-treatment MRI via human-in-the-loop deep learning

Abstract 3048: Deep Learning to Predict Survival Prognosis for Patients with Non-Small Cell Lung Cancer Using Images and Clinical Data

Leveraging immuno-fluorescence data to reduce pathologist annotation requirements in lung tumor segmentation using deep learning

Abstract 2595: Accelerated and precise tumor segmentation in NSCLC: A comparative analysis of automated ClickSeg and manual annotation for radiomics

Impact of localized fine tuning in the performance of segmentation and classification of lung nodules from computed tomography scans using deep learning

Comparing the performance of a deep learning-based lung gross tumour volume segmentation algorithm before and after transfer learning in a new hospital

Clinical evaluation of deep learning-based automatic clinical target volume segmentation: a single-institution multi-site tumor experience

An investigation of CNN models for differentiating malignant from benign lesions using small pathologically proven datasets

Abstract 4916: Enhancing multi-organ frozen section cancer discrimination model by sharing cancer discrimination and organ classification task

Towards radiologist-level cancer risk assessment in CT lung screening using deep learning

Abstract 6189: Deep-learning model trained on multiplex immunofluorescence-stained tissue samples predicts the survival of patients with non-small cell lung cancer better than PD-L1 TPS alone

Comprehensive framework for evaluation of deep neural networks in detection and quantification of lymphoma from PET/CT images: clinical insights, pitfalls, and observer agreement analyses

A deep learning‐based framework (Co‐ReTr) for auto‐segmentation of non‐small cell‐lung cancer in computed tomography images

Automated Lung Cancer Segmentation Using a Dual-Modality Deep Learning Network with PET and CT Images

An Adversarial Deep-Learning-Based Model for Cervical Cancer CTV Segmentation With Multicenter Blinded Randomized Controlled Validation

Topological structure and global features enhanced graph reasoning model for non-small cell lung cancer segmentation from CT

Improving ovarian cancer segmentation accuracy with transformers through AI-guided labeling

Cross-modality (CT-MRI) prior augmented deep learning for robust lung tumor segmentation from small MR datasets

Abstract 2310: Integrating real-world histopathological and clinicogenomic data from 1799 lung cancer patients by applying unsupervised deep learning