Abstract:Abstract Introduction: Precise segmentation of rectal tumors on pre-treatment MRI is critical for in vivo clinical staging and treatment selection. While automated deep learning models can help alleviate laborious manual annotation, these require significant expertise and time commitment. Towards addressing these issues, we present initial results of an integrated human-in-the-loop refinement learning model for semi-automated segmentation of rectal tumors across multiple acquisition planes (axial, coronal) on pre-treatment MRI scans. Methods: This retrospective study accrued baseline MRI scans from rectal cancer patients at four different institutions. A deep learning (DL) nnUNet tumor segmentation model was first trained on both axial plane and coronal plane T2w MRIs from two institutions, with segregated training and internal validation cohorts based on available radiologist annotations. The DL model outputs tumor delineations on both axial and coronal MRI scans in a separate human-in-the-loop (HITL) optimization cohort. Two rounds of HITL refinement learning were then conducted, where in each round model-generated segmentations were refined by two novice radiology readers. Refined annotations were then used to re-optimize the nnUnet model to yield final tumor segmentations. Model-generated segmentations were evaluated before HITL as well as after each round of HITL against “ground truth” radiologist annotations obtained for an external validation cohort, with performance quantified via dice similarity coefficient (DSC) as well as time taken for human annotation of MRIs. Statistical significance was determined via Wilcoxon rank-sum testing. Results: A total of 381 MRI scans from 231 rectal cancer patients were considered. After one round of HITL refinement, DL-based segmentations yielded the best overall performance on the external validation cohort (N=20, two institutions) for both axial (DSC = 0.76) and coronal scans (DSC=0.75). A second round of HITL refinement did not yield significantly different model performance. By comparison, the pre-HITL DL segmentation model yielded significantly worse performance on both axial (DSC=0.60, p=0.0362) and coronal (DSC=0.62, p=0.0186) MRI scans. HITL refinement for rectal tumor annotation was also found to significantly improve reader efficiency by requiring only 18 minutes/scan compared to manual “ground truth” de novo annotations which took up to 38 minutes/scan (p<0.001). Conclusion: Human-in-the-loop deep learning models can help generate accurate rectal tumor segmentations on pre-treatment MRI scans across both axial and coronal acquisition planes. Improvements to model generalizability, model efficacy, and reader efficiency suggest the potential for HITL-based semi-automated segmentation schemes for other medical imaging tasks. Citation Format: Michael Kong, Thomas DeSilvio, Leo Bao, Brennan Flannery, Benjamin N. Parker, Stephen Tang, Gregory O'Connor, Amit Gupta, Emily Steinhagen, Andrei S. Purysko, Eric L. Marderstein, Aaron Carroll, Marka Crittenden, Michael Gough, Kristina Young, Satish E. Viswanath. Multi-plane rectal tumor segmentation on pre-treatment MRI via human-in-the-loop deep learning [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 7386.

Generalizable Transfer Learning of Automated Tumor Segmentation from Cervical Cancers Toward a Universal Model for Uterine Malignancies in Diffusion-Weighted MRI

Deep Learning-Based Automatic Segmentation for Size and Volumetric Measurement of Breast Cancer on Magnetic Resonance Imaging.

Deep Learning for Fully Automated Tumor Segmentation and Extraction of Magnetic Resonance Radiomics Features in Cervical Cancer

Auto-segmentation of Adult-Type Diffuse Gliomas: Comparison of Transfer Learning-Based Convolutional Neural Network Model Vs. Radiologists

Integrating a deep neural network and Transformer architecture for the automatic segmentation and survival prediction in cervical cancer

Fully Automatic Whole-Volume Tumor Segmentation in Cervical Cancer

Automatic Segmentation of Rectal Tumor on Diffusion‐weighted Images by Deep Learning with U‐Net

A Transfer Learning Approach for Automated Segmentation of Prostate Whole Gland and Transition Zone in Diffusion Weighted MRI

Automatic gross tumor volume segmentation with failure detection for safe implementation in locally advanced cervical cancer

A Deep Learning Framework for Automatic Segmentation and Prediction Model Establishment from T2-Weighted MRI in Cervical Cancer Patients Receiving Radiotherapy

Automatic delineation of cervical cancer target volumes in small samples based on multi-decoder and semi-supervised learning and clinical application

Enhancing automatic prediction of clinically significant prostate cancer with deep transfer learning 2.5-dimensional segmentation on bi-parametric magnetic resonance imaging (bp-MRI)

Deep Learning Framework with Multi-Head Dilated Encoders for Enhanced Segmentation of Cervical Cancer on Multiparametric Magnetic Resonance Imaging

Deep Learning Segmentation of Infiltrative and Enhancing Cellular Tumor on Pre- and Posttreatment Multishell Diffusion MRI of Glioblastoma

Transfer Learning from Tumors to Organs at Risk for Cervical Cancer Image Segmentation.

Development of U-Net Breast Density Segmentation Method for Fat-Sat MR Images Using Transfer Learning Based on Non-Fat-Sat Model

DoseTransfer: A Transformer Embedded Model with Transfer Learning for Radiotherapy Dose Prediction of Cervical Cancer

Abstract 7386: Multi-plane rectal tumor segmentation on pre-treatment MRI via human-in-the-loop deep learning

Deep Learning for Longitudinal Gross Tumor Volume Segmentation in MRI-Guided Adaptive Radiotherapy for Head and Neck Cancer

Deep Learning Applications In Automatic Segmentation And Reconstruction In Ct-Based Cervix Brachytherapy

An Adversarial Deep-Learning-Based Model for Cervical Cancer CTV Segmentation With Multicenter Blinded Randomized Controlled Validation