Abstract:Abstract The purpose of this study was to build a software tool to test the feasibility of machine-learning (ML) assisted analysis of in vivo 3D images in oncology research studies. Conventionally, in vivo image segmentations are performed by hand, and are a bottleneck for data analysis, taking time and introducing both inter and intra-user variability. Recently, advances in ML have shown promise in accelerating similar clinical image analysis tasks. Our objective was to work toward making this technology accessible to preclinical cancer researchers. 3D image data across multiple mouse models, organs, modalities, and imaging systems were used. ML segmentation models were trained with user-defined masks on images of mouse bladders (N=134), kidneys (N=131), livers (N=65), and lungs (N=26) from either ultrasound or micro-computed tomography (uCT) scanners. Models were developed using PyTorch/MONAI, hosted in an AWS cloud environment, and served to users via a custom extension for 3D Slicer (www.slicer.org). Performance was assessed as the difference between the human vs. ML organ volumes on a test set unseen by the models during training. Lastly, the functionality of on-the-fly segmentation improvement tools through iterative user feedback was assessed. Results demonstrated that generating segmentations with the prototype ML software took 2-6 seconds per image running on a modern GPU (NVIDIA RTX 3090), compared to 3-7 minutes if performed manually by an expert user (>30x improvement). The Dice scores between the ML generated and human segmentations ranged from 0.81 (liver ultrasound) to 0.84 (bladder ultrasound) but could be improved using ML-based on-the-fly mask improvement tools. Using data from this pilot study, we estimate that the threshold to achieve 90% accuracy on first-pass segmentations is between 200-300 training images, depending on the variance observed in the image data. In summary, the prototype software was able to decrease the manual analysis time across a variety of preclinical in vivo image modalities, which is broadly relevant to preclinical oncology research. The next steps for this project will be to extend the platform to additional orthotopic tumor models (e.g. pancreatic, liver, prostate, etc.) and deploy to the field to enable access to this toolset by preclinical imaging scientists across the world. Citation Format: Adam M. Aji, Thomas M. Kierski, Juan D. Rojas, Hannah Morilak, Olivia J. Kelada, Kathryn H. Gessner, Andrew S. Gdowski, Lucia Kim, William Y. Kim, Ryan C. Gessner, Tomek J. Czernuszewicz. A prototype for a machine-learning assisted image analysis tool for preclinical in vivo studies [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 2336.

PAHPhysRAD: A Digital Imaging and Communications in Medicine Research Tool for Segmentation and Radiomic Feature Extraction

Clinical implementation of artificial intelligence in neuroradiology with development of a novel workflow-efficient picture archiving and communication system-based automated brain tumor segmentation and radiomic feature extraction

Innv-02. Brainmets: A Clinician-Friendly Software To Manually Segment Brain Metastases And Detect Primary Tumor Origin Using Deep Learning

Computational Radiomics System to Decode the Radiographic Phenotype.

Assessing Patient Health Dynamics by Comparative CT Analysis: An Automatic Approach to Organ and Body Feature Evaluation

PyRadGUI: A GUI based radiomics extractor software

Delta radiomics analysis of Magnetic Resonance guided radiotherapy imaging data can enable treatment response prediction in pancreatic cancer

Abstract 2336: A prototype for a machine-learning assisted image analysis tool for preclinical in vivo studies

MPRAD: A Multiparametric Radiomics Framework

A physics-guided modular deep-learning based automated framework for tumor segmentation in PET

A web-based brain metastases segmentation and labeling platform for stereotactic radiosurgery

A Deep Learning Based Automatic Segmentation Approach for Anatomical Structures in Intensity Modulation Radiotherapy

PCa-RadHop: A Transparent and Lightweight Feed-forward Method for Clinically Significant Prostate Cancer Segmentation

A new machine learning based user-friendly software platform for automatic radiomics modeling and analysis

Multitask 3D CBCT‐to‐CT translation and organs‐at‐risk segmentation using physics‐based data augmentation

Nimg-54. Automated Imaging Response Evaluation System (Aires) For Neuro-Oncology: Prototype Software Tool For Determining Standardized Radiographic Response Assessment For Glioblastoma Clinical Trials

Imager-4D: New Software for Viewing Dynamic PET Scans and Extracting Radiomic Parameters from PET Data

Automatic Contouring Analysis of Lung Cancer for Radiotherapy Radiation Planning from Ct-Simulator Image

Technical Development and In Silico Implementation of SyntheticMR in Head and Neck Adaptive Radiation Therapy: A Prospective R-IDEAL Stage 0/1 Technology Development Report

Implementation of a Semi-automated Post-processing System for Parametric MRI Mapping of Human Breast Cancer

A Physics-Guided Modular Deep-Learning Based Automated Framework for Tumor Segmentation in PET Images