Abstract:Purpose: Personalized interpretation of medical images is critical for optimum patient care, but current tools available to physicians to perform quantitative analysis of patient's medical images in real time are significantly limited. In this work, we describe a novel platform within PACS for volumetric analysis of images and thus development of large expert annotated datasets in parallel with radiologist performing the reading that are critically needed for development of clinically meaningful AI algorithms. Specifically, we implemented a deep learning-based algorithm for automated brain tumor segmentation and radiomics extraction, and embedded it into PACS to accelerate a supervised, end-to- end workflow for image annotation and radiomic feature extraction. Materials and methods: An algorithm was trained to segment whole primary brain tumors on FLAIR images from multi-institutional glioma BraTS 2021 dataset. Algorithm was validated using internal dataset from Yale New Haven Health (YHHH) and compared (by Dice similarity coefficient [DSC]) to radiologist manual segmentation. A UNETR deep-learning was embedded into Visage 7 (Visage Imaging, Inc., San Diego, CA, United States) diagnostic workstation. The automatically segmented brain tumor was pliable for manual modification. PyRadiomics (Harvard Medical School, Boston, MA) was natively embedded into Visage 7 for feature extraction from the brain tumor segmentations. Results: UNETR brain tumor segmentation took on average 4 s and the median DSC was 86%, which is similar to published literature but lower than the RSNA ASNR MICCAI BRATS challenge 2021. Finally, extraction of 106 radiomic features within PACS took on average 5.8 ± 0.01 s. The extracted radiomic features did not vary over time of extraction or whether they were extracted within PACS or outside of PACS. The ability to perform segmentation and feature extraction before radiologist opens the study was made available in the workflow. Opening the study in PACS, allows the radiologists to verify the segmentation and thus annotate the study. Conclusion: Integration of image processing algorithms for tumor auto-segmentation and feature extraction into PACS allows curation of large datasets of annotated medical images and can accelerate translation of research into development of personalized medicine applications in the clinic. The ability to use familiar clinical tools to revise the AI segmentations and natively embedding the segmentation and radiomic feature extraction tools on the diagnostic workstation accelerates the process to generate ground-truth data.

PyRadGUI: A GUI based radiomics extractor software

Computational Radiomics System to Decode the Radiographic Phenotype.

PAHPhysRAD: A Digital Imaging and Communications in Medicine Research Tool for Segmentation and Radiomic Feature Extraction

Radiomics in RayPlus: a Web-Based Tool for Texture Analysis in Medical Images

Precision-medicine-toolbox: An open-source python package for facilitation of quantitative medical imaging and radiomics analysis

Simple Python Module for Conversions Between DICOM Images and Radiation Therapy Structures, Masks, and Prediction Arrays

A Radiogenomics Pipeline for Lung Nodules Segmentation and Prediction of EGFR Mutation Status from CT Scans

Radiomics: the process and the challenges

MuSA: a graphical user interface for multi-OMICs data integration in radiogenomic studies

234 Predictive Radiomics in Glioblastoma: A Machine Learning Approach for Personalized Survival Outcomes and a Novel Web Application

Radtools: R utilities for convenient extraction of medical image metadata

Radiomics in Oncology: A Practical Guide

Open-radiomics: A Collection of Standardized Datasets and a Technical Protocol for Reproducible Radiomics Machine Learning Pipelines

Clinical implementation of artificial intelligence in neuroradiology with development of a novel workflow-efficient picture archiving and communication system-based automated brain tumor segmentation and radiomic feature extraction

TRU-IMP: techniques for reliable use of images in medical physics; a graphical user interface to analyze and compare segmentations in nuclear medicine

Radiomics: a new application from established techniques

RT-utils: A Minimal Python Library for RT-struct Manipulation

FeAture Explorer (FAE): A tool for developing and comparing radiomics models

Introduction to Radiomics

RadGazeGen: Radiomics and Gaze-guided Medical Image Generation using Diffusion Models

129Xe Image Processing Pipeline: An open‐source, graphical user interface application for the analysis of hyperpolarized 129Xe MRI