Abstract:Purpose: Personalized interpretation of medical images is critical for optimum patient care, but current tools available to physicians to perform quantitative analysis of patient's medical images in real time are significantly limited. In this work, we describe a novel platform within PACS for volumetric analysis of images and thus development of large expert annotated datasets in parallel with radiologist performing the reading that are critically needed for development of clinically meaningful AI algorithms. Specifically, we implemented a deep learning-based algorithm for automated brain tumor segmentation and radiomics extraction, and embedded it into PACS to accelerate a supervised, end-to- end workflow for image annotation and radiomic feature extraction. Materials and methods: An algorithm was trained to segment whole primary brain tumors on FLAIR images from multi-institutional glioma BraTS 2021 dataset. Algorithm was validated using internal dataset from Yale New Haven Health (YHHH) and compared (by Dice similarity coefficient [DSC]) to radiologist manual segmentation. A UNETR deep-learning was embedded into Visage 7 (Visage Imaging, Inc., San Diego, CA, United States) diagnostic workstation. The automatically segmented brain tumor was pliable for manual modification. PyRadiomics (Harvard Medical School, Boston, MA) was natively embedded into Visage 7 for feature extraction from the brain tumor segmentations. Results: UNETR brain tumor segmentation took on average 4 s and the median DSC was 86%, which is similar to published literature but lower than the RSNA ASNR MICCAI BRATS challenge 2021. Finally, extraction of 106 radiomic features within PACS took on average 5.8 ± 0.01 s. The extracted radiomic features did not vary over time of extraction or whether they were extracted within PACS or outside of PACS. The ability to perform segmentation and feature extraction before radiologist opens the study was made available in the workflow. Opening the study in PACS, allows the radiologists to verify the segmentation and thus annotate the study. Conclusion: Integration of image processing algorithms for tumor auto-segmentation and feature extraction into PACS allows curation of large datasets of annotated medical images and can accelerate translation of research into development of personalized medicine applications in the clinic. The ability to use familiar clinical tools to revise the AI segmentations and natively embedding the segmentation and radiomic feature extraction tools on the diagnostic workstation accelerates the process to generate ground-truth data.

Breaking Medical Data Sharing Boundaries by Employing Artificial Radiographs

Breaking boundaries in radiology: redefining AI diagnostics via raw data ahead of reconstruction

Overcoming barriers to data sharing with medical image generation: a comprehensive evaluation

Generating Synthetic Data for Medical Imaging

Synthetic Medical Imaging Generation with Generative Adversarial Networks For Plain Radiographs

Synthetic Data in Radiological Imaging: Current State and Future Outlook

Synthetic data accelerates the development of generalizable learning-based algorithms for X-ray image analysis

Generation of Anonymous Chest Radiographs Using Latent Diffusion Models for Training Thoracic Abnormality Classification Systems

[Artificial Intelligence in radiology : What can be expected in the next few years?]

Workflow Integration of Research AI Tools into a Hospital Radiology Rapid Prototyping Environment

Radiomics: Images Are More than Pictures, They Are Data

End-to-end reproducible AI pipelines in radiology using the cloud

Advanced image generation for cancer using diffusion models

Artificial intelligence in diagnostic and interventional radiology: Where are we now?

Radiomics and artificial intelligence in breast imaging: a survey

Practical Applications of Advanced Cloud Services and Generative AI Systems in Medical Image Analysis

Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks

Clinical implementation of artificial intelligence in neuroradiology with development of a novel workflow-efficient picture archiving and communication system-based automated brain tumor segmentation and radiomic feature extraction

Addressing the Generalizability of AI in Radiology Using a Novel Data Augmentation Framework with Synthetic Patient Image Data: Proof-of-Concept and External Validation for Classification Tasks in Multiple Sclerosis

Analyzing Racial Differences in Imaging Joint Replacement Registries Using Generative Artificial Intelligence: Advancing Orthopaedic Data Equity

How AI May Transform Musculoskeletal Imaging