Abstract:Purpose: Personalized interpretation of medical images is critical for optimum patient care, but current tools available to physicians to perform quantitative analysis of patient's medical images in real time are significantly limited. In this work, we describe a novel platform within PACS for volumetric analysis of images and thus development of large expert annotated datasets in parallel with radiologist performing the reading that are critically needed for development of clinically meaningful AI algorithms. Specifically, we implemented a deep learning-based algorithm for automated brain tumor segmentation and radiomics extraction, and embedded it into PACS to accelerate a supervised, end-to- end workflow for image annotation and radiomic feature extraction. Materials and methods: An algorithm was trained to segment whole primary brain tumors on FLAIR images from multi-institutional glioma BraTS 2021 dataset. Algorithm was validated using internal dataset from Yale New Haven Health (YHHH) and compared (by Dice similarity coefficient [DSC]) to radiologist manual segmentation. A UNETR deep-learning was embedded into Visage 7 (Visage Imaging, Inc., San Diego, CA, United States) diagnostic workstation. The automatically segmented brain tumor was pliable for manual modification. PyRadiomics (Harvard Medical School, Boston, MA) was natively embedded into Visage 7 for feature extraction from the brain tumor segmentations. Results: UNETR brain tumor segmentation took on average 4 s and the median DSC was 86%, which is similar to published literature but lower than the RSNA ASNR MICCAI BRATS challenge 2021. Finally, extraction of 106 radiomic features within PACS took on average 5.8 ± 0.01 s. The extracted radiomic features did not vary over time of extraction or whether they were extracted within PACS or outside of PACS. The ability to perform segmentation and feature extraction before radiologist opens the study was made available in the workflow. Opening the study in PACS, allows the radiologists to verify the segmentation and thus annotate the study. Conclusion: Integration of image processing algorithms for tumor auto-segmentation and feature extraction into PACS allows curation of large datasets of annotated medical images and can accelerate translation of research into development of personalized medicine applications in the clinic. The ability to use familiar clinical tools to revise the AI segmentations and natively embedding the segmentation and radiomic feature extraction tools on the diagnostic workstation accelerates the process to generate ground-truth data.

Agnostic multimodal brain anomalies detection using a novel single-structured framework for better patient diagnosis and therapeutic planning in clinical oncology

Smart Identification of Topographically Variant Anomalies in Brain Magnetic Resonance Imaging Using a Fish School-Based Fuzzy Clustering Approach

Modified Artificial Bee Colony Algorithm-Based Strategy for Brain Tumor Segmentation

Robust Brain Tumor Detection and Classification via Multi-Technique Image Analysis

Ensemble 3D CNN and U-Net-based brain tumour classification with MKKMC segmentation

Smart system for identifying the various pathologies in MR brain image using Monkey Search based Interval Type-II Fuzzy C-Means technique

Optimized Brain Tumor Detection: A Dual-Module Approach for MRI Image Enhancement and Tumor Classification

An Efficient Brain Tumor Segmentation Method Based on Adaptive Moving Self-Organizing Map and Fuzzy K-Mean Clustering

Diversified AI Techniques for Augmenting Brain Tumor Diagnosis

Multilayer Stacked Probabilistic Belief Network-Based Brain Tumor Segmentation and Classification

Brain Tumor Detection and Categorization with Segmentation of Improved Unsupervised Clustering Approach and Machine Learning Classifier

A Novel Framework for Multimodal Brain Tumor Detection with Scarce Labels

Optimized Interpretable Generalized Additive Neural Network-based Human Brain Diagnosis using Medical Imaging

Advancing multi-categorization and segmentation in brain tumors using novel efficient deep learning approaches

MRI brain tumor detection using optimal possibilistic fuzzy C-means clustering algorithm and adaptive k-nearest neighbor classifier

An improved framework for brain tumor analysis using MRI based on YOLOv2 and convolutional neural network

A computer-aided diagnosis system for brain tumors in magnetic resonance imaging (MRI)

Multimodal Brain Tumor Classification Using Deep Learning and Robust Feature Selection: A Machine Learning Application for Radiologists

Refining neural network algorithms for accurate brain tumor classification in MRI imagery

Multi class robust brain tumor with hybrid classification using DTA algorithm

Clinical implementation of artificial intelligence in neuroradiology with development of a novel workflow-efficient picture archiving and communication system-based automated brain tumor segmentation and radiomic feature extraction