Abstract:Introduction: Pediatric sarcomas are rare and diverse, with few highly specialized centers reviewing sufficient volume to hone histopathological expertise, resulting in frequent misclassification. Digitization of histology slides enables automated imaging analysis and training of artificial neural networks (ANNs) for sarcoma subtype classification. Such tools are reproducible, mitigate against inter-observer bias, and can be implemented at a distance, allowing for global access to more precise diagnostics. A limitation is insufficient high-quality data to train models and avoid overfitting. Here, we amass a digitized sarcoma histology dataset from multiple centers. We designed a computational pipeline to (1) harmonize images to remove center-specific artifacts, (2) mirror a traditional pathologist's process by extracting imaging features at varying sizes and magnifications, and (3) implement the latest in deep learning backbones to perform automated classification of rhabdomyosarcoma (RMS) v. non-rhabdomyosarcoma (NRSTS) and further subtyping. We provide powerful proof of concept for the ability of these techniques to expand access to highly specialized care to the global pediatric sarcoma population. Methods: Hematoxylin & Eosin-stained images and limited clinical data were collected with representation from numerous centers. We optimized a pipeline for focus checking, resolution standardization, stain normalization, and image format conversion to generate a harmonized dataset of over 500 images. We tested varying tile sizes and overlaps, magnification powers, and single- vs. multi-scale concatenated-feature sets to optimize classification accuracy. Deep learning feature extraction was performed with two backbones (InceptionV3 and CTranspath). Using our previously developed SAMPLER method, we create statistical representations of each feature to train and test ANN classifiers for RMS vs NRSTS and further subtype predictions. Results: Optimal parameters were 224 pixel tile size and 112 micron spacing on center, yielding non-overlapping tiles when viewed at 20X, 0.5 microns per pixel (mpp). Single scale feature extraction at 0.5 and 1.0 outperformed 0.75 mpp. Multi-scale feature concatenation from the combination of 0.5 and 1.0 mpp provided the best overall classification performance. In matched analyses of all tested parameter combinations, CTranspath outperformed InceptionV3 with consistently higher area under curve. Conclusions: Our multi-institutional pediatric sarcoma histology dataset represents the broadest harmonized resource of this type to our knowledge. Using a multiscale approach and optimized tiling parameters, we demonstrate the superiority of vision transformer- over strict convolutional ANNs to provide gross distinction between sarcoma subtypes. Our harmonization procedures open the door for expansion of the dataset through ongoing multi-institutional collaboration, bringing promise for a future in which automated image review may accurately and remotely identify sarcoma histology, improving subtype-specific delivery of care. Citation Format: Adam H. Thiesen, Sergii Domanskyi, Ali Foroughi pour, Todd B. Sheridan, Steven B. Neuhauser, Alyssa Stetson, Katelyn Dannheim, Danielle B. Cameron, Shawn Ahn, Hao Wu, Emily R. Christison-Lagay, Carol J. Bult, Jeffrey H. Chuang, Jill C. Rubinstein. Multicenter histology image integration and multiscale deep learning for pediatric sarcoma subtype classification [abstract]. In: Proceedings of the AACR Special Conference in Cancer Research: Advances in Pediatric Cancer Research; 2024 Sep 5-8; Toronto, Ontario, Canada. Philadelphia (PA): AACR; Cancer Res 2024;84(17 Suppl) nr B023.

Predicting Molecular Subtype and Survival of Rhabdomyosarcoma Patients using Deep Learning of H&E Images: A Report from the Children's Oncology Group

Deep Learning of Rhabdomyosarcoma Pathology Images for Classification and Survival Outcome Prediction.

Machine learning for rhabdomyosarcoma histopathology

Rhabdomyosarcoma Histology Classification Using Ensemble of Deep Learning Networks

Abstract B023: Multicenter histology image integration and multiscale deep learning for pediatric sarcoma subtype classification

Classifying Subtypes and Predicting Survival of Renal Cell Carcinoma Using Histopathology Image-Based Deep Learning

IMG-05. USING CONVOLUTIONAL NEURAL NETWORKS TO IDENTIFY COMMON MOLECULAR ALTERATIONS IN PEDIATRIC BRAIN TUMORS

Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter study

Deep learning-based survival prediction for multiple cancer types using histopathology images

Genomic Classification and Clinical Outcome in Rhabdomyosarcoma: A Report From an International Consortium

Prediction of overall survival and molecular markers in gliomas via analysis of digital pathology images using deep learning

A deep learning study on osteosarcoma detection from histological images

Abstract 5354: Prediction of OncotypeDX high risk group for chemotherapy benefit in breast cancer by deep learning analysis of hematoxylin and eosin-stained whole slide images

Identification of Therapeutic Targets in Rhabdomyosarcoma Through Integrated Genomic, Epigenomic, and Proteomic Analyses.

Beyond hand-crafted features for pretherapeutic molecular status identification of pediatric low-grade gliomas

Abstract 1939: Multimodal prediction of metastatic relapse using federated deep learning outperforms state-of-the-art methods in soft-tissue sarcoma

Prediction of lung malignancy progression and survival with machine learning based on pre-treatment FDG-PET/CT

Noninvasive Molecular Subtyping of Pediatric Low-Grade Glioma with Self-Supervised Transfer Learning

Development of a Histopathology Informatics Pipeline for Classification and Prediction of Clinical Outcomes in Subtypes of Renal Cell Carcinoma

Advanced Hybrid Deep Learning Model for Enhanced Classification of Osteosarcoma Histopathology Images

Image-Based Subtype Classification for Glioblastoma Using Deep Learning: Prognostic Significance and Biologic Relevance.