Abstract:Introduction: Pediatric sarcomas are rare and diverse, with few highly specialized centers reviewing sufficient volume to hone histopathological expertise, resulting in frequent misclassification. Digitization of histology slides enables automated imaging analysis and training of artificial neural networks (ANNs) for sarcoma subtype classification. Such tools are reproducible, mitigate against inter-observer bias, and can be implemented at a distance, allowing for global access to more precise diagnostics. A limitation is insufficient high-quality data to train models and avoid overfitting. Here, we amass a digitized sarcoma histology dataset from multiple centers. We designed a computational pipeline to (1) harmonize images to remove center-specific artifacts, (2) mirror a traditional pathologist's process by extracting imaging features at varying sizes and magnifications, and (3) implement the latest in deep learning backbones to perform automated classification of rhabdomyosarcoma (RMS) v. non-rhabdomyosarcoma (NRSTS) and further subtyping. We provide powerful proof of concept for the ability of these techniques to expand access to highly specialized care to the global pediatric sarcoma population. Methods: Hematoxylin & Eosin-stained images and limited clinical data were collected with representation from numerous centers. We optimized a pipeline for focus checking, resolution standardization, stain normalization, and image format conversion to generate a harmonized dataset of over 500 images. We tested varying tile sizes and overlaps, magnification powers, and single- vs. multi-scale concatenated-feature sets to optimize classification accuracy. Deep learning feature extraction was performed with two backbones (InceptionV3 and CTranspath). Using our previously developed SAMPLER method, we create statistical representations of each feature to train and test ANN classifiers for RMS vs NRSTS and further subtype predictions. Results: Optimal parameters were 224 pixel tile size and 112 micron spacing on center, yielding non-overlapping tiles when viewed at 20X, 0.5 microns per pixel (mpp). Single scale feature extraction at 0.5 and 1.0 outperformed 0.75 mpp. Multi-scale feature concatenation from the combination of 0.5 and 1.0 mpp provided the best overall classification performance. In matched analyses of all tested parameter combinations, CTranspath outperformed InceptionV3 with consistently higher area under curve. Conclusions: Our multi-institutional pediatric sarcoma histology dataset represents the broadest harmonized resource of this type to our knowledge. Using a multiscale approach and optimized tiling parameters, we demonstrate the superiority of vision transformer- over strict convolutional ANNs to provide gross distinction between sarcoma subtypes. Our harmonization procedures open the door for expansion of the dataset through ongoing multi-institutional collaboration, bringing promise for a future in which automated image review may accurately and remotely identify sarcoma histology, improving subtype-specific delivery of care. Citation Format: Adam H. Thiesen, Sergii Domanskyi, Ali Foroughi pour, Todd B. Sheridan, Steven B. Neuhauser, Alyssa Stetson, Katelyn Dannheim, Danielle B. Cameron, Shawn Ahn, Hao Wu, Emily R. Christison-Lagay, Carol J. Bult, Jeffrey H. Chuang, Jill C. Rubinstein. Multicenter histology image integration and multiscale deep learning for pediatric sarcoma subtype classification [abstract]. In: Proceedings of the AACR Special Conference in Cancer Research: Advances in Pediatric Cancer Research; 2024 Sep 5-8; Toronto, Ontario, Canada. Philadelphia (PA): AACR; Cancer Res 2024;84(17 Suppl) nr B023.

Abstract B023: Multicenter histology image integration and multiscale deep learning for pediatric sarcoma subtype classification

Machine learning for rhabdomyosarcoma histopathology

Rhabdomyosarcoma Histology Classification Using Ensemble of Deep Learning Networks

Abstract 1939: Multimodal prediction of metastatic relapse using federated deep learning outperforms state-of-the-art methods in soft-tissue sarcoma

Predicting Molecular Subtype and Survival of Rhabdomyosarcoma Patients using Deep Learning of H&E Images: A Report from the Children's Oncology Group

Abstract 6883: Investigation of tumor-immune interactions in pediatric sarcomas using single-cell multi-omics

Deep Learning of Rhabdomyosarcoma Pathology Images for Classification and Survival Outcome Prediction.

Abstract 4255: A systematic framework for efficient generation of expandable patient-derived 3D sarcoma models

Pediatric brain tumor classification using digital histopathology and deep learning: evaluation of SOTA methods on a multi-center Swedish cohort

Abstract 3928: Genomic landscape and estimation of immune infiltration of soft tissue sarcoma histology subtypes from the ORIEN network

Abstract B082: Early risk stratification of ER+/HER2– breast cancer patients using digital pathology and multi-task, weakly-supervised deep learning

Abstract 5431: 3D multiplexed tissue imaging reconstruction and optimized region-of-interest (ROI) selection through deep learning model of channels embedding

Advanced Hybrid Deep Learning Model for Enhanced Classification of Osteosarcoma Histopathology Images

Abstract 890: Multimodal modeling of digitized histopathology slides improves risk stratification in hormone receptor-positive breast cancer patients

Abstract 2318: Multimodal machine learning for the automatic classification of recurrent cancers

Abstract 7388: Deep learning-implemented molecular signature identification in vascular malignancies

Abstract 4951: Integrative multi-omic machine learning model predicts neoadjuvant immunotherapy response using molecular data and deep learning-derived features from digital pathology

Abstract 2310: Integrating real-world histopathological and clinicogenomic data from 1799 lung cancer patients by applying unsupervised deep learning

Abstract B039: SAMPLER: Unsupervised representations of whole slide images for tumor phenotype prediction

A Pan-Cancer Patient-Derived Xenograft Histology Image Repository with Genomic and Pathologic Annotations Enables Deep Learning Analysis

Abstract 4889: Integrative multi-omic analysis reveals novel prognostic biological entities in pediatric medulloblastoma