Abstract:Introduction: Pediatric sarcomas are rare and diverse, with few highly specialized centers reviewing sufficient volume to hone histopathological expertise, resulting in frequent misclassification. Digitization of histology slides enables automated imaging analysis and training of artificial neural networks (ANNs) for sarcoma subtype classification. Such tools are reproducible, mitigate against inter-observer bias, and can be implemented at a distance, allowing for global access to more precise diagnostics. A limitation is insufficient high-quality data to train models and avoid overfitting. Here, we amass a digitized sarcoma histology dataset from multiple centers. We designed a computational pipeline to (1) harmonize images to remove center-specific artifacts, (2) mirror a traditional pathologist's process by extracting imaging features at varying sizes and magnifications, and (3) implement the latest in deep learning backbones to perform automated classification of rhabdomyosarcoma (RMS) v. non-rhabdomyosarcoma (NRSTS) and further subtyping. We provide powerful proof of concept for the ability of these techniques to expand access to highly specialized care to the global pediatric sarcoma population. Methods: Hematoxylin & Eosin-stained images and limited clinical data were collected with representation from numerous centers. We optimized a pipeline for focus checking, resolution standardization, stain normalization, and image format conversion to generate a harmonized dataset of over 500 images. We tested varying tile sizes and overlaps, magnification powers, and single- vs. multi-scale concatenated-feature sets to optimize classification accuracy. Deep learning feature extraction was performed with two backbones (InceptionV3 and CTranspath). Using our previously developed SAMPLER method, we create statistical representations of each feature to train and test ANN classifiers for RMS vs NRSTS and further subtype predictions. Results: Optimal parameters were 224 pixel tile size and 112 micron spacing on center, yielding non-overlapping tiles when viewed at 20X, 0.5 microns per pixel (mpp). Single scale feature extraction at 0.5 and 1.0 outperformed 0.75 mpp. Multi-scale feature concatenation from the combination of 0.5 and 1.0 mpp provided the best overall classification performance. In matched analyses of all tested parameter combinations, CTranspath outperformed InceptionV3 with consistently higher area under curve. Conclusions: Our multi-institutional pediatric sarcoma histology dataset represents the broadest harmonized resource of this type to our knowledge. Using a multiscale approach and optimized tiling parameters, we demonstrate the superiority of vision transformer- over strict convolutional ANNs to provide gross distinction between sarcoma subtypes. Our harmonization procedures open the door for expansion of the dataset through ongoing multi-institutional collaboration, bringing promise for a future in which automated image review may accurately and remotely identify sarcoma histology, improving subtype-specific delivery of care. Citation Format: Adam H. Thiesen, Sergii Domanskyi, Ali Foroughi pour, Todd B. Sheridan, Steven B. Neuhauser, Alyssa Stetson, Katelyn Dannheim, Danielle B. Cameron, Shawn Ahn, Hao Wu, Emily R. Christison-Lagay, Carol J. Bult, Jeffrey H. Chuang, Jill C. Rubinstein. Multicenter histology image integration and multiscale deep learning for pediatric sarcoma subtype classification [abstract]. In: Proceedings of the AACR Special Conference in Cancer Research: Advances in Pediatric Cancer Research; 2024 Sep 5-8; Toronto, Ontario, Canada. Philadelphia (PA): AACR; Cancer Res 2024;84(17 Suppl) nr B023.

Rhabdomyosarcoma Histology Classification Using Ensemble of Deep Learning Networks

Deep Learning of Rhabdomyosarcoma Pathology Images for Classification and Survival Outcome Prediction.

Machine learning for rhabdomyosarcoma histopathology

Predicting Molecular Subtype and Survival of Rhabdomyosarcoma Patients using Deep Learning of H&E Images: A Report from the Children's Oncology Group

Abstract B023: Multicenter histology image integration and multiscale deep learning for pediatric sarcoma subtype classification

Deep Learning-Based Semantic Segmentation of Non-Melanocytic Skin Tumors in Whole-Slide Histopathological Images.

Ensemble Deep Learning-Based Image Classification for Breast Cancer Subtype and Invasiveness Diagnosis from Whole Slide Image Histopathology

Automated identification of malignancy in whole-slide pathological images: identification of eyelid malignant melanoma in gigapixel pathological slides using deep learning

A deep learning study on osteosarcoma detection from histological images

Deep learning-based identification of esophageal cancer subtypes through analysis of high-resolution histopathology images

Nimg-18. Rapid Intraoperative Differentiation Of Primary Cns Lymphoma From Common Cns Tumors Using Stimulated Raman Histology And Deep Learning

Lung cancer subtype classification using histopathological images based on weakly supervised multi-instance learning

Advanced Hybrid Deep Learning Model for Enhanced Classification of Osteosarcoma Histopathology Images

Classification of benign and malignant subtypes of breast cancer histopathology imaging using hybrid CNN-LSTM based transfer learning

Deep learning-based classification of breast cancer molecular subtypes from H&E whole-slide images

Automated Molecular Subtyping of Breast Carcinoma Using Deep Learning Techniques

Classification of Colorectal Cancer Consensus Molecular Subtypes Using Attention-Based Multi-Instance Learning Network on Whole-Slide Images

Multimodal Lung Cancer Subtyping Using Deep Learning Neural Networks on Whole Slide Tissue Images and MALDI MSI

From Human Mesenchymal Stromal Cells to Osteosarcoma Cells Classification by Deep Learning

Viable and necrotic tumor assessment from whole slide images of osteosarcoma using machine-learning and deep-learning models

Classifying Subtypes and Predicting Survival of Renal Cell Carcinoma Using Histopathology Image-Based Deep Learning