Abstract:Abstract Gliomas are primary brain tumors that arise from neural stem cells or glial precursors. Diagnosis of glioma is based on histological evaluation of pathological cell features and molecular markers. Gliomas are infiltrated by myeloid cells that accumulate preferentially in malignant tumors and their abundance inversely correlates with survival, which is of interest for cancer immunotherapies. To avoid time-consuming and laborious manual examination of the images, a deep learning approach for automatic multiclass classification of tumor grades was proposed. Importantly, as an alternative way of investigating characteristics of brain tumor grades, we implemented a protocol for learning, discovering, and quantifying tumor microenvironment elements on our glioma dataset. Using only single-stained biopsies we derived characteristic differentiating tumor microenvironment phenotypic neighborhoods. A challenge of the study was given by a small sample size of human leukocyte antigen stained on glioma tissue microarrays dataset - 203 images from 5 classes - and imbalanced data distribution. This has been addressed by image augmentation of the underrepresented classes. For this glioma multiclass classification task, a residual neural network architecture has been adapted. On the validation set the average accuracy was 0.72 when the model was trained from scratch, and 0.85 with the pre-trained model. Moreover, the tumor microenvironment analysis suggested a relevant role of the myeloid cells and their accumulation to characterize glioma grades. This promising approach can be used as an additional diagnostic tool to improve assessment during intra-operative examination or sub-typing tissues for treatment selection, despite the challenges caused by the difficult dataset. We present here the distributions and visualizations of extracted tumor inter-dependencies. Graphical abstract Highlights Research highlight 1: We demonstrate that the ResNet-18 architecture with simple data augmentation trained in 10-fold cross-validation performs the multiclass classification relatively well even with a small imbalanced dataset with a high degree of similarities between classes. Research highlight 2: After supervised subtyping of the tumor, we investigated the usefulness of the protocol for discovery and learning tumor microenvironment elements for the same task. The protocol designed for deriving new biomarkers based on multiplex stained histological samples proved the ability to detect features characteristic of malignant tumors based only on single target stained tissue microarrays. We propose further studies on this topic can help in formulating specific criteria for improvements in diagnosis of gliomas, allowing to avoid the necessity of conducting advanced histopathological analysis or complementing genetic testing of tumor samples.

Microvascularity detection and quantification in glioma: a novel deep-learning-based framework

Molecular Subtyping of Diffuse Gliomas Using Magnetic Resonance Imaging: Comparison and Correlation Between Radiomics and Deep Learning.

Prediction of overall survival and molecular markers in gliomas via analysis of digital pathology images using deep learning

Intraoperative superb microvascular ultrasound imaging in glioma: novel quantitative analysis correlates with tumour grade

Deep learning-based vessel extraction in 3D confocal microscope images of cleared human glioma tissues

Microvascular fractal dimension predicts prognosis and response to chemotherapy in glioblastoma: an automatic image analysis study

Deep Learning Glioma Grading with the Tumor Microenvironment Analysis Protocol for A Comprehensive Learning, Discovering, and Quantifying Microenvironmental Features

Deep Neural Network Analysis of Pathology Images With Integrated Molecular Data for Enhanced Glioma Classification and Grading

CNN-based glioma detection in MRI: A deep learning approach

Microvascular Characteristics of Lower-Grade Diffuse Gliomas: Investigating Vessel Size Imaging for Differentiating Grades and Subtypes.

Therapy-induced modulation of tumor vasculature and oxygenation in a murine glioblastoma model quantified by deep learning-based feature extraction

Image-Based Subtype Classification for Glioblastoma Using Deep Learning: Prognostic Significance and Biologic Relevance.

Whole brain morphologic features improve the predictive accuracy of IDH status and VEGF expression levels in gliomas

Automated Machine-Learning Framework Integrating Histopathological and Radiological Information for Predicting IDH1 Mutation Status in Glioma

Label-Free Detection of the Architectural Feature of Blood Vessels in Glioblastoma Based on Multiphoton Microscopy

Insight into deep learning for glioma IDH medical image analysis: A systematic review

Path-50. Ai-Powered Automated Tissue Segmentation Improves Outcome Stratification In Glioblastoma

Diffusion Histology Imaging Combining Diffusion Basis Spectrum Imaging (DBSI) and Machine Learning Improves Detection and Classification of Glioblastoma Pathology

Automatic Prediction Of Mgmt Status In Glioblastoma Via Deep Learning-Based Mr Image Analysis

Diffusion Histology Imaging Detects and Classifies Glioblastoma Pathology Missed by Conventional Magnetic Resonance Imaging

506 Deep Learning-Based Image-to-Image Translation to Identify Macrophage Infiltration in High-Grade Glioma Using Label-Free Stimulated Raman Histology