Abstract:PURPOSE:To apply deep learning algorithms to histopathology images, construct image-based subtypes independent of known clinical and molecular classifications for glioblastoma, and produce novel insights into molecular and immune characteristics of the glioblastoma tumor microenvironment.MATERIALS AND METHODS:Using whole-slide hematoxylin and eosin images from 214 patients with glioblastoma in The Cancer Genome Atlas (TCGA), a fine-tuned convolutional neural network model extracted deep learning features. Biclustering was used to identify subtypes and image feature modules. Prognostic value of image subtypes was assessed via Cox regression on survival outcomes and validated with 189 samples from the Clinical Proteomic Tumor Analysis Consortium (CPTAC) data set. Morphological, molecular, and immune characteristics of glioblastoma image subtypes were analyzed.RESULTS:Four distinct subtypes and modules (imClust1-4) were identified for the TCGA patients with glioblastoma on the basis of the image feature data. The glioblastoma image subtypes were significantly associated with overall survival (OS; P = .028) and progression-free survival (P = .003). Apparent association was also observed for disease-specific survival (P = .096). imClust2 had the best prognosis for all three survival end points (eg, after 25 months, imClust2 had >7% surviving patients than the other subtypes). Examination of OS in the external validation using the unseen CPTAC data set showed consistent patterns. Multivariable Cox analyses confirmed that the image subtypes carry unique prognostic information independent of known clinical and molecular predictors. Molecular and immune profiling revealed distinct immune compositions of the tumor microenvironment in different image subtypes and may provide biologic explanations for the patterns in patients' outcomes.CONCLUSION:Our image-based subtype classification on the basis of deep learning models is a novel tool to refine risk stratification in cancers. The image subtypes detected for glioblastoma represent a promising prognostic biomarker with distinct molecular and immune characteristics and may facilitate developing novel, individualized immunotherapies for glioblastoma.

Classifying Six Glioma Subtypes from Combined Gene Expression and CNVs Data Based on Compressive Sensing Approach

Subtyping glioblastoma by combining miRNA and mRNA expression data using compressed sensing-based approach

Molecular Subtyping of Diffuse Gliomas Using Magnetic Resonance Imaging: Comparison and Correlation Between Radiomics and Deep Learning.

Metabolic Signature-Based Subtypes May Pave Novel Ways for Low-Grade Glioma Prognosis and Therapy.

Identifying cancer subtypes in glioblastoma by combining genomic, transcriptomic and epigenomic data

Compressed spectral screening for large-scale differential correlation analysis with application in selecting Glioblastoma gene modules

A compressed sensing based approach for subtyping of leukemia from gene expression data.

Nimg-60. Subtyping Glioblastoma From Joint Clustering Of Imaging And Genomic Data

Comprehensive application of AI algorithms with TCR NGS data for glioma diagnosis

Combining Radiology and Pathology for Automatic Glioma Classification

Lung squamous cell carcinoma subtyping and feature identification based on-omics data analysis

Uncovering the Genetic Basis of Glioblastoma Heterogeneity through Multimodal Analysis of Whole Slide Images and RNA Sequencing Data

Multimodal Data Integration Using Deep Learning Predicts Overall Survival of Patients with Glioma

Integrating imaging and genomic data for the discovery of distinct glioblastoma subtypes: a joint learning approach

Identifying Diffuse Glioma Subtypes Based on Pathway Enrichment Evaluation

Surveying Brain Tumor Heterogeneity by Single-Cell RNA-sequencing of Multi-Sector Biopsies

Comprehensive quantitative radiogenomic evaluation reveals novel radiomic subtypes with distinct immune pattern in glioma

Multimodal Dimension Reduction and Subtype Classification of Head and Neck Squamous Cell Tumors

Visual genetic typing of glioma using proximity-anchored in situ spectral coding amplification

PATH-10. MULTI-OMICS PROFILING AND MACHINE LEARNING PROPOSE A REFINED MOLECULAR CLASSIFICATION SYSTEM FOR GLIOMA

Image-Based Subtype Classification for Glioblastoma Using Deep Learning: Prognostic Significance and Biologic Relevance.