Abstract:Abstract Digital analysis of pathology whole-slide images is fast becoming a game changer in cancer diagnosis and treatment. Specifically, deep learning methods have shown great potential to support pathology analysis, with recent studies identifying molecular traits that were not previously recognized in pathology H&E whole-slide images. Simultaneous to these developments, it is becoming increasingly evident that tumor heterogeneity is an important determinant of cancer prognosis and susceptibility to treatment, and should therefore play a role in the evolving practices of matching treatment protocols to patients. State of the art diagnostic procedures, however, do not provide automated methods for characterizing and/or quantifying tumor heterogeneity, certainly not in a spatial context. Further, existing methods for analyzing pathology whole-slide images from bulk measurements require many training samples and complex pipelines. Our work addresses these two challenges. First, we train deep learning models to spatially resolve bulk mRNA and miRNA expression levels on pathology whole-slide images (WSIs). Our models reach up to 0.95 AUC on held-out test sets from two cancer cohorts using a simple training pipeline and a small number of training samples. Using the inferred gene expression levels, we further develop a method to spatially characterize tumor heterogeneity. Specifically, we produce tumor molecular cartographies and heterogeneity maps of WSIs and formulate a heterogeneity index (HTI) that quantifies the level of heterogeneity within these maps. Applying our methods to breast and lung cancer slides, we show a significant statistical link between heterogeneity and survival. Our methods potentially open a new and accessible approach to investigating tumor heterogeneity and other spatial molecular properties and their link to clinical characteristics, including treatment susceptibility and survival.

What Do You Most Hope Spatial Molecular Profiling Will Help Us Understand? Part 1

Spatial components of molecular tissue biology

Deep Profiling of Cellular Heterogeneity by Emerging Single‐Cell Proteomic Technologies

Single-cell and spatial transcriptomics enables probabilistic inference of cell type topography

Spatial molecular profiling: platforms, applications and analysis tools

Spatial transcriptomics inferred from pathology whole-slide images links tumor heterogeneity to survival in breast and lung cancer

A Shift in Paradigms: Spatial Genomics Approaches to Reveal Single-Cell Principles of Genome Organization

Statistical Single Cell Multi-Omics Integration

Complementing cell taxonomies with a multicellular analysis of tissues

Microfluidic Single-Cell Transcriptomics: Moving Towards Multimodal And Spatiotemporal Omics

Integration of Single‐cell Transcriptome and Proteome Technologies: Toward Spatial Resolution Levels

Profiling cell identity and tissue architecture with single-cell and spatial transcriptomics

Complementing cell taxonomies with a multicellular functional analysis of tissues

Disentangling cell type and state transcriptional programs

Reference-based cell type matching of spatial transcriptomics data

Molecular profiling of single organelles for quantitative analysis of cellular heterogeneity

Hist2Cell: Deciphering Fine-grained Cellular Architectures from Histology Images

Mapping Cellular Interactions from Spatially Resolved Transcriptomics Data

Collective properties of cellular identity: a computational approach

Cell type and gene expression deconvolution with BayesPrism enables Bayesian integrative analysis across bulk and single-cell RNA sequencing in oncology

High-plex Multiomic Analysis in FFPE at Subcellular Level by Spatial Molecular Imaging