Abstract:Abstract Digital analysis of pathology whole-slide images is fast becoming a game changer in cancer diagnosis and treatment. Specifically, deep learning methods have shown great potential to support pathology analysis, with recent studies identifying molecular traits that were not previously recognized in pathology H&E whole-slide images. Simultaneous to these developments, it is becoming increasingly evident that tumor heterogeneity is an important determinant of cancer prognosis and susceptibility to treatment, and should therefore play a role in the evolving practices of matching treatment protocols to patients. State of the art diagnostic procedures, however, do not provide automated methods for characterizing and/or quantifying tumor heterogeneity, certainly not in a spatial context. Further, existing methods for analyzing pathology whole-slide images from bulk measurements require many training samples and complex pipelines. Our work addresses these two challenges. First, we train deep learning models to spatially resolve bulk mRNA and miRNA expression levels on pathology whole-slide images (WSIs). Our models reach up to 0.95 AUC on held-out test sets from two cancer cohorts using a simple training pipeline and a small number of training samples. Using the inferred gene expression levels, we further develop a method to spatially characterize tumor heterogeneity. Specifically, we produce tumor molecular cartographies and heterogeneity maps of WSIs and formulate a heterogeneity index (HTI) that quantifies the level of heterogeneity within these maps. Applying our methods to breast and lung cancer slides, we show a significant statistical link between heterogeneity and survival. Our methods potentially open a new and accessible approach to investigating tumor heterogeneity and other spatial molecular properties and their link to clinical characteristics, including treatment susceptibility and survival.

Integrating Ambient Mass Spectrometry Imaging and Spatial Transcriptomics on the Same Cancer Tissues to Identify Gene-Metabolite Correlations

Integration of mass cytometry and mass spectrometry imaging for spatially resolved single-cell metabolic profiling

In tissue spatial single-cell metabolomics by coupling mass spectrometry imaging and immunofluorescences

Spatial metabolomics principles and application to cancer research

Spatial transcriptomics inferred from pathology whole-slide images links tumor heterogeneity to survival in breast and lung cancer

An integrative spatial multi-omic workflow for unified analysis of tumor tissue

Spatially resolved multi-omics highlights cell-specific metabolic remodeling and interactions in gastric cancer

Spatial Integration of Multi-Omics Data using the novel Multi-Omics Imaging Integration Toolset

Technologies for Decoding Cancer Metabolism with Spatial Resolution

Metabolomics at the tumor microenvironment interface: Decoding cellular conversations

Technique Integration of Single-Cell RNA Sequencing with Spatially Resolved Transcriptomics in the Tumor Microenvironment

Spatiotemporal metabolomic approaches to the cancer-immunity panorama: a methodological perspective

haCCA: Multi-module Integrating of spatial transcriptomes and metabolomes

Comparing DESI-MSI and MALDI-MSI Mediated Spatial Metabolomics and Their Applications in Cancer Studies

Spatially resolved metabolomics to discover tumor-associated metabolic alterations

Identification of Niche-Specific Gene Signatures between Malignant Tumor Microenvironments by Integrating Single Cell and Spatial Transcriptomics Data

High resolution mapping of the tumor microenvironment using integrated single-cell, spatial and in situ analysis

Spatial transcriptomics and proteomics technologies for deconvoluting the tumor microenvironment

Integration of Multiple Spatial Omics Modalities Reveals Unique Insights into Molecular Heterogeneity of Prostate Cancer

Integration of Elemental Imaging and Spatial Transcriptomic Profiling for Proof-of-Concept Metals-Based Pathway Analysis of Colon Tumor Microenvironment

METI: deep profiling of tumor ecosystems by integrating cell morphology and spatial transcriptomics