Abstract:The rise of spatial transcriptomics (ST) is transforming our understanding of tumor heterogeneity by enabling high-resolution, location-specific mapping of gene expression across the tumor microenvironment. However, the translational potential of spatial transcriptomics is still limited by its high cost, hindering the assembly of large patient cohorts needed for robust biomarker discovery. Here we present Path2Space, a deep learning model trained on spatial transcriptomics data to predict spatial gene expression directly from histopathology slides. Studying breast cancer, the model was first trained on one ST breast cancer patients cohort and further independently tested and validated on two other ST cohorts. Path2Space identifies 4,500 genes whose spatial expression is robustly predicted in all three cohorts, markedly more accurate than existing ST predictors. Second, we show that based on the inferred ST, Path2Space accurately infers cell-type abundances in the tumor microenvironment (TME). Thirdly, Applying Path2Space to the TCGA breast cancer cohort we identify three TME spatially grounded subsets of patients that have markedly different survival rates. Fourth, analyzing two large breast cancer patients cohorts treated with trastuzumab, we show that the heterogeneity of the inferred HER2 levels across the tumor microenvironment is predictive of response, concordant with the bystander hypothesis. Finally, we developed a spatially interpretable model for predicting trastuzumab response directly from the H&E-slides. This model's performance surpasses that of existing response prediction models that use measured bulk multi-omics data. Path2Space is the first approach capable of robustly delineating the tumor microenvironment on an unprecedented scale directly from the tumor slides. It heralds the upcoming development of robust spatially grounded biomarkers of patients survival and treatment that promises to transform precision oncology in both the developed and developing worlds.

HE2Gene: Image-to-RNA Translation Via Multi-Task Learning for Spatial Transcriptomics Data

Spatial transcriptomics inferred from pathology whole-slide images links tumor heterogeneity to survival in breast and lung cancer

Leveraging information in spatial transcriptomics to predict super-resolution gene expression from histology images in tumors

GeneQuery: A General QA-based Framework for Spatial Gene Expression Predictions from Histology Images

Extraction and Comparison of Gene Expression Patterns from 2d Rna in Situ Hybridization Images

Spatial transcriptomics prediction from histology jointly through Transformer and graph neural networks

High-Resolution Spatial Transcriptomics from Histology Images using HisToSGE

Multimodal contrastive learning for spatial gene expression prediction using histology images

Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learning

THItoGene: a deep learning method for predicting spatial transcriptomics from histological images

Hist2Cell: Deciphering Fine-grained Cellular Architectures from Histology Images

Spatial gene expression at single-cell resolution from histology using deep learning with GHIST

Inferring histology-associated gene expression gradients in spatial transcriptomic studies

RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency

STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomics

Enhancing Spatial Transcriptomics Analysis by Integrating Image-Aware Deep Learning Methods

A multi-modality and multi-granularity collaborative learning framework for identifying spatial domains and spatially variable genes

SpatialMap: Spatial Mapping of Unmeasured Gene Expression Profiles in Spatial Transcriptomic Data Using Generalized Linear Spatial Models

Path2Space: An AI Approach for Cancer Biomarker Discovery Via Histopathology Inferred Spatial Transcriptomics

Breast Cancer Histopathology Image based Gene Expression Prediction using Spatial Transcriptomics data and Deep Learning