Abstract:Background. Spatial transcriptomics involves studying the spatial organization of gene expression within tissues, offering insights into the molecular diversity of tumors. While spatial gene expression is commonly amalgamated from 1-10 cells across 50-micron spots, recent methods have demonstrated the capability to disaggregate this information at subspot resolution by leveraging both expression and histological patterns. However, elucidating such information from histology alone presents a significant challenge but if solved can better permit spatial molecular analysis at cellular resolution for instances where Visium data is not available, reducing study costs. This study explores integrating single-cell histological and transcriptomic data to infer spatial mRNA expression patterns in whole slide images collected from a cohort of stage pT3 colorectal cancer patients. A cell graph neural network algorithm was developed to align histological information extracted from detected cells with single cell RNA patterns through optimal transport methods, facilitating the analysis of cellular groupings and gene relationships. This approach leveraged spot-level expression as an intermediary to co-map histological and transcriptomic information at the single-cell level. Results. Our study demonstrated that single-cell transcriptional heterogeneity within a spot could be predicted from histological markers extracted from cells detected within a spot. Furthermore, our model exhibited proficiency in delineating overarching gene expression patterns across whole-slide images. This approach compared favorably to traditional patch-based computer vision methods as well as other methods which did not incorporate single cell expression during the model fitting procedures. Topological nuances of single-cell expression within a Visium spot were preserved using the developed methodology. Conclusion. This innovative approach augments the resolution of spatial molecular assays utilizing histology as a sole input through synergistic co-mapping of histological and transcriptomic datasets at the single-cell level, anchored by spatial transcriptomics. While initial results are promising, they warrant rigorous validation. This includes collaborating with pathologists for precise spatial identification of distinct cell types and utilizing sophisticated assays, such as Xenium, to attain deeper subcellular insights.

Hist2Cell: Deciphering Fine-grained Cellular Architectures from Histology Images

Spatial gene expression at single-cell resolution from histology using deep learning with GHIST

Spatial transcriptomics prediction from histology jointly through Transformer and graph neural networks

HE2Gene: Image-to-RNA Translation Via Multi-Task Learning for Spatial Transcriptomics Data

Accurate, Scalable and Cross-platform Cell Identification for High-resolution Spatial Transcriptomics

THItoGene: a deep learning method for predicting spatial transcriptomics from histological images

From Histopathology Images to Cell Clouds: Learning Slide Representations with Hierarchical Cell Transformer

Leveraging information in spatial transcriptomics to predict super-resolution gene expression from histology images in tumors

Inferring single-cell spatial gene expression with tissue morphology via explainable deep learning

Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learning

stLearn: integrating spatial location, tissue morphology and gene expression to find cell types, cell-cell interactions and spatial trajectories within undissociated tissues

KanCell: Dissecting Cellular Heterogeneity in Biological Tissues Through Integrated Single-Cell and Spatial Transcriptomics

CellMemory: Hierarchical Interpretation of Out-of-Distribution Cells Using Bottlenecked Transformer

Feasibility of Inferring Spatial Transcriptomics from Single-Cell Histological Patterns for Studying Colon Cancer Tumor Heterogeneity

Spatial Transcriptomics Prediction from Histology Images at Single-cell Resolution using RedeHist

Comprehensive mapping of tissue cell architecture via integrated single cell and spatial transcriptomics

Computational Staining of Pathology Images to Study the Tumor Microenvironment in Lung Cancer

Cell2location maps fine-grained cell types in spatial transcriptomics

Exploit Spatially Resolved Transcriptomic Data to Infer Cellular Features from Pathology Imaging Data}

When Machine Vision Meets Histology: A Comparative Evaluation of Model Architecture for Classification of Histology Sections