Abstract:The spatial arrangement of cells is vital in developmental processes and organogenesis in multicellular life forms. Deep learning models trained with spatial omics data uncover complex patterns and relationships among cells, genes, and proteins in a high-dimensional space, providing new insights into biological processes and diseases. State-of-the-art in silico spatial multi-cell gene expression methods using histological images of tissue stained with hematoxylin and eosin (H&E) to characterize cellular heterogeneity. These computational techniques offer the advantage of analyzing vast amounts of spatial data in a scalable and automated manner, thereby accelerating scientific discovery and enabling more precise medical diagnostics and treatments. In this work, we developed a vision transformer (ViT) framework to map histological signatures to spatial single-cell transcriptomic signatures, named SPiRiT (Spatial Omics Prediction and Reproducibility integrated Transformer). Our framework was enhanced by integrating cross validation with model interpretation during hyper-parameter tuning. SPiRiT predicts single-cell spatial gene expression using the matched histopathological image tiles of human breast cancer and whole mouse pup, evaluated by Xenium (10x Genomics) datasets. Furthermore, ViT model interpretation reveals the high-resolution, high attention area (HAR) that the ViT model uses to predict the gene expression, including marker genes for invasive cancer cells (FASN), stromal cells (POSTN), and lymphocytes (IL7R). In an apple-to-apple comparison with the ST-Net Convolutional Neural Network algorithm, SPiRiT improved predictive accuracy by 40% using human breast cancer Visium (10x Genomics) dataset. Cancer biomarker gene prediction and expression level are highly consistent with the tumor region annotation. In summary, our work highlights the feasibility to infer spatial single-cell gene expression using tissue morphology in multiple-species, i.e., human and mouse, and multi-organs, i.e., mouse whole body morphology. Importantly, incorporating model interpretation and vision transformer is expected to serve as a general-purpose framework for spatial transcriptomics.

RESEPT: tissue architecture inference and visualization from spatially resolved transcriptomics

Define and visualize pathological architectures of human tissues from spatially resolved transcriptomics using deep learning

Inferring single-cell spatial gene expression with tissue morphology via explainable deep learning

A contrastive learning approach to integrate spatial transcriptomics and histological images

Spatial Transcriptomics Prediction from Histology Images at Single-cell Resolution using RedeHist

A graph self-supervised residual learning framework for domain identification and data integration of spatial transcriptomics

FICTURE: scalable segmentation-free analysis of submicron-resolution spatial transcriptomics

Spatial-ID: a cell typing method for spatially resolved transcriptomics via transfer learning and spatial embedding

STEP: Spatial Transcriptomics Embedding Procedure for Multi-scale Biological Heterogeneities Revelation in Multiple Samples

Spatially Exploring RNA Biology in Archival Formalin-Fixed Paraffin-Embedded Tissues

Rapid and Signal Crowdedness-Robust In-Situ Sequencing Through Hybrid Block Coding

Accurate and efficient integrative reference-informed spatial domain detection for spatial transcriptomics

Spatially aware self-representation learning for tissue structure characterization and spatial functional genes identification

Uncovering an Organ's Molecular Architecture at Single-Cell Resolution by Spatially Resolved Transcriptomics

Efficient reliability analysis of spatially resolved transcriptomics at varying resolutions using SpaSEG

INSPIRE: interpretable, flexible and spatially-aware integration of multiple spatial transcriptomics datasets from diverse sources

Unveiling Tissue Structure and Tumor Microenvironment from Spatially Resolved Transcriptomics by Hypergraph Learning

FastReseg: using transcript locations to refine image-based cell segmentation results in spatial transcriptomics

Inferring super-resolution tissue architecture by integrating spatial transcriptomics with histology

STEP: Deciphering Spatial Atlas at Single-Cell Level with Whole-Transcriptome Coverage

StereoCell enables highly accurate single-cell segmentation for spatial transcriptomics