Abstract:The spatial arrangement of cells is vital in developmental processes and organogenesis in multicellular life forms. Deep learning models trained with spatial omics data uncover complex patterns and relationships among cells, genes, and proteins in a high-dimensional space, providing new insights into biological processes and diseases. State-of-the-art in silico spatial multi-cell gene expression methods using histological images of tissue stained with hematoxylin and eosin (H&E) to characterize cellular heterogeneity. These computational techniques offer the advantage of analyzing vast amounts of spatial data in a scalable and automated manner, thereby accelerating scientific discovery and enabling more precise medical diagnostics and treatments. In this work, we developed a vision transformer (ViT) framework to map histological signatures to spatial single-cell transcriptomic signatures, named SPiRiT (Spatial Omics Prediction and Reproducibility integrated Transformer). Our framework was enhanced by integrating cross validation with model interpretation during hyper-parameter tuning. SPiRiT predicts single-cell spatial gene expression using the matched histopathological image tiles of human breast cancer and whole mouse pup, evaluated by Xenium (10x Genomics) datasets. Furthermore, ViT model interpretation reveals the high-resolution, high attention area (HAR) that the ViT model uses to predict the gene expression, including marker genes for invasive cancer cells (FASN), stromal cells (POSTN), and lymphocytes (IL7R). In an apple-to-apple comparison with the ST-Net Convolutional Neural Network algorithm, SPiRiT improved predictive accuracy by 40% using human breast cancer Visium (10x Genomics) dataset. Cancer biomarker gene prediction and expression level are highly consistent with the tumor region annotation. In summary, our work highlights the feasibility to infer spatial single-cell gene expression using tissue morphology in multiple-species, i.e., human and mouse, and multi-organs, i.e., mouse whole body morphology. Importantly, incorporating model interpretation and vision transformer is expected to serve as a general-purpose framework for spatial transcriptomics.

Explainable multi-view framework for dissecting intercellular signaling from highly multiplexed spatial data

Revealing Spatial Multimodal Heterogeneity in Tissues with SpaTrio

SOTIP: a Unified Framework for Microenvironment Modelling with Spatial Omics Data

MIST: an interpretable and flexible deep learning framework for single-T cell transcriptome and receptor analysis

Mapping Cells Through Time and Space with Moscot

Inferring single-cell spatial gene expression with tissue morphology via explainable deep learning

A bayesian multivariate mixture model for high throughput spatial transcriptomics

Spatial Integration of Multi-Omics Data using the novel Multi-Omics Imaging Integration Toolset

SIMVI reveals intrinsic and spatial-induced states in spatial omics data

Development of Multiomics in Situ Pairwise Sequencing (Mip-Seq) for Single-cell Resolution Multidimensional Spatial Omics

SOTIP is a versatile method for microenvironment modeling with spatial omics data

Exploring Structured Molecular Landscape from Single-Cell Multi-Omics Data by an Explainable Multimodal Model

Microarray Integrated Spatial Transcriptomics (MIST) for Affordable, Robust, and Comprehensive Digital Pathology

Mapping Cellular Interactions from Spatially Resolved Transcriptomics Data

Learning tissue representation by identification of persistent local patterns in spatial omics data

A deep learning-based multiscale integration of spatial omics with tumor morphology.

DIMPLE: AN R PACKAGE TO QUANTIFY, VISUALIZE, AND MODEL SPATIAL CELLULAR INTERACTIONS FROM MULTIPLEX IMAGING WITH DISTANCE MATRICES

MorphLink: Bridging Cell Morphological Behaviors and Molecular Dynamics in Multi-modal Spatial Omics

SpatialCells: automated profiling of tumor microenvironments with spatially resolved multiplexed single-cell data

Informing biologically relevant signal from spatial transcriptomic data

Single-Cell Spatial MIST for Versatile, Scalable Detection of Protein Markers