Abstract:Spatial omics and multiplexed imaging technologies provide unprecedented spatial context to characterize molecular variation in complex tissues. Developing unsupervised computational pipeline in a discovery mode is of vital importance to interpret spatially resolved data and derive novel biological insights. We develop Stereo, a unified framework leveraging contrastive learning to jointly model molecular and spatial information in a self-supervised manner. Stereo consists of two modules, StereoCell for neighbor-aware cell identity inference and clustering on spatial transcriptomics data, and StereoNiche for biologically-relevant niche identification on spatial proteomics data. StereoCell uses graph attention to aggregate immediate neighbors’ content for each cell while StereoNiche exploits vision Transformer to explicitly relate position coordinates with marker readouts within certain receptive field. We validate StereoCell’s superior utility on both simulated and real transcriptomics datasets of brain tissues acquired by various technologies with different resolutions. StereoCell can operate on all genes, extract layer-specific signature genes at single-cell resolution and identify clear layer-wise structure with state-of-the-art performance. Applied on tumor tissue sections, StereoCell enables detailed characterization of intratumoral heterogeneity and reveals invasive or metastasis behaviors concordant with expert annotations. Evaluated on a multiplexed fluorescence imaging dataset for colorectal cancer (CRC) patients, StereoNiche refines niche assignments, recapitulates classical follicle structure, and validates enriched T cells-macrophages interdigitation. Via self-distillation operation, StereoNiche also enables extracting bounded layout of tertiary lymphoid structure with no supervision, representing classical Crohn’s-like reaction behavior. Local explanations are derived for a tree-based survival model to validate the clinical relevance of identified niches. For mass spectrometry profiled triple-negative breast cancer (TNBC) samples, StereoNiche recognizes differential tumor-immune interactions to separate compartmentalized from mixed pattern. In brief, Stereo is applicable to a variety of spatial technologies, serving as a powerful method to interrogate context-aware biological process and facilitate hierarchical signature discovery in neuroscience and computational pathology.

Stereopy: modeling comparative and spatiotemporal cellular heterogeneity via multi-sample spatial transcriptomics

Revealing Spatial Multimodal Heterogeneity in Tissues with SpaTrio

Development of Multiomics in Situ Pairwise Sequencing (Mip-Seq) for Single-cell Resolution Multidimensional Spatial Omics

Spateo: multidimensional spatiotemporal modeling of single-cell spatial transcriptomics

StereoCell enables highly accurate single-cell segmentation for spatial transcriptomics

StereoSiTE: a framework to spatially and quantitatively profile the cellular neighborhood organized iTME

Position-informed contrastive learning for spatially resolved omics deciphers hierarchical tissue structure at both cellular and niche levels

Generating single-cell gene expression profiles for high-resolution spatial transcriptomics based on cell boundary images

Large field of view-spatially resolved transcriptomics at nanoscale resolution

Spatially informed clustering, integration, and deconvolution of spatial transcriptomics with GraphST

CellBin: a highly accurate single-cell gene expression processing pipeline for high-resolution spatial transcriptomics

Integrating spatial and single-cell transcriptomics data using deep generative models with SpatialScope

Accurate, Scalable and Cross-platform Cell Identification for High-resolution Spatial Transcriptomics

StereoMM: A Graph Fusion Model for Integrating Spatial Transcriptomic Data and Pathological Images

CellBin enables highly accurate single-cell segmentation for spatial transcriptomics

Uncover spatially informed variations for single-cell spatial transcriptomics with STew

Mitigating autocorrelation during spatially resolved transcriptomics data analysis

Systematic comparison of sequencing-based spatial transcriptomic methods

Starfysh integrates spatial transcriptomic and histologic data to reveal heterogeneous tumor–immune hubs

STPDA: Leveraging spatial-temporal patterns for downstream analysis in spatial transcriptomic data