Abstract:Spatial omics and multiplexed imaging technologies provide unprecedented spatial context to characterize molecular variation in complex tissues. Developing unsupervised computational pipeline in a discovery mode is of vital importance to interpret spatially resolved data and derive novel biological insights. We develop Stereo, a unified framework leveraging contrastive learning to jointly model molecular and spatial information in a self-supervised manner. Stereo consists of two modules, StereoCell for neighbor-aware cell identity inference and clustering on spatial transcriptomics data, and StereoNiche for biologically-relevant niche identification on spatial proteomics data. StereoCell uses graph attention to aggregate immediate neighbors’ content for each cell while StereoNiche exploits vision Transformer to explicitly relate position coordinates with marker readouts within certain receptive field. We validate StereoCell’s superior utility on both simulated and real transcriptomics datasets of brain tissues acquired by various technologies with different resolutions. StereoCell can operate on all genes, extract layer-specific signature genes at single-cell resolution and identify clear layer-wise structure with state-of-the-art performance. Applied on tumor tissue sections, StereoCell enables detailed characterization of intratumoral heterogeneity and reveals invasive or metastasis behaviors concordant with expert annotations. Evaluated on a multiplexed fluorescence imaging dataset for colorectal cancer (CRC) patients, StereoNiche refines niche assignments, recapitulates classical follicle structure, and validates enriched T cells-macrophages interdigitation. Via self-distillation operation, StereoNiche also enables extracting bounded layout of tertiary lymphoid structure with no supervision, representing classical Crohn’s-like reaction behavior. Local explanations are derived for a tree-based survival model to validate the clinical relevance of identified niches. For mass spectrometry profiled triple-negative breast cancer (TNBC) samples, StereoNiche recognizes differential tumor-immune interactions to separate compartmentalized from mixed pattern. In brief, Stereo is applicable to a variety of spatial technologies, serving as a powerful method to interrogate context-aware biological process and facilitate hierarchical signature discovery in neuroscience and computational pathology.

Position-informed contrastive learning for spatially resolved omics deciphers hierarchical tissue structure at both cellular and niche levels

Revealing Spatial Multimodal Heterogeneity in Tissues with SpaTrio

StereoMM: A Graph Fusion Model for Integrating Spatial Transcriptomic Data and Pathological Images

StereoSiTE: a framework to spatially and quantitatively profile the cellular neighborhood organized iTME

Multi-modal Spatial Clustering for Spatial Transcriptomics Utilizing High-resolution Histology Images

MuCST: restoring and integrating heterogeneous morphology images and spatial transcriptomics data with contrastive learning

StereoCell enables highly accurate single-cell segmentation for spatial transcriptomics

CellContrast: Reconstructing spatial relationships in single-cell RNA sequencing data via deep contrastive learning

Interpretable spatial cell learning enhances the characterization of patient tissue microenvironments with highly multiplexed imaging data

spatiAlign: an unsupervised contrastive learning model for data integration of spatially resolved transcriptomics

Deciphering Spatial Domains by Integrating Histopathological Image and Tran-scriptomics via Contrastive Learning

Large field of view-spatially resolved transcriptomics at nanoscale resolution

STAIG: Spatial Transcriptomics Analysis via Image-Aided Graph Contrastive Learning for Domain Exploration and Alignment-Free Integration

Stereopy: modeling comparative and spatiotemporal cellular heterogeneity via multi-sample spatial transcriptomics

conST: an interpretable multi-modal contrastive learning framework for spatial transcriptomics

Accurate, Scalable and Cross-platform Cell Identification for High-resolution Spatial Transcriptomics

stLearn: integrating spatial location, tissue morphology and gene expression to find cell types, cell-cell interactions and spatial trajectories within undissociated tissues

Spatially informed clustering, integration, and deconvolution of spatial transcriptomics with GraphST

Stmmr: Accurate and Robust Spatial Domain Identification from Spatially Resolved Transcriptomics with Multi-Modal Feature Representation

A contrastive learning approach to integrate spatial transcriptomics and histological images

Computational Modeling for Deciphering Tissue Microenvironment Heterogeneity from Spatially Resolved Transcriptomics