Abstract:Modeling single-cell perturbations is a crucial task in the field of single-cell biology. Predicting the effect of up or down gene regulation or drug treatment on the gene expression profile of a cell can open avenues in understanding biological mechanisms and potentially treating disease. Most foundation models for single-cell biology learn from scRNA-seq counts, using experimental data as a modality to generate gene representations. Similarly, the scientific literature holds a plethora of information that can be used in generating gene representations using a different modality - language - as the basis. In this work, we study the effect of using both language and experimental data in modeling genes for perturbation prediction. We show that textual representations of genes provide additive and complementary value to gene representations learned from experimental data alone in predicting perturbation outcomes for single-cell data. We find that textual representations alone are not as powerful as biologically learned gene representations, but can serve as useful prior information. We show that different types of scientific knowledge represented as language induces different types of prior knowledge. For example, in the datasets we study, subcellular location helps the most for predicting the effect of single-gene perturbations, and protein information helps the most for modeling perturbation effects of interactions of combinations of genes. We validate our findings by extending the popular scGPT model, a foundation model trained on scRNA-seq counts, to incorporate language embeddings at the gene level. We start with NCBI gene card and UniProt protein summaries from the genePT approach and add gene function annotations from the Gene Ontology (GO). We name our model "scGenePT", representing the combination of ideas from these two models. Our work sheds light on the value of integrating multiple sources of knowledge in modeling single-cell data, highlighting the effect of language in enhancing biological representations learned from experimental data.

Generative modeling and latent space arithmetics predict single-cell perturbation response across cell types, studies and species

Scgen Predicts Single-Cell Perturbation Responses

Predicting cell morphological responses to perturbations using generative modeling

Modeling and predicting single-cell multi-gene perturbation responses with scLAMBDA

Compositional perturbation autoencoder for single-cell response modeling

Learning interpretable cellular responses to complex perturbations in high-throughput screens

Machine learning for perturbational single-cell omics

Predicting Cellular Responses to Complex Perturbations in High-Throughput Screens.

scGenePT: Is language all you need for modeling single-cell perturbations?

Generative adversarial networks simulate gene expression and predict perturbations in single cells

scPreGAN, a deep generative model for predicting the response of single-cell expression to perturbation

PrePR-CT: Predicting Perturbation Responses in Unseen Cell Types Using Cell-Type-Specific Graphs

Learning to encode cellular responses to systematic perturbations with deep generative models

sc-OTGM: Single-Cell Perturbation Modeling by Solving Optimal Mass Transport on the Manifold of Gaussian Mixtures

scARE: Attribution Regularization for Single Cell Representation Learning

Modeling interpretable correspondence between cell state and perturbation response with CellCap

Modelling Cellular Perturbations with the Sparse Additive Mechanism Shift Variational Autoencoder

Comprehensive single-cell RNA-seq analysis using deep interpretable generative modeling guided by biological hierarchy knowledge

Benchmarking a foundational cell model for post-perturbation RNAseq prediction

Modeling and interpretation of single-cell proteogenomic data

Stochastic Modeling of Biophysical Responses to Perturbation