Abstract:Over the past decade, the revolution in single-cell sequencing has enabled the simultaneous molecular profiling of various modalities across thousands of individual cells, allowing scientists to investigate the diverse functions of complex tissues and uncover underlying disease mechanisms. Among all the analytical steps, assigning individual cells to specific types is fundamental for understanding cellular heterogeneity. However, this process is usually labor-intensive and requires extensive expert knowledge. Recent advances in large language models (LLMs) have demonstrated their ability to efficiently process and synthesize vast corpora of text to automatically extract essential biological knowledge, such as marker genes, potentially promoting more efficient and automated cell type annotations. To thoroughly evaluate the capability of modern instruction-tuned LLMs in automating the cell type identification process, we introduce SOAR, a comprehensive benchmarking study of LLMs for cell type annotation tasks in single-cell genomics. Specifically, we assess the performance of 8 instruction-tuned LLMs across 11 datasets, spanning multiple cell types and species. Our study explores the potential of LLMs to accurately classify and annotate cell types in single-cell RNA sequencing (scRNA-seq) data, while extending their application to multiomics data through cross-modality translation. Additionally, we evaluate the effectiveness of chain-of-thought (CoT) prompting techniques in generating detailed biological insights during the annotation process. The results demonstrate that LLMs can provide robust interpretations of single-cell data without requiring additional fine-tuning, advancing the automation of cell type annotation in genomics research.

The Development of AI Foundation Models for Single-Cell Transcriptomics

Large-scale foundation model on single-cell transcriptomics

CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells

scGPT: toward building a foundation model for single-cell multi-omics using generative AI

scGPT: Towards Building a Foundation Model for Single-Cell Multi-omics Using Generative AI

BioLLM: A Standardized Framework for Integrating and Benchmarking Single-Cell Foundation Models

scInterpreter: Training Large Language Models to Interpret scRNA-seq Data for Cell Type Annotation

How do Large Language Models understand Genes and Cells

Single-Cell Omics Arena: A Benchmark Study for Large Language Models on Cell Type Annotation Using Single-Cell Data

scLong: A Billion-Parameter Foundation Model for Capturing Long-Range Gene Context in Single-Cell Transcriptomics

Harnessing the deep learning power of foundation models in single-cell omics

Foundation models in molecular biology

Large-scale Foundation Models and Generative AI for BigData Neuroscience

scELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis

Deep-learning methods for unveiling large-scale single-cell transcriptomes

Toward mastering the cell language by learning to generate

ChatCell: Facilitating Single-Cell Analysis with Natural Language

Scaling Dense Representations for Single Cell with Transcriptome-Scale Context

Transformer-based Single-Cell Language Model: A Survey

LucaOne: Generalized Biological Foundation Model with Unified Nucleic Acid and Protein Language