Abstract:Motivation: Recent advances in sequencing technology provide opportunities to study biological processes at a higher resolution. Cell type annotation is an important step in scRNA-seq analysis, which often relies on established marker genes. However, most of the previous methods divide the identification of cell types into two stages, clustering and assignment, whose performances are susceptible to the clustering algorithm, and the marker information cannot effectively guide the clustering process. Furthermore, their linear heuristic-based cell assignment process is often insufficient to capture potential dependencies between cells and types. Results: Here, we present Interpretable Cell Type Annotation based on self-training (sICTA), a marker-based cell type annotation method that combines the self-training strategy with pseudo-labeling and the nonlinear association capturing capability of Transformer. In addition, we incorporate biological priori knowledge of genes and pathways into the classifier through an attention mechanism to enhance the transparency of the model. A benchmark analysis on 11 publicly available single-cell datasets demonstrates the superiority of sICTA compared to state-of-the-art methods. The robustness of our method is further validated by evaluating the prediction accuracy of the model on different cell types for each single-cell data. Moreover, ablation studies show that self-training and the ability to capture potential dependencies between cells and cell types, both of which are mutually reinforcing, work together to improve model performance. Finally, we apply sICTA to the pancreatic dataset, exemplifying the interpretable attention matrix captured by sICTA. Availability and implementation: The source code of sICTA is available in public at https://github.com/nbnbhwyy/sICTA. The processed datasets can be found at https://drive.google.com/drive/folders/1jbqSxacL_IDIZ4uPjq220C9Kv024m9eL. The final version of the model will be permanently available at https://doi.org/10.5281/zenodo.13474010.

CIForm as a Transformer-based model for cell-type annotation of large-scale single-cell RNA-seq data

Sctab: Scaling Cross-Tissue Single-Cell Annotation Models

TransCluster: A Cell-Type Identification Method for single-cell RNA-Seq data using deep learning based on transformer

CASSIA allows for robust, automated cell annotation in single-cell RNA-sequencing data

scGAA: a general gated axial-attention model for accurate cell-type annotation of single-cell RNA-seq data

A self-training interpretable cell type annotation framework using specific marker gene

Transformer for one stop interpretable cell type annotation

CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells

Imbalance and Composition Correction Ensemble Learning Framework (ICCELF): A novel framework for automated scRNA-seq cell type annotation

EnClaSC: a novel ensemble approach for accurate and robust cell-type classification of single-cell transcriptomes

Scaling Dense Representations for Single Cell with Transcriptome-Scale Context

TripletCell: a deep metric learning framework for accurate annotation of cell types at the single-cell level

Transformer-based Single-Cell Language Model: A Survey

scAnno: a deconvolution strategy-based automatic cell type annotation tool for single-cell RNA-sequencing data sets

Objectively Evaluating the Reliability of Cell Type Annotation Using LLM-Based Strategies

Single-Cell Omics Arena: A Benchmark Study for Large Language Models on Cell Type Annotation Using Single-Cell Data

CIA: a Cluster Independent Annotation method to investigate cell identities in scRNA-seq data

Large-scale foundation model on single-cell transcriptomics

Integration and transfer learning of single-cell transcriptomes via cFIT

scInterpreter: Training Large Language Models to Interpret scRNA-seq Data for Cell Type Annotation

scRCA: a Siamese network-based pipeline for the annotation of cell types using imperfect single-cell RNA-seq reference data