Abstract:Motivation: Recent advances in sequencing technology provide opportunities to study biological processes at a higher resolution. Cell type annotation is an important step in scRNA-seq analysis, which often relies on established marker genes. However, most of the previous methods divide the identification of cell types into two stages, clustering and assignment, whose performances are susceptible to the clustering algorithm, and the marker information cannot effectively guide the clustering process. Furthermore, their linear heuristic-based cell assignment process is often insufficient to capture potential dependencies between cells and types. Results: Here, we present Interpretable Cell Type Annotation based on self-training (sICTA), a marker-based cell type annotation method that combines the self-training strategy with pseudo-labeling and the nonlinear association capturing capability of Transformer. In addition, we incorporate biological priori knowledge of genes and pathways into the classifier through an attention mechanism to enhance the transparency of the model. A benchmark analysis on 11 publicly available single-cell datasets demonstrates the superiority of sICTA compared to state-of-the-art methods. The robustness of our method is further validated by evaluating the prediction accuracy of the model on different cell types for each single-cell data. Moreover, ablation studies show that self-training and the ability to capture potential dependencies between cells and cell types, both of which are mutually reinforcing, work together to improve model performance. Finally, we apply sICTA to the pancreatic dataset, exemplifying the interpretable attention matrix captured by sICTA. Availability and implementation: The source code of sICTA is available in public at https://github.com/nbnbhwyy/sICTA. The processed datasets can be found at https://drive.google.com/drive/folders/1jbqSxacL_IDIZ4uPjq220C9Kv024m9eL. The final version of the model will be permanently available at https://doi.org/10.5281/zenodo.13474010.

SCTrans: Multi-scale Scrna-Seq Sub-vector Completion Transformer for Gene-selective Cell Type Annotation

Sctranssort: Transformers for Intelligent Annotation of Cell Types by Gene Embeddings.

Sctab: Scaling Cross-Tissue Single-Cell Annotation Models

TransCluster: A Cell-Type Identification Method for single-cell RNA-Seq data using deep learning based on transformer

xTrimoGene: An Efficient and Scalable Representation Learner for Single-Cell RNA-Seq Data

A self-training interpretable cell type annotation framework using specific marker gene

scGREAT: Transformer-Based Deep-Language Model for Gene Regulatory Network Inference from Single-Cell Transcriptomics

scGAA: a general gated axial-attention model for accurate cell-type annotation of single-cell RNA-seq data

Transformer for one stop interpretable cell type annotation

Scact: Accurate Cross-modality Translation Via Cycle-consistent Training from Unpaired Single-cell Data

Scgat: A Cell-Type Annotation Framework for Single-Cell Transcriptomics Using Graph Attention Network and Meta Learning

Deciphering cell types by integrating scATAC-seq data with genome sequences

scTCA: a hybrid Transformer-CNN architecture for imputation and denoising of scDNA-seq data

scMMT: a multi-use deep learning approach for cell annotation, protein prediction and embedding in single-cell RNA-seq data

CIForm as a Transformer-based model for cell-type annotation of large-scale single-cell RNA-seq data

scCTS: identifying the cell type-specific marker genes from population-level single-cell RNA-seq

SuperCT: a supervised-learning framework for enhanced characterization of single-cell transcriptomic profiles.

Scwecta: A Weighted Ensemble Classification Framework for Cell Type Assignment Based on Single Cell Transcriptome

stEnTrans: Transformer-based deep learning for spatial transcriptomics enhancement

scGraphformer: unveiling cellular heterogeneity and interactions in scRNA-seq data using a scalable graph transformer network

Translator: A Transfer Learning Approach to Facilitate Single-Cell ATAC-Seq Data Analysis from Reference Dataset