Abstract:Motivation: Rapidly generated scRNA-seq datasets enable us to understand cellular differences and the function of each individual cell at single-cell resolution. Cell-type classification, which aims at characterizing and labeling groups of cells according to their gene expression, is one of the most important steps for single-cell analysis. To facilitate the manual curation process, supervised learning methods have been used to automatically classify cells. Most of the existing supervised learning approaches only utilize annotated cells in the training step while ignoring the more abundant unannotated cells. In this article, we proposed scPretrain, a multi-task self-supervised learning approach that jointly considers annotated and unannotated cells for cell-type classification. scPretrain consists of a pre-training step and a fine-tuning step. In the pre-training step, scPretrain uses a multi-task learning framework to train a feature extraction encoder based on each dataset's pseudo-labels, where only unannotated cells are used. In the fine-tuning step, scPretrain fine-tunes this feature extraction encoder using the limited annotated cells in a new dataset. Results: We evaluated scPretrain on 60 diverse datasets from different technologies, species and organs, and obtained a significant improvement on both cell-type classification and cell clustering. Moreover, the representations obtained by scPretrain in the pre-training step also enhanced the performance of conventional classifiers, such as random forest, logistic regression and support-vector machines. scPretrain is able to effectively utilize the massive amount of unlabeled data and be applied to annotating increasingly generated scRNA-seq datasets. Availability and implementation: The data and code underlying this article are available in scPretrain: Multi-task self-supervised learning for cell type classification, at https://github.com/ruiyi-zhang/scPretrain and https://zenodo.org/record/5802306. Supplementary information: Supplementary data are available at Bioinformatics online.

scSwinTNet: A Cell Type Annotation Method for Large-Scale Single-Cell RNA-Seq Data Based on Shifted Window Attention

scAnno: a deconvolution strategy-based automatic cell type annotation tool for single-cell RNA-sequencing data sets

Sctab: Scaling Cross-Tissue Single-Cell Annotation Models

scDeepSort: a pre-trained cell-type annotation method for single-cell transcriptomics using deep learning with a weighted graph neural network

scGAA: a general gated axial-attention model for accurate cell-type annotation of single-cell RNA-seq data

Scgat: A Cell-Type Annotation Framework for Single-Cell Transcriptomics Using Graph Attention Network and Meta Learning

Generalized Cell Type Annotation and Discovery for Single-Cell RNA-Seq Data

Realistic Cell Type Annotation and Discovery for Single-cell RNA-seq Data

Reference-free Cell-type Annotation for Single-cell Transcriptomics using Deep Learning with a Weighted Graph Neural Network

Deciphering cell types by integrating scATAC-seq data with genome sequences

scATAnno: Automated Cell Type Annotation for single-cell ATAC Sequencing Data

Automatic Cell Type Annotation Using Marker Genes for Single-Cell RNA Sequencing Data

Scellseg: a Style-Aware Cell Instance Segmentation Tool with Pre-Training and Contrastive Fine-Tuning

Automatically Detecting Anchor Cells and Clustering for scRNA-Seq Data Using scTSNN

Scemail: Universal and Source-free Annotation Method for Scrna-Seq Data with Novel Cell-type Perception.

SCSA: A Cell Type Annotation Tool for Single-Cell RNA-seq Data

scAnnotatR: framework to accurately classify cell types in single-cell RNA-sequencing data

Automated cell annotation in scRNA-seq data using unique marker gene sets

Attention Based Models for Cell Type Classification on Single-Cell RNA-Seq Data.

scPretrain: multi-task self-supervised learning for cell-type classification

SCINA: Semi-Supervised Analysis of Single Cells in silico