Abstract:Motivation: Rapidly generated scRNA-seq datasets enable us to understand cellular differences and the function of each individual cell at single-cell resolution. Cell-type classification, which aims at characterizing and labeling groups of cells according to their gene expression, is one of the most important steps for single-cell analysis. To facilitate the manual curation process, supervised learning methods have been used to automatically classify cells. Most of the existing supervised learning approaches only utilize annotated cells in the training step while ignoring the more abundant unannotated cells. In this article, we proposed scPretrain, a multi-task self-supervised learning approach that jointly considers annotated and unannotated cells for cell-type classification. scPretrain consists of a pre-training step and a fine-tuning step. In the pre-training step, scPretrain uses a multi-task learning framework to train a feature extraction encoder based on each dataset's pseudo-labels, where only unannotated cells are used. In the fine-tuning step, scPretrain fine-tunes this feature extraction encoder using the limited annotated cells in a new dataset. Results: We evaluated scPretrain on 60 diverse datasets from different technologies, species and organs, and obtained a significant improvement on both cell-type classification and cell clustering. Moreover, the representations obtained by scPretrain in the pre-training step also enhanced the performance of conventional classifiers, such as random forest, logistic regression and support-vector machines. scPretrain is able to effectively utilize the massive amount of unlabeled data and be applied to annotating increasingly generated scRNA-seq datasets. Availability and implementation: The data and code underlying this article are available in scPretrain: Multi-task self-supervised learning for cell type classification, at https://github.com/ruiyi-zhang/scPretrain and https://zenodo.org/record/5802306. Supplementary information: Supplementary data are available at Bioinformatics online.

SuperCT: a supervised-learning framework for enhanced characterization of single-cell transcriptomic profiles.

Integrating Deep Supervised, Self-Supervised and Unsupervised Learning for Single-Cell RNA-seq Clustering and Annotation

Evaluation of some aspects in supervised cell type identification for single-cell RNA-seq: classifier, feature selection, and reference construction

EnClaSC: a novel ensemble approach for accurate and robust cell-type classification of single-cell transcriptomes

scCTS: identifying the cell type-specific marker genes from population-level single-cell RNA-seq

A Hybrid Deep Clustering Approach for Robust Cell Type Profiling Using Single-cell RNA-seq Data

Scwecta: A Weighted Ensemble Classification Framework for Cell Type Assignment Based on Single Cell Transcriptome

CTISL: a dynamic stacking multi-class classification approach for identifying cell types from single-cell RNA-seq data

An Adaptive Sparse Subspace Clustering for Cell Type Identification.

scClassify: sample size estimation and multiscale classification of cells using single and multiple reference

SCINA: Semi-Supervised Analysis of Single Cells in silico

SCTrans: Multi-scale Scrna-Seq Sub-vector Completion Transformer for Gene-selective Cell Type Annotation

scPretrain: multi-task self-supervised learning for cell-type classification

Learning multi-cellular representations of single-cell transcriptomics data enables characterization of patient-level disease states

TransCluster: A Cell-Type Identification Method for single-cell RNA-Seq data using deep learning based on transformer

scASGC: An adaptive simplified graph convolution model for clustering single-cell RNA-seq data

A Message Passing Framework for Precise Cell State Identification with scClassify2

A New Graph Autoencoder-Based Multi-level Kernel Subspace Fusion Framework for Single-cell Type Identification

scAnno: a deconvolution strategy-based automatic cell type annotation tool for single-cell RNA-sequencing data sets

Topological identification and interpretation for single-cell gene regulation elucidation across multiple platforms using scMGCA

Accurate, Scalable and Cross-platform Cell Identification for High-resolution Spatial Transcriptomics