Abstract:Identifying cellular identities (both novel and well-studied) is one of the key use cases in single-cell transcriptomics. While supervised machine learning has been leveraged to automate cell annotation predictions for some time, there has been relatively little progress both in scaling neural networks to large data sets and in constructing models that generalize well across diverse tissues and biological contexts up to whole organisms. Here, we propose scTab, an automated, feature-attention-based cell type prediction model specific to tabular data, and train it using a novel data augmentation scheme across a large corpus of single-cell RNA-seq observations (22.2 million human cells in total). In addition, scTab leverages deep ensembles for uncertainty quantification. Moreover, we account for ontological relationships between labels in the model evaluation to accommodate for differences in annotation granularity across datasets. On this large-scale corpus, we show that cross-tissue annotation requires nonlinear models and that the performance of scTab scales in terms of training dataset size as well as model size - demonstrating the advantage of scTab over current state-of-the-art linear models in this context. Additionally, we show that the proposed data augmentation schema improves model generalization. In summary, we introduce a de novo cell type prediction model for single-cell RNA-seq data that can be trained across a large-scale collection of curated datasets from a diverse selection of human tissues and demonstrate the benefits of using deep learning methods in this paradigm. Our codebase, training data, and model checkpoints are publicly available at https://github.com/theislab/scTab to further enable rigorous benchmarks of foundation models for single-cell RNA-seq data.

scMusketeers: Addressing imbalanced cell type annotation and batch effect reduction with a modular autoencoder

Mixed Effects Deep Learning for the interpretable analysis of single cell RNA sequencing data by quantifying and visualizing batch effects

Deciphering subcellular organization with multiplexed imaging and deep learning

scARE: Attribution Regularization for Single Cell Representation Learning

Learning Consistent Subcellular Landmarks to Quantify Changes in Multiplexed Protein Maps.

scMMT: a multi-use deep learning approach for cell annotation, protein prediction and embedding in single-cell RNA-seq data

Sctab: Scaling Cross-Tissue Single-Cell Annotation Models

Mapping Single-Cell Data to Reference Atlases by Transfer Learning

Deep feature extraction of single-cell transcriptomes by generative adversarial network

Scmoe: Single-Cell Multi-Modal Multi-Task Learning Via Sparse Mixture-of-Experts

A joint deep learning model enables simultaneous batch effect correction, denoising, and clustering in single-cell transcriptomics

Sparsely Connected Autoencoders: A Multi-Purpose Tool for Single Cell omics Analysis

Contrastive Learning for Robust Cell Annotation and Representation from Single-Cell Transcriptomics

ScMOGAE: A Graph Convolutional Autoencoder-Based Multi-omics Data Integration Framework for Single-Cell Clustering

Deep domain adversarial neural network for the deconvolution of cell type mixtures in tissue proteome profiling

A biology-driven deep generative model for cell-type annotation in cytometry

scAEGAN: Unification of single-cell genomics data by adversarial learning of latent space correspondences

Advancing single-cell RNA-seq data analysis through the fusion of multi-layer perceptron and graph neural network

scMAE: a masked autoencoder for single-cell RNA-seq clustering

scIAE: an integrative autoencoder-based ensemble classification framework for single-cell RNA-seq data

scMaui: a widely applicable deep learning framework for single-cell multiomics integration in the presence of batch effects and missing data