Abstract:With continuous progress of single-cell chromatin accessibility profiling techniques, scATAC-seq has become more commonly used in investigating regulatory genomic regions and their involvement in developmental, evolutionary, and disease-related processes. At the same time, accurate cell type annotation plays a crucial role in comprehending the cellular makeup of complex tissues and uncovering novel cell types. Unfortunately, the majority of existing methods primarily focus on label transfer within scRNA-seq datasets and only a limited number of approaches have been specifically developed for transferring labels from scRNA-seq to scATAC-seq data. Moreover, many methods have been published for the joint embedding of data from the two modalities, which can be used for label transfer by adding a classifier trained on the latent space. Given these available methods, this study presents a comprehensive benchmarking study evaluating 27 computational tools for scATAC-seq label annotations through tasks involving single-cell RNA and ATAC data from various human and mouse tissues. We found that when high quality paired data were available to transfer labels across unpaired data, Bridge and GLUE were the best performers; otherwise, bindSC and GLUE achieved the highest prediction accuracy overall. All these methods were able to use peak-level information instead of purely relying on the gene activities from scATAC-seq. Furthermore, we found that data imbalance, cross-omics dissimilarity on common cell types, data binarization, and the introduction of semi-supervised strategy usually had negative impacts on model performance. In terms of scalability, we found that the most time and memory efficient methods were Bridge and deep-learning-based algorithms like GLUE. Based on the results of this study, we provide several suggestions for future methodology development.

scReadSim: a single-cell RNA-seq and ATAC-seq read simulator

SCAN-ATAC-Sim: a scalable and efficient method for simulating single-cell ATAC-seq data from bulk-tissue experiments

Scart: Recognizing Cell Clusters and Constructing Trajectory from Single-Cell Epigenomic Data

simCAS: an embedding-based method for simulating single-cell chromatin accessibility sequencing data

SCSsim: an Integrated Tool for Simulating Single-Cell Genome Sequencing Data.

AsaruSim: a single-cell and spatial RNA-Seq Nanopore long-reads simulation workflow

Schi-Csim: a Flexible Simulator That Generates High-Fidelity Single-Cell Hi-C Data for Benchmarking

Systematic evaluation with practical guidelines for single-cell and spatially resolved transcriptomics data simulation under multiple scenarios

SimReadUntil for Benchmarking Selective Sequencing Algorithms on ONT Devices

The shaky foundations of simulating single-cell RNA sequencing data

Enhancement and Imputation of Peak Signal Enables Accurate Cell-Type Classification in scATAC-seq

Systematic benchmarking of single-cell ATAC-sequencing protocols

SimCH: simulation of single-cell RNA sequencing data by modeling cellular heterogeneity at gene expression level

SimuSCoP: Reliably Simulate Illumina Sequencing Data Based on Position and Context Dependent Profiles

A Comprehensive Benchmarking Study on Computational Tools for Cross-omics Label Transfer from Single-cell RNA to ATAC Data

Benchmarking algorithms for gene set scoring of single-cell ATAC-seq data

GLMsim: a GLM-based single cell RNA-seq simulator incorporating batch and biological effects

scDesign2: a transparent simulator that generates high-fidelity single-cell gene expression count data with gene correlations captured

Scrnass: a Single-Cell RNA-seq Assembler Via Imputing Dropouts and Combing Junctions

Art: A Next-Generation Sequencing Read Simulator

SnapATAC: A Comprehensive Analysis Package for Single Cell ATAC-seq