Abstract:BackgroundA fundamental fact in biology states that genes do not operate in isolation, and yet, methods that infer regulatory networks for single cell gene expression data have been slow to emerge. With single cell sequencing methods now becoming accessible, general network inference algorithms that were initially developed for data collected from bulk samples may not be suitable for single cells. Meanwhile, although methods that are specific for single cell data are now emerging, whether they have improved performance over general methods is unknown. In this study, we evaluate the applicability of five general methods and three single cell methods for inferring gene regulatory networks from both experimental single cell gene expression data and in silico simulated data.ResultsStandard evaluation metrics using ROC curves and Precision-Recall curves against reference sets sourced from the literature demonstrated that most of the methods performed poorly when they were applied to either experimental single cell data, or simulated single cell data, which demonstrates their lack of performance for this task. Using default settings, network methods were applied to the same datasets. Comparisons of the learned networks highlighted the uniqueness of some predicted edges for each method. The fact that different methods infer networks that vary substantially reflects the underlying mathematical rationale and assumptions that distinguish network methods from each other.ConclusionsThis study provides a comprehensive evaluation of network modeling algorithms applied to experimental single cell gene expression data and in silico simulated datasets where the network structure is known. Comparisons demonstrate that most of these assessed network methods are not able to predict network structures from single cell expression data accurately, even if they are specifically developed for single cell methods. Also, single cell methods, which usually depend on more elaborative algorithms, in general have less similarity to each other in the sets of edges detected. The results from this study emphasize the importance for developing more accurate optimized network modeling methods that are compatible for single cell data. Newly-developed single cell methods may uniquely capture particular features of potential gene-gene relationships, and caution should be taken when we interpret these results.

Dissecting and improving gene regulatory network inference using single-cell transcriptome data

Functional Inference of Gene Regulation Using Single-Cell Multi-Omics

A hybrid deep learning framework for gene regulatory network inference from single-cell transcriptomic data

Inferring Gene Regulatory Networks From Single-Cell Transcriptomic Data Using Bidirectional RNN

SIN-KNO: A method of gene regulatory network inference using single-cell transcription and gene knockout data

SCING: Single Cell INtegrative Gene regulatory network inference elucidates robust, interpretable gene regulatory networks

Gene regulatory network inference in the era of single-cell multi-omics

ScReNI: single-cell regulatory network inference through integrating scRNA-seq and scATAC-seq data

Gene Regulatory Network Inference with Joint Representation from Graph Neural Network and Single-Cell Foundation Model

A single-cell multimodal view on gene regulatory network inference from transcriptomics and chromatin accessibility data

How to build regulatory networks from single-cell gene expression data

Inferring gene regulatory network from single-cell transcriptomic data by integrating multiple prior networks

Inferring single-cell gene regulatory network by non-redundant mutual information

Inferring Gene Regulatory Network Based on scATAC-seq Data with Gene Perturbation

Evaluating methods of inferring gene regulatory networks highlights their lack of performance for single cell gene expression data

scGREAT: Transformer-Based Deep-Language Model for Gene Regulatory Network Inference from Single-Cell Transcriptomics

GMFGRN: a matrix factorization and graph neural network approach for gene regulatory network inference

A review on gene regulatory network reconstruction algorithms based on single cell RNA sequencing

Integrated Pipelines for Inferring Gene Regulatory Networks from Single-Cell Data

Scalable identification of lineage-specific gene regulatory networks from metacells with NetID

DeepGRNCS: deep learning-based framework for jointly inferring gene regulatory networks across cell subpopulations