Evaluation of Kernfeld et al.: Toward best practices for tackling false positives in regulatory network inference

Anthony Gitter

DOI: https://doi.org/10.1016/j.cels.2024.07.009

2024-08-21

Abstract:One snapshot of the peer review process for "Transcriptome data are insufficient to control false discoveries in regulatory network inference" (Kernfeld et al., 2024).1.

What problem does this paper attempt to address?

Transcriptome data are insufficient to control false discoveries in regulatory network inference

Eric Kernfeld,Rebecca Keener,Patrick Cahan,Alexis Battle

DOI: https://doi.org/10.1016/j.cels.2024.07.006

2024-08-21

Abstract:Inference of causal transcriptional regulatory networks (TRNs) from transcriptomic data suffers notoriously from false positives. Approaches to control the false discovery rate (FDR), for example, via permutation, bootstrapping, or multivariate Gaussian distributions, suffer from several complications: difficulty in distinguishing direct from indirect regulation, nonlinear effects, and causal structure inference requiring "causal sufficiency," meaning experiments that are free of any unmeasured, confounding variables. Here, we use a recently developed statistical framework, model-X knockoffs, to control the FDR while accounting for indirect effects, nonlinear dose-response, and user-provided covariates. We adjust the procedure to estimate the FDR correctly even when measured against incomplete gold standards. However, benchmarking against chromatin immunoprecipitation (ChIP) and other gold standards reveals higher observed than reported FDR. This indicates that unmeasured confounding is a major driver of FDR in TRN inference. A record of this paper's transparent peer review process is included in the supplemental information.
A Novel Technique for Reduction of False Positives in Predicted Gene Regulatory Networks

Abhinandan Khan,Goutam Saha,Rajat Kumar Pal

DOI: https://doi.org/10.1007/978-3-319-44332-4_6

2016-01-01

Abstract:In this paper, we have proposed a novel method for the reduction of the number of inferred false positives in gene regulatory networks, constructed from time-series microarray genetic expression datasets. We have implemented a hybrid statistical/swarm intelligence technique for the purpose of reverse engineering genetic networks from temporal expression data. The theory of combination has been used to reduce the search space of network topologies effectively. Recurrent neural networks have been employed to obtain the underlying dynamics of the expression data accurately. Two swarm intelligence techniques, namely, Particle Swarm Optimisation and a Bat Algorithm inspired variant of the same, have been used to train the corresponding model parameters. Subsequently, we have identified and used their common portions to construct a final network where the incorrect predictions have been filtered out. We have done preliminary investigations on experimental (in vivo) data sets of the real-world SOS DNA repair network in Escherichia coli. Furthermore, we have implemented our proposed algorithm on medium-scale networks, consisting of 10 and 20 genes. Experimental results are quite encouraging, and they suggest that the proposed methodology is capable of reducing the number of false positives, thus, increasing the overall accuracy and the biological plausibility of the predicted genetic networks.
Unexpected links reflect the noise in networks

Anatoly Yambartsev,Michael A. Perlin,Yevgeniy Kovchegov,Natalia Shulzhenko,Karina L. Mine,Xiaoxi Dong,Andrey Morgun

DOI: https://doi.org/10.1186/s13062-016-0155-0

2016-10-13

Biology Direct

Abstract:BackgroundGene covariation networks are commonly used to study biological processes. The inference of gene covariation networks from observational data can be challenging, especially considering the large number of players involved and the small number of biological replicates available for analysis.ResultsWe propose a new statistical method for estimating the number of erroneous edges in reconstructed networks that strongly enhances commonly used inference approaches. This method is based on a special relationship between sign of correlation (positive/negative) and directionality (up/down) of gene regulation, and allows for the identification and removal of approximately half of all erroneous edges. Using the mathematical model of Bayesian networks and positive correlation inequalities we establish a mathematical foundation for our method. Analyzing existing biological datasets, we find a strong correlation between the results of our method and false discovery rate (FDR). Furthermore, simulation analysis demonstrates that our method provides a more accurate estimate of network error than FDR.ConclusionsThus, our study provides a new robust approach for improving reconstruction of covariation networks.ReviewersThis article was reviewed by Eugene Koonin, Sergei Maslov, Daniel Yasumasa Takahashi.

biology
Improving Network Inference: The Impact of False Positive and False Negative Conclusions about the Presence or Absence of Links

Gloria Cecchini,Marco Thiel,Bjoern Schelter,Linda Sommerlade

DOI: https://doi.org/10.1016/j.jneumeth.2018.06.011

2018-06-26

Abstract:A reliable inference of networks from data is of key interest in the Neurosciences. Several methods have been suggested in the literature to reliably determine links in a network. To decide about the presence of links, these techniques rely on statistical inference, typically controlling the number of false positives, paying little attention to false negatives. In this paper, by means of a comprehensive simulation study, we analyse the influence of false positive and false negative conclusions about the presence or absence of links in a network on the network topology. We show that different values to balance false positive and false negative conclusions about links should be used in order to reliably estimate network characteristics. We propose to run careful simulation studies prior to making potentially erroneous conclusion about the network topology. Our analysis shows that optimal values to balance false positive and false negative conclusions about links depend on the network topology and characteristic of interest. Existing methods rely on a choice of the rate for false positive conclusions. They aim to be sure about individual links rather than the entire network. The rate of false negative conclusions is typically not investigated. Our investigation shows that the balance of false positive and false negative conclusions about links in a network has to be tuned for any network topology that is to be estimated. Moreover, within the same network topology, the results are qualitatively the same for each network characteristic, but the actual values leading to reliable estimates of the characteristics are different.

Physics and Society,Data Analysis, Statistics and Probability
Benchmarking algorithms for gene regulatory network inference from single-cell transcriptomic data

Aditya Pratapa,Amogh P. Jalihal,Jeffrey N. Law,Aditya Bharadwaj,T. M. Murali

DOI: https://doi.org/10.1038/s41592-019-0690-6

IF: 48

2020-01-06

Nature Methods

Abstract:We present a systematic evaluation of state-of-the-art algorithms for inferring gene regulatory networks from single-cell transcriptional data. As the ground truth for assessing accuracy, we use synthetic networks with predictable trajectories, literature-curated Boolean models and diverse transcriptional regulatory networks. We develop a strategy to simulate single-cell transcriptional data from synthetic and Boolean networks that avoids pitfalls of previously used methods. Furthermore, we collect networks from multiple experimental single-cell RNA-seq datasets. We develop an evaluation framework called BEELINE. We find that the area under the precision-recall curve and early precision of the algorithms are moderate. The methods are better in recovering interactions in synthetic networks than Boolean models. The algorithms with the best early precision values for Boolean models also perform well on experimental datasets. Techniques that do not require pseudotime-ordered cells are generally more accurate. Based on these results, we present recommendations to end users. BEELINE will aid the development of gene regulatory network inference algorithms.

biochemical research methods
Controlling false discoveries in Bayesian gene networks with lasso regression p-values

Lingfei Wang,Tom Michoel

DOI: https://doi.org/10.1101/288217

2018-03-27

Abstract:Abstract Motivation Bayesian networks can represent directed gene regulations and therefore are favored over co-expression networks. However, hardly any Bayesian network study concerns the false discovery control (FDC) of network edges, leading to low accuracies due to systematic biases from inconsistent false discovery levels in the same study. Results We design four empirical tests to examine the FDC of Bayesian networks from three p -value based lasso regression variable selections — two existing and one we originate. Our method, lassopv , computes p -values for the critical regularization strength at which a predictor starts to contribute to lasso regression. Using null and Geuvadis datasets, we find that lassopv obtains optimal FDC in Bayesian gene networks, whilst existing methods have defective p -values. The FDC concept and tests extend to most network inference scenarios and will guide the design and improvement of new and existing methods. Our novel variable selection method with lasso regression also allows FDC on other datasets and questions, even beyond network inference and computational biology. Availability Lassopv is implemented in R and freely available at https://github.com/lingfeiwang/lassopv and https://cran.r-project.org/package=lassopv . Contact Lingfei.Wang@roslin.ed.ac.uk Supplementary information Supplementary data are available at Bioinformatics online.
Detecting signal from science:The structure of research communities and prior knowledge improves prediction of genetic regulatory experiments

Alexander V. Belikov,Andrey Rzhetsky,James Evans

DOI: https://doi.org/10.48550/arXiv.2008.09985

2020-08-23

Social and Information Networks

Abstract:The explosive growth of scientists, scientific journals, articles and findings in recent years exponentially increases the difficulty scientists face in navigating prior knowledge. This challenge is exacerbated by uncertainty about the reproducibility of published findings. The availability of massive digital archives, machine reading and extraction tools on the one hand, and automated high-throughput experiments on the other, allow us to evaluate these challenges at scale and identify novel opportunities for accelerating scientific advance. Here we demonstrate a Bayesian calculus that enables the positive prediction of robust, replicable scientific claims with findings automatically extracted from published literature on gene interactions. We matched these findings, filtered by science, with unfiltered gene interactions measured by the massive LINCS L1000 high-throughput experiment to identify and counteract sources of bias. Our calculus is built on easily extracted publication meta-data regarding the position of a scientific claim within the web of prior knowledge, and its breadth of support across institutions, authors and communities, revealing that scientifically focused but socially and institutionally independent research activity is most likely to replicate. These findings recommend policies that go against the common practice of channeling biomedical research funding into centralized research consortia and institutes rather than dispersing it more broadly. Our results demonstrate that robust scientific findings hinge upon a delicate balance of shared focus and independence, and that this complex pattern can be computationally exploited to decode bias and predict the replicability of published findings. These insights provide guidance for scientists navigating the research literature and for science funders seeking to improve it.
Identifying strengths and weaknesses of methods for computational network inference from single-cell RNA-seq data

Sunnie Grace McCalla,Alireza Fotuhi Siahpirani,Jiaxin Li,Saptarshi Pyne,Matthew Stone,Viswesh Periyasamy,Junha Shin,Sushmita Roy

DOI: https://doi.org/10.1093/g3journal/jkad004

2023-01-10

G3 Genes|Genomes|Genetics

Abstract:Abstract Single-cell RNA-sequencing (scRNA-seq) offers unparalleled insight into the transcriptional programs of different cellular states by measuring the transcriptome of thousands of individual cells. An emerging problem in the analysis of scRNA-seq is the inference of transcriptional gene regulatory networks and a number of methods with different learning frameworks have been developed to address this problem. Here, we present an expanded benchmarking study of eleven recent network inference methods on seven published scRNA-seq datasets in human, mouse, and yeast considering different types of gold standard networks and evaluation metrics. We evaluate methods based on their computing requirements as well as on their ability to recover the network structure. We find that, while most methods have a modest recovery of experimentally derived interactions based on global metrics such as Area Under the Precision Recall curve, methods are able to capture targets of regulators that are relevant to the system under study. Among the top performing methods that use only expression were SCENIC, PIDC, MERLIN or Correlation. Addition of prior biological knowledge and the estimation of transcription factor activities resulted in the best overall performance with the Inferelator and MERLIN methods that use prior knowledge outperforming methods that use expression alone. We found that imputation for network inference did not improve network inference accuracy and could be detrimental. Comparisons of inferred networks for comparable bulk conditions showed that the networks inferred from scRNA-seq datasets are often better or at par with the networks inferred from bulk datasets. Our analysis should be beneficial in selecting methods for network inference. At the same time, this highlights the need for improved methods and better gold standards for regulatory network inference from scRNAseq datasets.

genetics & heredity
A practical guide to methods controlling false discoveries in computational biology

Keegan Korthauer,Patrick K. Kimes,Claire Duvallet,Alejandro Reyes,Ayshwarya Subramanian,Mingxiang Teng,Chinmay Shukla,Eric J. Alm,Stephanie C. Hicks

DOI: https://doi.org/10.1186/s13059-019-1716-1

IF: 17.906

2019-06-04

Genome Biology

Abstract:<h3>Background</h3><p>In high-throughput studies, hundreds to millions of hypotheses are typically tested. Statistical methods that control the false discovery rate (FDR) have emerged as popular and powerful tools for error rate control. While classic FDR methods use only <em>p</em> values as input, more modern FDR methods have been shown to increase power by incorporating complementary information as informative covariates to prioritize, weight, and group hypotheses. However, there is currently no consensus on how the modern methods compare to one another. We investigate the accuracy, applicability, and ease of use of two classic and six modern FDR-controlling methods by performing a systematic benchmark comparison using simulation studies as well as six case studies in computational biology.</p><h3>Results</h3><p>Methods that incorporate informative covariates are modestly more powerful than classic approaches, and do not underperform classic approaches, even when the covariate is completely uninformative. The majority of methods are successful at controlling the FDR, with the exception of two modern methods under certain settings. Furthermore, we find that the improvement of the modern FDR methods over the classic methods increases with the informativeness of the covariate, total number of hypothesis tests, and proportion of truly non-null hypotheses.</p><h3>Conclusions</h3><p>Modern FDR methods that use an informative covariate provide advantages over classic FDR-controlling procedures, with the relative gain dependent on the application and informativeness of available covariates. We present our findings as a practical guide and provide recommendations to aid researchers in their choice of methods to correct for false discoveries.</p>

genetics & heredity,biotechnology & applied microbiology
Evaluating the Reproducibility of Single-Cell Gene Regulatory Network Inference Algorithms

Yoonjee Kang,Denis Thieffry,Laura Cantini

DOI: https://doi.org/10.3389/fgene.2021.617282

IF: 3.7

2021-03-22

Frontiers in Genetics

Abstract:Networks are powerful tools to represent and investigate biological systems. The development of algorithms inferring regulatory interactions from functional genomics data has been an active area of research. With the advent of single-cell RNA-seq data (scRNA-seq), numerous methods specifically designed to take advantage of single-cell datasets have been proposed. However, published benchmarks on single-cell network inference are mostly based on simulated data. Once applied to real data, these benchmarks take into account only a small set of genes and only compare the inferred networks with an imposed ground-truth. Here, we benchmark six single-cell network inference methods based on their reproducibility, i.e., their ability to infer similar networks when applied to two independent datasets for the same biological condition. We tested each of these methods on real data from three biological conditions: human retina, T-cells in colorectal cancer, and human hematopoiesis. Once taking into account networks with up to 100,000 links, GENIE3 results to be the most reproducible algorithm and, together with GRNBoost2, show higher intersection with ground-truth biological interactions. These results are independent from the single-cell sequencing platform, the cell type annotation system and the number of cells constituting the dataset. Finally, GRNBoost2 and CLR show more reproducible performance once a more stringent thresholding is applied to the networks (1,000–100 links). In order to ensure the reproducibility and ease extensions of this benchmark study, we implemented all the analyses in scNET, a Jupyter notebook available at https://github.com/ComputationalSystemsBiology/scNET .

genetics & heredity
Evaluating methods of inferring gene regulatory networks highlights their lack of performance for single cell gene expression data

Shuonan Chen,Jessica C. Mar

DOI: https://doi.org/10.1186/s12859-018-2217-z

IF: 3.307

2018-06-19

BMC Bioinformatics

Abstract:BackgroundA fundamental fact in biology states that genes do not operate in isolation, and yet, methods that infer regulatory networks for single cell gene expression data have been slow to emerge. With single cell sequencing methods now becoming accessible, general network inference algorithms that were initially developed for data collected from bulk samples may not be suitable for single cells. Meanwhile, although methods that are specific for single cell data are now emerging, whether they have improved performance over general methods is unknown. In this study, we evaluate the applicability of five general methods and three single cell methods for inferring gene regulatory networks from both experimental single cell gene expression data and in silico simulated data.ResultsStandard evaluation metrics using ROC curves and Precision-Recall curves against reference sets sourced from the literature demonstrated that most of the methods performed poorly when they were applied to either experimental single cell data, or simulated single cell data, which demonstrates their lack of performance for this task. Using default settings, network methods were applied to the same datasets. Comparisons of the learned networks highlighted the uniqueness of some predicted edges for each method. The fact that different methods infer networks that vary substantially reflects the underlying mathematical rationale and assumptions that distinguish network methods from each other.ConclusionsThis study provides a comprehensive evaluation of network modeling algorithms applied to experimental single cell gene expression data and in silico simulated datasets where the network structure is known. Comparisons demonstrate that most of these assessed network methods are not able to predict network structures from single cell expression data accurately, even if they are specifically developed for single cell methods. Also, single cell methods, which usually depend on more elaborative algorithms, in general have less similarity to each other in the sets of edges detected. The results from this study emphasize the importance for developing more accurate optimized network modeling methods that are compatible for single cell data. Newly-developed single cell methods may uniquely capture particular features of potential gene-gene relationships, and caution should be taken when we interpret these results.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
A multifactorial evaluation framework for gene regulatory network reconstruction

Laurent Mombaerts,Atte Aalto,Johan Markdahl,Jorge Goncalves

DOI: https://doi.org/10.48550/arXiv.1906.12243

2019-06-28

Abstract:In the past years, many computational methods have been developed to infer the structure of gene regulatory networks from time-series data. However, the applicability and accuracy presumptions of such algorithms remain unclear due to experimental heterogeneity. This paper assesses the performance of recent and successful network inference strategies under a novel, multifactorial evaluation framework in order to highlight pragmatic tradeoffs in experimental design. The effects of data quantity and systems perturbations are addressed, thereby formulating guidelines for efficient resource management. Realistic data were generated from six widely used benchmark models of rhythmic and non-rhythmic gene regulatory systems with random perturbations mimicking the effect of gene knock-out or chemical treatments. Then, time-series data of increasing lengths were provided to five state-of-the-art network inference algorithms representing distinctive mathematical paradigms. The performances of such network reconstruction methodologies are uncovered under various experimental conditions. We report that the algorithms do not benefit equally from data increments. Furthermore, for rhythmic systems, it is more profitable for network inference strategies to be run on long time-series rather than short time-series with multiple perturbations. By contrast, for the non-rhythmic systems, increasing the number of perturbation experiments yielded better results than increasing the sampling frequency. We expect that future benchmark and algorithm design would integrate such multifactorial considerations to promote their widespread and conscientious usage.

Molecular Networks,Dynamical Systems,Quantitative Methods
Supervised, semi-supervised and unsupervised inference of gene regulatory networks

Stefan R Maetschke,Piyush B Madhamshettiwar,Melissa J Davis,Mark A Ragan,S. R. Maetschke,P. B. Madhamshettiwar,M. J. Davis,M. A. Ragan

DOI: https://doi.org/10.1093/bib/bbt034

IF: 9.5

2013-05-21

Briefings in Bioinformatics

Abstract:Inference of gene regulatory network from expression data is a challenging task. Many methods have been developed to this purpose but a comprehensive evaluation that covers unsupervised, semi-supervised and supervised methods, and provides guidelines for their practical application, is lacking. We performed an extensive evaluation of inference methods on simulated and experimental expression data. The results reveal low prediction accuracies for unsupervised techniques with the notable exception of the Z-SCORE method on knockout data. In all other cases, the supervised approach achieved the highest accuracies and even in a semi-supervised setting with small numbers of only positive samples, outperformed the unsupervised techniques.

biochemical research methods,mathematical & computational biology
A Posterior Probability Approach for Gene Regulatory Network Inference in Genetic Perturbation Data

William Chad Young,Ka Yee Yeung,Adrian E. Raftery

DOI: https://doi.org/10.48550/arXiv.1603.04835

2016-03-16

Abstract:Inferring gene regulatory networks is an important problem in systems biology. However, these networks can be hard to infer from experimental data because of the inherent variability in biological data as well as the large number of genes involved. We propose a fast, simple method for inferring regulatory relationships between genes from knockdown experiments in the NIH LINCS dataset by calculating posterior probabilities, incorporating prior information. We show that the method is able to find previously identified edges from TRANSFAC and JASPAR and discuss the merits and limitations of this approach.

Applications,Genomics
Inferring Cell-Type-Specific Co-Expressed Genes from Single Cell Data

Xinning Shan,Hongyu Zhao

DOI: https://doi.org/10.1101/2024.11.08.622700

2024-11-11

Abstract:Cell-type-specific gene co-expression networks are widely used to characterize gene relationships. Although many methods have been developed to infer such co-expression networks from single-cell data, the lack of consideration of false positive control in many evaluations may lead to incorrect conclusions because higher reproducibility, higher functional coherence, and a larger overlap with known biological networks may not imply better performance if the false positives are not well controlled. In this study, we have developed an efficient and effective simulation tool to derive empirical p-values in co-expression inference to appropriately control false positives in assessing method performance. We studied the power of the p-value-based approach in inferring cell-type-specific co-expressions from single-cell data using both simulated and real data. We also highlight the need to adjust for random overlaps between the inferred and known networks when the number of selected correlated gene pairs varies substantially across different methods. We further illustrate the expression level bias in known biological networks and the impact of such bias in method assessment. Our study indicates the importance of controlling false positives in the inference of co-expressed genes to achieve more reliable results and proposes a simulation-based p-value method to achieve this.

Bioinformatics
From time-series transcriptomics to gene regulatory networks: A review on inference methods

Malvina Marku,Vera Pancaldi

DOI: https://doi.org/10.1371/journal.pcbi.1011254

2023-08-11

PLoS Computational Biology

Abstract:Inference of gene regulatory networks has been an active area of research for around 20 years, leading to the development of sophisticated inference algorithms based on a variety of assumptions and approaches. With the ever increasing demand for more accurate and powerful models, the inference problem remains of broad scientific interest. The abstract representation of biological systems through gene regulatory networks represents a powerful method to study such systems, encoding different amounts and types of information. In this review, we summarize the different types of inference algorithms specifically based on time-series transcriptomics, giving an overview of the main applications of gene regulatory networks in computational biology. This review is intended to give an updated reference of regulatory networks inference tools to biologists and researchers new to the topic and guide them in selecting the appropriate inference method that best fits their questions, aims, and experimental data.

biochemical research methods,mathematical & computational biology
Improving gene regulatory network inference and assessment: The importance of using network structure

Juan M. Escorcia-Rodríguez,Estefani Gaytan-Nuñez,Ericka M. Hernandez-Benitez,Andrea Zorro-Aranda,Marco A. Tello-Palencia,Julio A. Freyre-González

DOI: https://doi.org/10.3389/fgene.2023.1143382

IF: 3.7

2023-02-28

Frontiers in Genetics

Abstract:Gene regulatory networks are graph models representing cellular transcription events. Networks are far from complete due to time and resource consumption for experimental validation and curation of the interactions. Previous assessments have shown the modest performance of the available network inference methods based on gene expression data. Here, we study several caveats on the inference of regulatory networks and methods assessment through the quality of the input data and gold standard, and the assessment approach with a focus on the global structure of the network. We used synthetic and biological data for the predictions and experimentally-validated biological networks as the gold standard (ground truth). Standard performance metrics and graph structural properties suggest that methods inferring co-expression networks should no longer be assessed equally with those inferring regulatory interactions. While methods inferring regulatory interactions perform better in global regulatory network inference than co-expression-based methods, the latter is better suited to infer function-specific regulons and co-regulation networks. When merging expression data, the size increase should outweigh the noise inclusion and graph structure should be considered when integrating the inferences. We conclude with guidelines to take advantage of inference methods and their assessment based on the applications and available expression datasets.

genetics & heredity
Online control of the false discovery rate in biomedical research

David S. Robertson,James M.S. Wason

2018-09-27

Abstract:Modern biomedical research frequently involves testing multiple related hypotheses, while maintaining control over a suitable error rate. In many applications the false discovery rate (FDR), which is the expected proportion of false positives among the rejected hypotheses, has become the standard error criterion. Procedures that control the FDR, such as the well-known Benjamini-Hochberg procedure, assume that all p-values are available to be tested at a single time point. However, this ignores the sequential nature of many biomedical experiments, where a sequence of hypotheses is tested without having access to future p-values or even the number of hypotheses. Recently, the first procedures that control the FDR in this online manner have been proposed by Javanmard and Montanari (Ann. Stat. 2018), and built upon by Ramdas et al. (NIPS 2017, ICML 2018). In this paper, we compare and contrast these proposed procedures, with a particular focus on the setting where the p-values are dependent. We also propose a simple modification of the procedures for when there is an upper bound on the number of hypotheses to be tested. Using comprehensive simulation scenarios and case studies, we provide recommendations for which procedures to use in practice for online FDR control.

Applications
False discovery rate control: Moving beyond the Benjamini–Hochberg method

Salil Koner,Navonil De Sarkar,Nilanjana Laha

DOI: https://doi.org/10.1101/2024.01.13.575531

2024-01-15

Abstract:Modern bioinformatics studies often involve numerous simultaneous statistical tests, increasing the risk of false discoveries. To control the false discovery rate (FDR), these studies typically employ a statistical method called the Benjamini–Hochberg (BH) method. Often, the BH approach tends to be overly conservative and overlooks valuable biological insights associated with data structures, particularly those of groups. Group structures can manifest when closely located genomic coordinates are functionally active and closely related because of co-regulation. Recent statistical advancements have led to the development of updated BH methods tailored for datasets featuring pre-existing group structures. These methods can improve the statistical power and potentially enhance scientific discoveries. In this study, we elucidated the advantages of contemporary group-aware BH methods using a previously published microRNA (miRNA) dataset. For this dataset, group-aware BH methods identified a larger set of miRNAs with significantly deregulated expression (p-value <0.05) than the traditional BH method. These new findings are supported by existing literature on miRNAs and a related 2017 study. Our results underscore the potential of specialized BH methods for controlling the FDR in high throughput omics studies with pre-defined group structures.

Bioinformatics
Reverse engineering and verification of gene networks: Principles, assumptions, and limitations of present methods and future perspectives

Feng He,Rudi Balling,An-Ping Zeng

DOI: https://doi.org/10.1016/j.jbiotec.2009.07.013

IF: 3.595

2009-01-01

Journal of Biotechnology

Abstract:Reverse engineering of gene networks aims at revealing the structure of the gene regulation network in a biological system by reasoning backward directly from experimental data. Many methods have recently been proposed for reverse engineering of gene networks by using gene transcript expression data measured by microarray. Whereas the potentials of the methods have been well demonstrated, the assumptions and limitations behind them are often not clearly stated or not well understood. In this review, we first briefly explain the principles of the major methods, identify the assumptions behind them and pinpoint the limitations and possible pitfalls in applying them to real biological questions. With regard to applications, we then discuss challenges in the experimental verification of gene networks generated from reverse engineering methods. We further propose an optimal experimental design for allocating sampling schedule and possible strategies for reducing the limitations of some of the current reverse engineering methods. Finally, we examine the perspectives for the development of reverse engineering and urge the need to move from revealing network structure to the dynamics of biological systems.

Evaluation of Kernfeld et al.: Toward best practices for tackling false positives in regulatory network inference

Transcriptome data are insufficient to control false discoveries in regulatory network inference

A Novel Technique for Reduction of False Positives in Predicted Gene Regulatory Networks

Unexpected links reflect the noise in networks

Improving Network Inference: The Impact of False Positive and False Negative Conclusions about the Presence or Absence of Links

Benchmarking algorithms for gene regulatory network inference from single-cell transcriptomic data

Controlling false discoveries in Bayesian gene networks with lasso regression p-values

Detecting signal from science:The structure of research communities and prior knowledge improves prediction of genetic regulatory experiments

Identifying strengths and weaknesses of methods for computational network inference from single-cell RNA-seq data

A practical guide to methods controlling false discoveries in computational biology

Evaluating the Reproducibility of Single-Cell Gene Regulatory Network Inference Algorithms

Evaluating methods of inferring gene regulatory networks highlights their lack of performance for single cell gene expression data

A multifactorial evaluation framework for gene regulatory network reconstruction

Supervised, semi-supervised and unsupervised inference of gene regulatory networks

A Posterior Probability Approach for Gene Regulatory Network Inference in Genetic Perturbation Data

Inferring Cell-Type-Specific Co-Expressed Genes from Single Cell Data

From time-series transcriptomics to gene regulatory networks: A review on inference methods

Improving gene regulatory network inference and assessment: The importance of using network structure

Online control of the false discovery rate in biomedical research

False discovery rate control: Moving beyond the Benjamini–Hochberg method

Reverse engineering and verification of gene networks: Principles, assumptions, and limitations of present methods and future perspectives