[Misdiagnosed infectious complications of cranioencephalic injures].

M. Rivierez,A. Redondo,S. Askienazy,P. Dorland,J. Chodkiewicz

1973-10-01

Abstract:

What problem does this paper attempt to address?

binomialRF: interpretable combinatoric efficiency of random forests to identify biomarker interactions

Samir Rachid Zaim,Colleen Kenost,Joanne Berghout,Wesley Chiu,Liam Wilson,Hao Helen Zhang,Yves A. Lussier

DOI: https://doi.org/10.1186/s12859-020-03718-9

IF: 3.307

2020-08-28

BMC Bioinformatics

Abstract:Abstract Background In this era of data science-driven bioinformatics, machine learning research has focused on feature selection as users want more interpretation and post-hoc analyses for biomarker detection. However, when there are more features (i.e., transcripts) than samples (i.e., mice or human samples) in a study, it poses major statistical challenges in biomarker detection tasks as traditional statistical techniques are underpowered in high dimension. Second and third order interactions of these features pose a substantial combinatoric dimensional challenge. In computational biology, random forest ( RF ) classifiers are widely used due to their flexibility, powerful performance, their ability to rank features, and their robustness to the “P > > N ” high-dimensional limitation that many matrix regression algorithms face. We propose binomialRF, a feature selection technique in RFs that provides an alternative interpretation for features using a correlated binomial distribution and scales efficiently to analyze multiway interactions. Results In both simulations and validation studies using datasets from the TCGA and UCI repositories, binomialRF showed computational gains (up to 5 to 300 times faster) while maintaining competitive variable precision and recall in identifying biomarkers’ main effects and interactions. In two clinical studies, the binomialRF algorithm prioritizes previously-published relevant pathological molecular mechanisms (features) with high classification precision and recall using features alone, as well as with their statistical interactions alone. Conclusion binomialRF extends upon previous methods for identifying interpretable features in RFs and brings them together under a correlated binomial distribution to create an efficient hypothesis testing algorithm that identifies biomarkers’ main effects and interactions. Preliminary results in simulations demonstrate computational gains while retaining competitive model selection and classification accuracies. Future work will extend this framework to incorporate ontologies that provide pathway-level feature selection from gene expression input data.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Sample size and statistical power considerations in high-dimensionality data settings: a comparative study of classification algorithms

Yu Guo,Armin Graber,Robert N McBurney,Raji Balasubramanian

DOI: https://doi.org/10.1186/1471-2105-11-447

IF: 3.307

2010-09-03

BMC Bioinformatics

Abstract:Abstract Background Data generated using 'omics' technologies are characterized by high dimensionality, where the number of features measured per subject vastly exceeds the number of subjects in the study. In this paper, we consider issues relevant in the design of biomedical studies in which the goal is the discovery of a subset of features and an associated algorithm that can predict a binary outcome, such as disease status. We compare the performance of four commonly used classifiers (K-Nearest Neighbors, Prediction Analysis for Microarrays, Random Forests and Support Vector Machines) in high-dimensionality data settings. We evaluate the effects of varying levels of signal-to-noise ratio in the dataset, imbalance in class distribution and choice of metric for quantifying performance of the classifier. To guide study design, we present a summary of the key characteristics of 'omics' data profiled in several human or animal model experiments utilizing high-content mass spectrometry and multiplexed immunoassay based techniques. Results The analysis of data from seven 'omics' studies revealed that the average magnitude of effect size observed in human studies was markedly lower when compared to that in animal studies. The data measured in human studies were characterized by higher biological variation and the presence of outliers. The results from simulation studies indicated that the classifier Prediction Analysis for Microarrays (PAM) had the highest power when the class conditional feature distributions were Gaussian and outcome distributions were balanced. Random Forests was optimal when feature distributions were skewed and when class distributions were unbalanced. We provide a free open-source R statistical software library ( MVpower ) that implements the simulation strategy proposed in this paper. Conclusion No single classifier had optimal performance under all settings. Simulation studies provide useful guidance for the design of biomedical studies involving high-dimensionality data.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
biosigner: A New Method for the Discovery of Significant Molecular Signatures from Omics Data

Philippe Rinaudo,Samia Boudah,Christophe Junot,Etienne A. Thévenot

DOI: https://doi.org/10.3389/fmolb.2016.00026

IF: 6.113

2016-06-21

Frontiers in Molecular Biosciences

Abstract:High-throughput technologies such as transcriptomics, proteomics, and metabolomics show great promise for the discovery of biomarkers for diagnosis and prognosis. Selection of the most promising candidates between the initial untargeted step and the subsequent validation phases is critical within the pipeline leading to clinical tests. Several statistical and data mining methods have been described for feature selection: in particular, wrapper approaches iteratively assess the performance of the classifier on distinct subsets of variables. Current wrappers, however, do not estimate the significance of the selected features. We therefore developed a new methodology to find the smallest feature subset which significantly contributes to the model performance, by using a combination of resampling, ranking of variable importance, significance assessment by permutation of the feature values in the test subsets, and half-interval search. We wrapped our biosigner algorithm around three reference binary classifiers (Partial Least Squares-Discriminant Analysis, Random Forest, and Support Vector Machines) which have been shown to achieve specific performances depending on the structure of the dataset. By using three real biological and clinical metabolomics and transcriptomics datasets (containing up to 7000 features), complementary signatures were obtained in a few minutes, generally providing higher prediction accuracies than the initial full model. Comparison with alternative feature selection approaches further indicated that our method provides signatures of restricted size and high stability. Finally, by using our methodology to seek metabolites discriminating type 1 from type 2 diabetic patients, several features were selected, including a fragment from the taurochenodeoxycholic bile acid. Our methodology, implemented in the biosigner R/Bioconductor package and Galaxy/Workflow4metabolomics module, should be of interest for both experimenters and statisticians to identify robust molecular signatures from large omics datasets in the process of developing new diagnostics.

biochemistry & molecular biology
A Flexible Approach for Predictive Biomarker Discovery

Philippe Boileau,Nina Ting Qi,Mark J. van der Laan,Sandrine Dudoit,Ning Leng

DOI: https://doi.org/10.1093/biostatistics/kxac029

2022-06-02

Abstract:An endeavor central to precision medicine is predictive biomarker discovery; they define patient subpopulations which stand to benefit most, or least, from a given treatment. The identification of these biomarkers is often the byproduct of the related but fundamentally different task of treatment rule estimation. Using treatment rule estimation methods to identify predictive biomarkers in clinical trials where the number of covariates exceeds the number of participants often results in high false discovery rates. The higher than expected number of false positives translates to wasted resources when conducting follow-up experiments for drug target identification and diagnostic assay development. Patient outcomes are in turn negatively affected. We propose a variable importance parameter for directly assessing the importance of potentially predictive biomarkers, and develop a flexible nonparametric inference procedure for this estimand. We prove that our estimator is double-robust and asymptotically linear under loose conditions on the data-generating process, permitting valid inference about the importance metric. The statistical guarantees of the method are verified in a thorough simulation study representative of randomized control trials with moderate and high-dimensional covariate vectors. Our procedure is then used to discover predictive biomarkers from among the tumor gene expression data of metastatic renal cell carcinoma patients enrolled in recently completed clinical trials. We find that our approach more readily discerns predictive from non-predictive biomarkers than procedures whose primary purpose is treatment rule estimation. An open-source software implementation of the methodology, the uniCATE R package, is briefly introduced.

Methodology
Computation and Selection of Optimal Biomarker Combinations by Integrative ROC Analysis Using CombiROC

Mauro Bombaci,Riccardo L Rossi

DOI: https://doi.org/10.1007/978-1-4939-9164-8_16

Abstract:The diagnostic accuracy of biomarker-based approaches can be considerably improved by combining multiple markers. A biomarker's capacity to identify specific subjects is usually assessed using receiver operating characteristic (ROC) curves. Multimarker signatures are complicated to select as data signatures must be integrated using sophisticated statistical methods. CombiROC, developed as a user-friendly web tool, helps researchers to accurately determine optimal combinations of markers identified by a range of omics methods. With CombiROC, data of different types, such as proteomics and transcriptomics, can be analyzed using Sensitivity/Specificity filters: the number of candidate marker panels arising from combinatorial analysis is easily optimized bypassing limitations imposed by the nature of different experimental approaches. Users have full control over initial selection stringency, then CombiROC computes sensitivity and specificity for all marker combinations, determines performance for the best combinations, and produces ROC curves for automatic comparisons. All steps can be visualized in a graphic interface. CombiROC is designed without hard-coded thresholds, to allow customized fitting of each specific dataset: this approach dramatically reduces computational burden and false-negative rates compared to fixed thresholds. CombiROC can be accessed at www.combiroc.eu .
Statistical Methods for Selective Biomarker Testing

A. Adam Ding,Natalie DelRocco,Samuel S. Wu

DOI: https://doi.org/10.1007/s12561-023-09416-3

2024-02-11

Statistics in Biosciences

Abstract:Biomarkers are critically important tools in modern clinical diagnosis, prognosis, and classification/prediction. However, there are fiscal and analytical barriers to biomarker research. Selective Genotyping is an approach to increasing study power and efficiency where individuals with the most extreme phenotype (response) are chosen for genotyping (exposure) in order to maximize the information in the sample. In this article, we describe an analogous procedure in the biomarker testing landscape where both response and biomarker (exposure) are continuous. We propose an intuitive reverse-regression least squares estimator for the parameters relating biomarker value to response. An expression for robust standard error and corresponding confidence interval are derived. A simulation study is used to demonstrate that this method is unbiased and efficient relative to estimates from random sampling when the joint normal distribution assumption is met, and to compare the estimator to an alternative under a related sampling design. We illustrate application of proposed methods on data from a chronic pain clinical trial.
Decision Variants for the Automatic Determination of Optimal Feature Subset in RF-RFE

Qi Chen,Zhaopeng Meng,Xinyi Liu,Qianguo Jin,Ran Su

DOI: https://doi.org/10.3390/genes9060301

IF: 4.141

2018-06-15

Genes

Abstract:Feature selection, which identifies a set of most informative features from the original feature space, has been widely used to simplify the predictor. Recursive feature elimination (RFE), as one of the most popular feature selection approaches, is effective in data dimension reduction and efficiency increase. A ranking of features, as well as candidate subsets with the corresponding accuracy, is produced through RFE. The subset with highest accuracy (HA) or a preset number of features (PreNum) are often used as the final subset. However, this may lead to a large number of features being selected, or if there is no prior knowledge about this preset number, it is often ambiguous and subjective regarding final subset selection. A proper decision variant is in high demand to automatically determine the optimal subset. In this study, we conduct pioneering work to explore the decision variant after obtaining a list of candidate subsets from RFE. We provide a detailed analysis and comparison of several decision variants to automatically select the optimal feature subset. Random forest (RF)-recursive feature elimination (RF-RFE) algorithm and a voting strategy are introduced. We validated the variants on two totally different molecular biology datasets, one for a toxicogenomic study and the other one for protein sequence analysis. The study provides an automated way to determine the optimal feature subset when using RF-RFE.

genetics & heredity
AI–Driven Predictive Biomarker Discovery with Contrastive Learning to Improve Clinical Trial Outcomes

Gustavo Arango,Damian E Bikiel,Gerald J Sun,Elly Kipkogei,Kaitlin M Smith,Sebastian Carrasco Pro,Etai Jacob

DOI: https://doi.org/10.1101/2024.01.31.24302104

2024-08-07

Abstract:Modern clinical trials can capture tens of thousands of clinicogenomic measurements per individual. Employing manual approaches to discover predictive biomarkers, as differentiated from prognostic markers, is a challenging task. To address this challenge, we present an automated neural network framework based on contrastive learning, which we have named the predictive biomarker modeling framework (PBMF). This general-purpose framework explores potential predictive biomarkers in a systematic and unbiased manner, as demonstrated in simulated "ground truth" synthetic scenarios resembling clinical trials. Applied retrospectively to real clinicogenomic data sets, particularly in the complex field of immunooncology (IO) predictive biomarker discovery, our algorithm successfully found biomarkers that identify IO-treated individuals who survive longer than those treated with chemotherapy. In a retrospective analysis, we demonstrated how our framework could have contributed to a phase 3 clinical trial ( ) by uncovering a predictive biomarker based solely on early study data. Patients identified with this predictive biomarker had a 15% improvement in survival risk, as compared to those of the original trial. This improvement was achieved with a simple, interpretable decision tree generated via PBMF knowledge distillation. Our framework offers a rapid and robust approach to inform biomarker strategy, providing actionable outcomes for clinical decision-making.

Oncology
Cimetidine versus antacids in the prevention of stress erosions in critically ill patients.

M. Poleski,A. Spanier

1986-02-01

Abstract:To assess the efficacy of cimetidine versus Mylanta II in the prevention of stress erosions, 44 patients at risk were randomized to receive cimetidine 300 mg/6 h intravenously to a maximum of 400 mg/4 h; or Mylanta II 30 ml/h through a nasogastric tube to a maximum of 90 ml/h. The minimum dose of medication was used to maintain hourly gastric pH greater than or equal to 4. All patients were to be endoscoped after 72 h and erosions graded by an endoscopist who had no knowledge of their treatment regime. Grade 3 or 4 erosions occurred in five of 21 cimetidine-treated patients and eight of 16 antacid-treated patients (p greater than 0.05). A gastric pH greater than or equal to 4 was maintained 79.5% of the time by cimetidine and 97.9% of the time by Mylanta II (p less than 0.001). Cimetidine and antacids are equal in the prevention of stress erosions although Mylanta II is superior in hourly pH control. Hourly pH control does not entirely explain the beneficial effect of cimetidine in the prevention of stress ulcers. There was no significant bleeding in this study. Fatalities in patients at risk of developing stress ulcers result from the underlying disease, not from hemorrhage from stress-induced mucosal lesions. In critically ill patients, endoscopic examination should be restricted to the rare case with manifest hemorrhage.
Forward variable selection improves the power of random forest for high-dimensional microbiome data

Tung Dang,Hirohisa Kishino

DOI: https://doi.org/10.21203/rs.3.rs-319022/v1

2021-04-05

Abstract:Abstract Background : Random forest (RF) captures complex feature patterns that differentiate groups of samples and is rapidly being adopted in microbiome studies. However, a major challenge is the high dimensionality of microbiome datasets. They include thousands of species or molecular functions of particular biological interest. This high dimensionality significantly reduces the power of random forest approaches for identifying true differences. The widely used Boruta algorithm iteratively removes features that are proved by a statistical test to be less relevant than random probes. Result : We developed a massively parallel forward variable selection algorithm and coupled it with the RF classifier to maximize the predictive performance. The forward variable selection algorithm adds new variable to a set of selected variables as far as the prespecified criterion of predictive power is improved. At each step, the parameters of random forest are optimized. We demonstrated the performance of the proposed approach, which we named RF-FVS, by analyzing two published datasets from large-scale case-control studies: (i) 16S rRNA gene amplicon data for Clostridioides difficile infection (CDI) and (ii) shotgun metagenomics data for human colorectal cancer (CRC). The RF-FVS approach further screened the variables that the Boruta algorithm left and improved the accuracy of the random forest classifier from 81% to 99.01% for CDI and from 75.14% to 90.17% for CRC. Conclusion : Valid variable selection is essential for the analysis of high-dimensional microbiota data. By adopting the Boruta algorithm for pre-screening of the variables, our proposed RF-FVS approach improves the accuracy of random forest significantly with minimum increase of computational burden. The procedure can be used to identify the functional profiles that differentiate samples between different conditions.
PDXpower: A Power Analysis Tool for Experimental Design in Pre-clinical Xenograft Studies for Uncensored and Censored Outcomes

Shanpeng Li,Donatello Telesca,Harley I. Kornblum,David Nathanson,Frank Pajonk,Elvis Han Cui,Joycelynne Palmer,Gang Li

DOI: https://doi.org/10.48550/arxiv.2404.08927

2024-04-13

Applications

Abstract:In cancer research, leveraging patient-derived xenografts (PDXs) in pre-clinical experiments is a crucial approach for assessing innovative therapeutic strategies. Addressing the inherent variability in treatment response among and within individual PDX lines is essential. However, the current literature lacks a user-friendly statistical power analysis tool capable of concurrently determining the required number of PDX lines and animals per line per treatment group in this context. In this paper, we present a simulation-based R package for sample size determination, named `\textbf{PDXpower}', which is publicly available at The Comprehensive R Archive Network \url{https://CRAN.R-project.org/package=PDXpower}. The package is designed to estimate the necessary number of both PDX lines and animals per line per treatment group for the design of a PDX experiment, whether for an uncensored outcome, or a censored time-to-event outcome. Our sample size considerations rely on two widely used analytical frameworks: the mixed effects ANOVA model for uncensored outcomes and Cox's frailty model for censored data outcomes, which effectively account for both inter-PDX variability and intra-PDX correlation in treatment response. Step-by-step illustrations for utilizing the developed package are provided, catering to scenarios with or without preliminary data.
Random feature baselines provide distributional performance and feature selection benchmarks for clinical and 'omic machine learning

Randall J. Ellis,Audrey Airaud,Chirag J. Patel

2024-11-28

Abstract:Identifying predictive features from high-dimensional datasets is a major task in biomedical research. However, it is difficult to determine the robustness of selected features. Here, we investigate the performance of randomly chosen features, what we term "random feature baselines" (RFBs), in the context of disease risk prediction from blood plasma proteomics data in the UK Biobank. We examine two published case studies predicting diagnosis of (1) dementia and (2) hip fracture. RFBs perform similarly to published proteins of interest (using the same number, randomly chosen). We then measure the performance of RFBs for all 607 disease outcomes in the UK Biobank, with various numbers of randomly chosen features, as well as all proteins in the dataset. 114/607 outcomes showed a higher mean AUROC when choosing 5 random features than using all proteins, and the absolute difference in mean AUC was 0.075. 163 outcomes showed a higher mean AUROC when choosing 1000 random features than using all proteins, and the absolute difference in mean AUC was 0.03. Incorporating RFBs should become part of ML practice when feature selection or target discovery is a goal.

Quantitative Methods
Common, uncommon, and novel applications of random forest in psychological research

Dustin A. Fife,Juliana D’Onofrio

DOI: https://doi.org/10.3758/s13428-022-01901-9

IF: 5.953

2022-08-03

Behavior Research Methods

Abstract:Recent reform efforts have pushed toward a better understanding of the distinction between exploratory and confirmatory research, and appropriate use of each. As some utilize more exploratory tools, it may be tempting to employ multiple linear regression models. In this paper, we advocate for the use of random forest (RF) models. RF is able to obtain better predictive performance than traditional regression, while also inherently protecting against overfitting as well as detecting nonlinear effects and interactions among predictors. Given the advantages of RF compared to other statistical procedures, it is a tool commonly used within a plethora of industries, including stock trading, banking, pharmaceuticals, and patient healthcare planning. However, we find RF is used within the field of psychology comparatively less frequently. In the current paper, we advocate for RF as an important statistical tool within the context of behavioral and psychological research. In hopes of increasing the use of RF in the field of psychology, we provide information pertaining to the limitations one might confront in using RF and how to overcome such limitations. Moreover, we discuss various methods for how to optimally utilize RF with psychological data, such as nonparametric modeling, interaction and nonlinearity detection, variable selection, prediction and classification modeling, and assessing parameters of Monte Carlo simulations. Throughout, we illustrate the use of RF with visualization strategies, aimed to make RF models more comprehensible and intuitive.

psychology, experimental, mathematical
Detecting gene-gene interactions using a permutation-based random forest method

Jing Li,James D. Malley,Angeline S. Andrew,Margaret R. Karagas,Jason H. Moore

DOI: https://doi.org/10.1186/s13040-016-0093-5

2016-04-06

BioData Mining

Abstract:BackgroundIdentifying gene-gene interactions is essential to understand disease susceptibility and to detect genetic architectures underlying complex diseases. Here, we aimed at developing a permutation-based methodology relying on a machine learning method, random forest (RF), to detect gene-gene interactions. Our approach called permuted random forest (pRF) which identified the top interacting single nucleotide polymorphism (SNP) pairs by estimating how much the power of a random forest classification model is influenced by removing pairwise interactions.ResultsWe systematically tested our approach on a simulation study with datasets possessing various genetic constraints including heritability, number of SNPs, sample size, etc. Our methodology showed high success rates for detecting the interaction SNP pair. We also applied our approach to two bladder cancer datasets, which showed consistent results with well-studied methodologies, such as multifactor dimensionality reduction (MDR) and statistical epistasis network (SEN). Furthermore, we built permuted random forest networks (PRFN), in which we used nodes to represent SNPs and edges to indicate interactions.ConclusionsWe successfully developed a scale-invariant methodology to detect pure gene-gene interactions based on permutation strategies and the machine learning method random forest. This methodology showed great potential to be used for detecting gene-gene interactions to study underlying genetic architectures in a scale-free way, which could be benefit to uncover the complex disease mechanisms.

mathematical & computational biology
A multicenter random forest model for effective prognosis prediction in collaborative clinical research network

Jin Li,Yu Tian,Yan Zhu,Tianshu Zhou,Jun Li,Kefeng Ding,Jingsong Li

DOI: https://doi.org/10.1016/j.artmed.2020.101814

Abstract:Background: The accuracy of a prognostic prediction model has become an essential aspect of the quality and reliability of the health-related decisions made by clinicians in modern medicine. Unfortunately, individual institutions often lack sufficient samples, which might not provide sufficient statistical power for models. One mitigation is to expand data collection from a single institution to multiple centers to collectively increase the sample size. However, sharing sensitive biomedical data for research involves complicated issues. Machine learning models such as random forests (RF), though they are commonly used and achieve good performances for prognostic prediction, usually suffer worse performance under multicenter privacy-preserving data mining scenarios compared to a centrally trained version. Methods and materials: In this study, a multicenter random forest prognosis prediction model is proposed that enables federated clinical data mining from horizontally partitioned datasets. By using a novel data enhancement approach based on a differentially private generative adversarial network customized to clinical prognosis data, the proposed model is able to provide a multicenter RF model with performances on par with-or even better than-centrally trained RF but without the need to aggregate the raw data. Moreover, our model also incorporates an importance ranking step designed for feature selection without sharing patient-level information. Result: The proposed model was evaluated on colorectal cancer datasets from the US and China. Two groups of datasets with different levels of heterogeneity within the collaborative research network were selected. First, we compare the performance of the distributed random forest model under different privacy parameters with different percentages of enhancement datasets and validate the effectiveness and plausibility of our approach. Then, we compare the discrimination and calibration ability of the proposed multicenter random forest with a centrally trained random forest model and other tree-based classifiers as well as some commonly used machine learning methods. The results show that the proposed model can provide better prediction performance in terms of discrimination and calibration ability than the centrally trained RF model or the other candidate models while following the privacy-preserving rules in both groups. Additionally, good discrimination and calibration ability are shown on the simplified model based on the feature importance ranking in the proposed approach. Conclusion: The proposed random forest model exhibits ideal prediction capability using multicenter clinical data and overcomes the performance limitation arising from privacy guarantees. It can also provide feature importance ranking across institutions without pooling the data at a central site. This study offers a practical solution for building a prognosis prediction model in the collaborative clinical research network and solves practical issues in real-world applications of medical artificial intelligence.
Knowledge-slanted random forest method for high-dimensional data and small sample size with a feature selection application for gene expression data

Erika Cantor,Sandra Guauque-Olarte,Roberto León,Steren Chabert,Rodrigo Salas

DOI: https://doi.org/10.1186/s13040-024-00388-8

2024-09-10

Abstract:The use of prior knowledge in the machine learning framework has been considered a potential tool to handle the curse of dimensionality in genetic and genomics data. Although random forest (RF) represents a flexible non-parametric approach with several advantages, it can provide poor accuracy in high-dimensional settings, mainly in scenarios with small sample sizes. We propose a knowledge-slanted RF that integrates biological networks as prior knowledge into the model to improve its performance and explainability, exemplifying its use for selecting and identifying relevant genes. knowledge-slanted RF is a combination of two stages. First, prior knowledge represented by graphs is translated by running a random walk with restart algorithm to determine the relevance of each gene based on its connection and localization on a protein-protein interaction network. Then, each relevance is used to modify the selection probability to draw a gene as a candidate split-feature in the conventional RF. Experiments in simulated datasets with very small sample sizes ( n ≤ 30 ) comparing knowledge-slanted RF against conventional RF and logistic lasso regression, suggest an improved precision in outcome prediction compared to the other methods. The knowledge-slanted RF was completed with the introduction of a modified version of the Boruta feature selection algorithm. Finally, knowledge-slanted RF identified more relevant biological genes, offering a higher level of explainability for users than conventional RF. These findings were corroborated in one real case to identify relevant genes to calcific aortic valve stenosis.
MetaFS: Performance assessment of biomarker discovery in metaproteomics

Jing Tang,Minjie Mou,Yunxia Wang,Yongchao Luo,Feng Zhu

DOI: https://doi.org/10.1093/bib/bbaa105

IF: 9.5

2021-01-01

Briefings in Bioinformatics

Abstract:Metaproteomics suffers from the issues of dimensionality and sparsity. Data reduction methods can maximally identify the relevant subset of significant differential features and reduce data redundancy. Feature selection (FS) methods were applied to obtain the significant differential subset. So far, a variety of feature selection methods have been developed for metaproteomic study. However, due to FS's performance depended heavily on the data characteristics of a given research, the well-suitable feature selection method must be carefully selected to obtain the reproducible differential proteins. Moreover, it is critical to evaluate the performance of each FS method according to comprehensive criteria, because the single criterion is not sufficient to reflect the overall performance of the FS method. Therefore, we developed an online tool named MetaFS, which provided 13 types of FS methods and conducted the comprehensive evaluation on the complex FS methods using four widely accepted and independent criteria. Furthermore, the function and reliability of MetaFS were systematically tested and validated via two case studies. In sum, MetaFS could be a distinguished tool for discovering the overall well-performed FS method for selecting the potential biomarkers in microbiome studies. The online tool is freely available at https://idrblab.org/metafs/.
Random Forest for Bioinformatics

Yanjun Qi

DOI: https://doi.org/10.1007/978-1-4419-9326-7_11

2012-01-01

Abstract:Modern biology has experienced an increased use of machine learning techniques for large scale and complex biological data analysis. In the area of Bioinformatics, the Random Forest (RF) [6] technique, which includes an ensemble of decision trees and incorporates feature selection and interactions naturally in the learning process, is a popular choice. It is nonparametric, interpretable, efficient, and has high prediction accuracy for many types of data. Recent work in computational biology has seen an increased use of RF, owing to its unique advantages in dealing with small sample size, high-dimensional feature space, and complex data structures.
Iterative Random Forests to detect predictive and stable high-order interactions

Sumanta Basu,Karl Kumbier,James B. Brown,Bin Yu

DOI: https://doi.org/10.1073/pnas.1711236115

2017-12-24

Abstract:Genomics has revolutionized biology, enabling the interrogation of whole transcriptomes, genome-wide binding sites for proteins, and many other molecular processes. However, individual genomic assays measure elements that interact in vivo as components of larger molecular machines. Understanding how these high-order interactions drive gene expression presents a substantial statistical challenge. Building on Random Forests (RF), Random Intersection Trees (RITs), and through extensive, biologically inspired simulations, we developed the iterative Random Forest algorithm (iRF). iRF trains a feature-weighted ensemble of decision trees to detect stable, high-order interactions with same order of computational cost as RF. We demonstrate the utility of iRF for high-order interaction discovery in two prediction problems: enhancer activity in the early Drosophila embryo and alternative splicing of primary transcripts in human derived cell lines. In Drosophila, among the 20 pairwise transcription factor interactions iRF identifies as stable (returned in more than half of bootstrap replicates), 80% have been previously reported as physical interactions. Moreover, novel third-order interactions, e.g. between Zelda (Zld), Giant (Gt), and Twist (Twi), suggest high-order relationships that are candidates for follow-up experiments. In human-derived cells, iRF re-discovered a central role of H3K36me3 in chromatin-mediated splicing regulation, and identified novel 5th and 6th order interactions, indicative of multi-valent nucleosomes with specific roles in splicing regulation. By decoupling the order of interactions from the computational cost of identification, iRF opens new avenues of inquiry into the molecular mechanisms underlying genome biology.

Machine Learning,Genomics
JigSaw: A tool for discovering explanatory high-order interactions from random forests

Demetrius DiMucci

DOI: https://doi.org/10.48550/arXiv.2005.04342

2020-05-09

Abstract:Machine learning is revolutionizing biology by facilitating the prediction of outcomes from complex patterns found in massive data sets. Large biological data sets, like those generated by transcriptome or microbiome studies,measure many relevant components that interact in vivo with one another in modular <a class="link-external link-http" href="http://ways.Identifying" rel="external noopener nofollow">this http URL</a> the high-order interactions that machine learning models use to make predictions would facilitate the development of hypotheses linking combinations of measured components to outcome. By using the structure of random forests, a new algorithmic approach, termed JigSaw,was developed to aid in the discovery of patterns that could explain predictions made by the forest. By examining the patterns of individual decision trees JigSaw identifies high-order interactions between measured features that are strongly associated with a particular outcome and identifies the relevant decision thresholds. JigSaw's effectiveness was tested in simulation studies where it was able to recover multiple ground truth patterns;even in the presence of significant noise. It was then used to find patterns associated with outcomes in two real world data <a class="link-external link-http" href="http://sets.It" rel="external noopener nofollow">this http URL</a> was first used to identify patterns clinical measurements associated with heart disease. It was then used to find patterns associated with breast cancer using metabolites measured in the blood. In heart disease, JigSaw identified several three-way interactions that combine to explain most of the heart disease records (66%) with high precision (93%). In breast cancer, three two-way interactions were recovered that can be combined to explain almost all records (92%) with good precision (79%). JigSaw is an efficient method for exploring high-dimensional feature spaces for rules that explain statistical associations with a given outcome and can inspire the generation of testable hypotheses.

Quantitative Methods,Machine Learning

[Misdiagnosed infectious complications of cranioencephalic injures].

binomialRF: interpretable combinatoric efficiency of random forests to identify biomarker interactions

Sample size and statistical power considerations in high-dimensionality data settings: a comparative study of classification algorithms

biosigner: A New Method for the Discovery of Significant Molecular Signatures from Omics Data

A Flexible Approach for Predictive Biomarker Discovery

Computation and Selection of Optimal Biomarker Combinations by Integrative ROC Analysis Using CombiROC

Statistical Methods for Selective Biomarker Testing

Decision Variants for the Automatic Determination of Optimal Feature Subset in RF-RFE

AI–Driven Predictive Biomarker Discovery with Contrastive Learning to Improve Clinical Trial Outcomes

Cimetidine versus antacids in the prevention of stress erosions in critically ill patients.

Forward variable selection improves the power of random forest for high-dimensional microbiome data

PDXpower: A Power Analysis Tool for Experimental Design in Pre-clinical Xenograft Studies for Uncensored and Censored Outcomes

Random feature baselines provide distributional performance and feature selection benchmarks for clinical and 'omic machine learning

Common, uncommon, and novel applications of random forest in psychological research

Detecting gene-gene interactions using a permutation-based random forest method

A multicenter random forest model for effective prognosis prediction in collaborative clinical research network

Knowledge-slanted random forest method for high-dimensional data and small sample size with a feature selection application for gene expression data

MetaFS: Performance assessment of biomarker discovery in metaproteomics

Random Forest for Bioinformatics

Iterative Random Forests to detect predictive and stable high-order interactions

JigSaw: A tool for discovering explanatory high-order interactions from random forests