Abstract:High-throughput technologies such as transcriptomics, proteomics, and metabolomics show great promise for the discovery of biomarkers for diagnosis and prognosis. Selection of the most promising candidates between the initial untargeted step and the subsequent validation phases is critical within the pipeline leading to clinical tests. Several statistical and data mining methods have been described for feature selection: in particular, wrapper approaches iteratively assess the performance of the classifier on distinct subsets of variables. Current wrappers, however, do not estimate the significance of the selected features. We therefore developed a new methodology to find the smallest feature subset which significantly contributes to the model performance, by using a combination of resampling, ranking of variable importance, significance assessment by permutation of the feature values in the test subsets, and half-interval search. We wrapped our biosigner algorithm around three reference binary classifiers (Partial Least Squares-Discriminant Analysis, Random Forest, and Support Vector Machines) which have been shown to achieve specific performances depending on the structure of the dataset. By using three real biological and clinical metabolomics and transcriptomics datasets (containing up to 7000 features), complementary signatures were obtained in a few minutes, generally providing higher prediction accuracies than the initial full model. Comparison with alternative feature selection approaches further indicated that our method provides signatures of restricted size and high stability. Finally, by using our methodology to seek metabolites discriminating type 1 from type 2 diabetic patients, several features were selected, including a fragment from the taurochenodeoxycholic bile acid. Our methodology, implemented in the biosigner R/Bioconductor package and Galaxy/Workflow4metabolomics module, should be of interest for both experimenters and statisticians to identify robust molecular signatures from large omics datasets in the process of developing new diagnostics.

Variable Importance Analysis Based on Rank Aggregation with Applications in Metabolomics for Biomarker Discovery.

Informative Metabolites Identification by Variable Importance Analysis Based on Random Variable Combination

Combining bootstrap and uninformative variable elimination: Chemometric identification of metabonomic biomarkers by nonparametric analysis of discriminant partial least squares

Critical Assessment of the Biomarker Discovery and Classification Methods for Multiclass Metabolomics.

A Novel Strategy for Rapidly and Accurately Screening Biomarkers Based on Ultraperformance Liquid Chromatography-Mass Spectrometry Metabolomics Data.

Identifying High-Dimensional Biomarkers for Personalized Medicine via Variable Importance Ranking

A Method for Handling Metabonomics Data from Liquid Chromatography/mass Spectrometry: Combinational Use of Support Vector Machine Recursive Feature Elimination, Genetic Algorithm and Random Forest for Feature Selection

Feature Ranking and Screening for Class-Imbalanced Metabolomics Data Based on Rank Aggregation Coupled with Re-Balance

Controlled variable selection with nonconvex regularization for identifying biomarkers

Shrunken centroids regularized discriminant analysis as a promising strategy for metabolomics data exploration

An efficient approach for identifying important biomarkers for biomedical diagnosis

Recipe for revealing informative metabolites based on model population analysis

Coupling bootstrap with synergy self-organizing map-based orthogonal partial least squares discriminant analysis: Stable metabolic biomarker selection for inherited metabolic diseases

New Variable Scaling Method for NMR-based Metabolomics Data Analysis

Selective of informative metabolites using random forests based on model population analysis.

Application of sparse linear discriminant analysis for metabolomics data

Efficient and Doubly-Robust Methods for Variable Selection and Parameter Estimation in Longitudinal Data Analysis

Variable Complementary Network: a Novel Approach for Identifying Biomarkers and Their Mutual Associations

A Model Population Analysis Method For Variable Selection Based On Mutual Information

biosigner: A New Method for the Discovery of Significant Molecular Signatures from Omics Data

Nonparametric Assessment of Variable Selection and Ranking Algorithms