Abstract:The Model-X knockoffs is a practical methodology for variable selection, which stands out from other selection strategies since it allows for the control of the false discovery rate (FDR), relying on finite-sample guarantees. In this article, we propose a Truncated D-vine Copula Knockoffs (TDCK) algorithm for sampling approximate knockoffs from complex multivariate distributions. Our algorithm enhances and improves features of previous attempts to sample knockoffs under the multivariate setting, with the three main contributions being: 1) the truncation of the D-vine copula, which reduces the dependence between the original variables and their corresponding knockoffs, improving the statistical power; 2) the employment of a straightforward non-parametric formulation for marginal transformations, eliminating the need for a specific parametric family or a kernel density estimator; 3) the use of the "rvinecopulib'' R package offers better flexibility than the existing fitting vine copula knockoff methods. To eliminate the randomness in distinct realizations resulting in different sets of selected variables, we wrap the TDCK method with an existing derandomizing procedure for knockoffs, leading to a Derandomized Truncated D-vine Copula Knockoffs with e-values (DTDCKe) procedure. We demonstrate the robustness of the DTDCKe procedure under various scenarios with extensive simulation studies. We further illustrate its efficacy using a gene expression dataset, showing it achieves a more reliable gene selection than other competing methods, when the findings are compared with those of a meta-analysis. The results indicate that our Truncated D-vine copula approach is robust and has superior power, representing an appealing approach for variable selection in different multivariate applications, particularly in gene expression analysis.

Replica Analysis for Ensemble Techniques in Variable Selection

Ising Model Selection Using ℓ1ℓ1\ell_{1}-Regularized Linear Regression: A Statistical Mechanics Analysis

Ising Model Selection Using 𝓁-Regularized Linear Regression.

Ising Model Selection Using ℓ_1-Regularized Linear Regression: A Statistical Mechanics Analysis

A Novel Technique To Prune Variable Selection Ensembles

Variable Selection with the Knockoffs: Composite Null Hypotheses

Instability of Variable-selection Algorithms Used to Identify True Predictors of an Outcome in Intermediate-dimension Epidemiologic Studies

A Novel Bagging Ensemble Approach for Variable Ranking and Selection for Linear Regression Models

Sequential Knockoffs for Variable Selection in Reinforcement Learning

The Stochastic Replica Approach to Machine Learning: Stability and Parameter Optimization

Improving the Stability of the Knockoff Procedure: Multiple Simultaneous Knockoffs and Entropy Maximization

An Association-Based Evolutionary Ensemble Method of Variable Selection.

Randomizing Outputs to Increase Variable Selection Accuracy.

Stab-GKnock: Controlled variable selection for partially linear models using generalized knockoffs

Knockoff Boosted Tree for Model-Free Variable Selection

Derandomized Truncated D-vine Copula Knockoffs with e-values to control the false discovery rate

Ensembling Variable Selectors by Stability Selection for the Cox Model

Ensemble Regression Coefficient Analysis for Application to Near-Infrared Spectroscopy

Variable Selection in Rank Regression for Analyzing Longitudinal Data

Nonparametric Assessment of Variable Selection and Ranking Algorithms