Abstract:Accurate identification of direct causal(parental) variables for a target is of primary interest in many applications, especially in biomedicine. It could promote our understanding of the underlying pathophysiological mechanism and facilitate the discovery of new biomarkers and therapeutic targets for studied clinical outcomes. However, many researchers are inclined to resort to association-based machine learning methods to identify outcome-associated variables. And many of the identified variables may prove to be irrelevant. On the other hand, there is a lack of an efficient method for reliable parental set identification, especially in high-dimensional settings (e.g., biomedicine). Here, we proposed a novel and efficient two-stage approach (I-GCM) to discover the direct causal variables (including genetic and clinical variables) for various outcomes. Variable selection was first performed by the PC-simple algorithm. Then it exploited the invariance of causal relations in different (experimental) settings, which was represented by generalized covariance measure calculated from gradient-boosted trees, for efficient and reliable causal variable discovery. We first verified the proposed method through extensive simulations. This approach constantly yielded high precision (a.k.a., positive predictive value) and specificity while maintaining satisfactory sensitivity in general, and consistently outperformed a standard Notably, the precision was larger than 90% in our simulated scenarios, even in high-dimensional settings. We then applied the proposed method to 4 clinical traits to uncover the corresponding direct causal variables. Encouragingly, many identified clinical variables, genes and pathways were supported by the literature. Our proposed method constantly achieved superior performance in identifying actual direct causal variables, making it particularly useful in selecting what (genetic/clinical) risk factors to follow up. Importantly, our work represents one of the first applications of the invariance principle for causal inference in biomedical or clinical studies, and suggests a new avenue for causal discovery in these settings.

Domain knowledge-enhanced variable selection for biomedical data analysis

Variable Selection in Logistic Regression Model with Genetic Algorithm.

A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)

Statistical Challenges with High Dimensionality: Feature Selection in Knowledge Discovery

Interrelated feature selection from health surveys using domain knowledge graph

A survey on incorporating domain knowledge into deep learning for medical image analysis

Controlled variable selection with nonconvex regularization for identifying biomarkers

Multivariate Bayesian variable selection with application to multi-trait genetic fine mapping

Domain constraints improve risk prediction when outcome data is missing

Variable Importance Assessments and Backward Variable Selection for High-Dimensional Data

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning

False discovery control for penalized variable selections with high-dimensional covariates.

On Gleaning Knowledge from Multiple Domains for Active Learning

Repeated Sieving for Prediction Model Building with High-Dimensional Data

Variable selection for partially linear models via Bayesian subset modeling with diffusing prior

Variable selection for sparse Dirichlet-multinomial regression with an application to microbiome data analysis

Variable Selection Using Nonlocal Priors in High-Dimensional Generalized Linear Models With Application to fMRI Data Analysis

Variable selection in high-dimensional logistic regression models using a whitening approach

Direct causal variable discovery leveraging the invariance principle: application in biomedical studies

A Model-free Variable Screening Method Based on Leverage Score

Imbalanced Data Classification:A Survey and Experiments in Medical Domain