Abstract:The discovery of Markov boundaries is highly effective at identifying features that are causally related to the target variable, providing strong interpretability and robustness. While there are numerous methods for discovering Markov boundaries in real-world applications, no single method is universally applicable to all datasets. Therefore, in order to balance precision and recall, we propose an ensemble framework of divide-and-conquer Markov boundary discovery algorithms based on U-I selection strategy. We put three divide-and-conquer Markov boundary methods into the framework to obtain an ensemble algorithm, focusing on judging controversial parent–child variables to further balance precision and recall. By combining multiple algorithms, the ensemble algorithm can leverage their respective strengths and more thoroughly analyze the cause-and-effect relationships of target variables through various perspectives. Furthermore, it can enhance the robustness of the algorithm and reduce dependence on a single algorithm. In the experiment, we select four advanced Markov boundary discovery algorithms as comparison algorithms and compare them on nine benchmark Bayesian networks and three real-world datasets. The results show that EDMB ranks first in the overall ranking, which illustrates the superiority of the integrated algorithm and the effectiveness of the adopted U-I selection strategy. The main contribution of this paper lies in proposing an ensemble framework for divide-and-conquer Markov boundary discovery algorithms, balancing precision and recall through the U-I selection strategy, and judging controversial parent–child variables to enhance algorithm performance and robustness. The advantage of the U-I selection strategy and its difference from existing methods is the ability to independently obtain the maximum precision and recall of multiple algorithms within the ensemble framework. By assessing controversial parent–child variables, it further balances precision and recall, leading to results that are closer to the true Markov boundary.

Practical Markov Boundary Learning Without Strong Assumptions.

Accurate Markov Boundary Discovery for Causal Feature Selection.

Multi-Target Markov Boundary Discovery: Theory, Algorithm, and Application.

Analysis of Markov Boundary Induction in Bayesian Networks: A New View from Matroid Theory

Broad Minimax Probability Learning System and its Application in Regression Modeling

Mining Markov Blankets Without Causal Sufficiency

Boundary-restricted metric learning

Causal Feature Selection With Dual Correction

Analyzing and Improving Supervised Nonlinear Dynamical Probabilistic Latent Variable Model for Inferential Sensors

Markov Boundary-Based Outlier Mining

Multi-label Causal Variable Discovery: Learning Common Causal Variables and Label-specific Causal Variables

Bounds optimization of model response moments: a twin-engine Bayesian active learning method

Stable Prediction Across Unknown Environments

A Novel Ensemble Method of Divide-and-Conquer Markov Boundary Discovery for Causal Feature Selection

Probabilistic Feature Selection and Classification Vector Machine

A Bayesian Approach to Learning Bandit Structure in Markov Decision Processes

An Information-Theoretic Analysis of Bayesian Reinforcement Learning

Learning Car-Following Behaviors Using Bayesian Matrix Normal Mixture Regression

Boundary Exploration for Bayesian Optimization With Unknown Physical Constraints

Markov Kernels and the Conditional Extreme Value Model

Learning Counterfactual Distributions via Kernel Nearest Neighbors