Abstract:This paper presents a multi-algorithm fusion model (StackingGroup) based on the Stacking ensemble learning framework to address the variable selection problem in high-dimensional group structure data. The proposed algorithm takes into account the differences in data observation and training principles of different algorithms. It leverages the strengths of each model and incorporates Stacking ensemble learning with multiple group structure regularization methods. The main approach involves dividing the data set into K parts on average, using more than 10 algorithms as basic learning models, and selecting the base learner based on low correlation, strong prediction ability, and small model error. Finally, we selected the grSubset + grLasso, grLasso, and grSCAD algorithms as the base learners for the Stacking algorithm. The Lasso algorithm was used as the meta-learner to create a comprehensive algorithm called StackingGroup. This algorithm is designed to handle high-dimensional group structure data. Simulation experiments showed that the proposed method outperformed other R 2 , RMSE , and MAE prediction methods. Lastly, we applied the proposed algorithm to investigate the risk factors of low birth weight in infants and young children. The final results demonstrate that the proposed method achieves a mean absolute error ( MAE ) of 0.508 and a root mean square error ( RMSE ) of 0.668. The obtained values are smaller compared to those obtained from a single model, indicating that the proposed method surpasses other algorithms in terms of prediction accuracy.

Ensemble selection for superparent-one-dependence estimators

To Select or to Weigh: A Comparative Study of Linear Combination Schemes for SuperParent-One-Dependence Estimators

Efficient Learning Ensemble SuperParent-one-dependence Estimator by Maximizing Conditional Log Likelihood

To select or to weigh: a comparative study of model selection and model weighing for SPODE ensembles

Instance-based weighting filter for superparent one-dependence estimators

Model Weighting for One-Dependence Estimators by Measuring the Independence Assumptions

Weighted One-Dependence Forests Classifier.

Extracting Credible Dependencies for Averaged One-Dependence Estimator Analysis

K-Dependence Bayesian Classifier Ensemble

Semi-naive Exploitation of One-Dependence Estimators

Multi-Model Subset Selection

Averaged Tree-Augmented One-Dependence Estimators

Self-Adaptive Attribute Value Weighting for Averaged One-Dependence Estimators.

Ranking and Combining Latent Structured Predictive Scores without Labeled Data

Semi-supervised Weighting for Averaged One-Dependence Estimators

Sample-Based Attribute Selective A$n$ DE for Large Data

A penalized variable selection ensemble algorithm for high-dimensional group-structured data

Improved prediction rule ensembling through model-based data generation

Attribute Value Weighted Averaged One-Dependence Estimators with Kullback–Leibler Divergence

Metamodel selection based on stepwise regression

Dependency bagging