Abstract:Machine learning models are used to create and enhance various disease prediction frameworks. Ensemble learning is a machine learning technique that combines multiple classifiers to improve performance by making more accurate predictions than a single classifier. Although numerous studies have employed ensemble approaches for disease prediction, there is a lack of thorough assessment of commonly used ensemble approaches against highly researched diseases. Consequently, this study aims to identify significant trends in the performance accuracies of ensemble techniques (i.e., bagging, boosting, stacking, and voting) against five hugely researched diseases (i.e., diabetes, skin disease, kidney disease, liver disease, and heart conditions). Using a well-defined search strategy, we first identified 45 articles from the current literature that applied two or more of the four ensemble approaches to any of these five diseases and were published in 2016–2023. Although stacking has been used the fewest number of times (23) compared with bagging (41) and boosting (37), it showed the most accurate performance the most times (19 out of 23). The voting approach is the second-best ensemble approach, as revealed in this review. Stacking always revealed the most accurate performance in the reviewed articles for skin disease and diabetes. Bagging demonstrated the best performance for kidney disease (five out of six times) and boosting for liver and diabetes (four out of six times). The results show that stacking has demonstrated greater accuracy in disease prediction than the other three candidate algorithms. Our study also demonstrates variability in the perceived performance of different ensemble approaches against frequently used disease datasets. The findings of this work will assist researchers in better understanding current trends and hotspots in disease prediction models that employ ensemble learning, as well as in determining a more suitable ensemble model for predictive disease analytics. This article also discusses variability in the perceived performance of different ensemble approaches against frequently used disease datasets.

Ensemble learning: A survey

Ensemble Learning Techniques and its Efficiency in Machine Learning: A Survey

A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects

Ensemble Methods: Foundations and Algorithms

Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography

Ensemble based systems in decision making

Ensemble Reinforcement Learning: A Survey

Ensemble deep learning: A review

A practical tutorial on bagging and boosting based ensembles for machine learning: Algorithms, software tools, performance study, practical perspectives and opportunities

Credit Scoring Models Using Ensemble Learning and Classification Approaches: A Comprehensive Survey

Voting Combinations-Based Ensemble: A Hybrid Approach

Ensemble Multifeatured Deep Learning Models and Applications: A Survey

A compressed sensing approach for efficient ensemble learning

Classifiers Combination with Observational Learning

Subspace Ensembles for Classification

Ensemble Methods For Class Imbalance Learning

On Optimizing Ensemble Models using Column Generation

Ensemble Learning for Disease Prediction: A Review

Clustering Ensemble Approaches: an Overview

Ensemble Learning through Diversity Management: Theory, Algorithms, and Applications