Abstract:Machine learning models are used to create and enhance various disease prediction frameworks. Ensemble learning is a machine learning technique that combines multiple classifiers to improve performance by making more accurate predictions than a single classifier. Although numerous studies have employed ensemble approaches for disease prediction, there is a lack of thorough assessment of commonly used ensemble approaches against highly researched diseases. Consequently, this study aims to identify significant trends in the performance accuracies of ensemble techniques (i.e., bagging, boosting, stacking, and voting) against five hugely researched diseases (i.e., diabetes, skin disease, kidney disease, liver disease, and heart conditions). Using a well-defined search strategy, we first identified 45 articles from the current literature that applied two or more of the four ensemble approaches to any of these five diseases and were published in 2016–2023. Although stacking has been used the fewest number of times (23) compared with bagging (41) and boosting (37), it showed the most accurate performance the most times (19 out of 23). The voting approach is the second-best ensemble approach, as revealed in this review. Stacking always revealed the most accurate performance in the reviewed articles for skin disease and diabetes. Bagging demonstrated the best performance for kidney disease (five out of six times) and boosting for liver and diabetes (four out of six times). The results show that stacking has demonstrated greater accuracy in disease prediction than the other three candidate algorithms. Our study also demonstrates variability in the perceived performance of different ensemble approaches against frequently used disease datasets. The findings of this work will assist researchers in better understanding current trends and hotspots in disease prediction models that employ ensemble learning, as well as in determining a more suitable ensemble model for predictive disease analytics. This article also discusses variability in the perceived performance of different ensemble approaches against frequently used disease datasets.

Ensemble Learning Techniques and its Efficiency in Machine Learning: A Survey

Ensemble learning: A survey

A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects

Ensemble Methods: Foundations and Algorithms

Ensemble Multifeatured Deep Learning Models and Applications: A Survey

Ensemble Reinforcement Learning: A Survey

Ensemble based systems in decision making

Ensemble deep learning: A review

Ensemble Transfer Learning Algorithm

A Survey on ensemble learning under the era of deep learning

Research and development of neural network ensembles: a survey

Online learning: A comprehensive survey

Credit Scoring Models Using Ensemble Learning and Classification Approaches: A Comprehensive Survey

Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography

A practical tutorial on bagging and boosting based ensembles for machine learning: Algorithms, software tools, performance study, practical perspectives and opportunities

Technology-Enhanced Collaborative and Blended Learning Ensemble Learning: An Approach in Artificial Intelligence

Empirical Evaluation of Ensemble Learning for Credit Scoring

Clustering Ensemble Approaches: an Overview

Ensemble Learning through Diversity Management: Theory, Algorithms, and Applications

A compressed sensing approach for efficient ensemble learning

Ensemble Learning for Disease Prediction: A Review