Abstract:Ensemble models in classification problems often encounter learning collision during joint training, where multiple base learners learn similar data representations concurrently. This phenomenon can diminish diversity and confidence in classification, especially in the context of medical image analysis, potentially leading to biased class predictions and classification errors. In this study, we tackle this issue by proposing ensemble models that combine both joint and independent training methodologies on the same medical image dataset. Our key contribution lies in explicitly controlling diversity through the design of the loss function. We fine-tuned the ResNet50V2 base learner, resulting in a significant 3% increase in training accuracy (86.00% compared to the previous 83.00%). Losses decreased from 0.42±0.44 to 0.40±0.42 . For ResNet101V2, we observed a 2.27 percentage point increase in training accuracy (84.57% compared to the previous 82.30%) and reduced loss values to 0.357±0.367 from the previous 0.428±0.448 . Furthermore, we conducted a comparative analysis of our optimized ensemble models, both with and without pruning, to assess their impact on model performance and to better understand their efficacy compared to earlier research work. The results underscore the effectiveness of our approach in mitigating learning collision and enhancing classification accuracy, particularly in the domain of medical image classification. Overall, our approach effectively reduces learning collision and improves classification accuracy as well as test accuracy on unseen medical images, addressing a significant gap in COVID-19 identification. This novel approach holds promise for ensemble models in medical image classification, particularly for lung-related diseases.

Ensemble One-class Classifiers Based on Hybrid Diversity Generation and Pruning

Ensemble Classifier Design Based on Perturbation Binary Salp Swarm Algorithm for Classification

An optimal pruning algorithm of classifier ensembles: dynamic programming approach

Dynamically building diversified classifier pruning ensembles via canonical correlation analysis

Diversity Regularized Ensemble Pruning.

An Integrated Pruning Criterion for Ensemble Learning Based on Classification Accuracy and Diversity.

Application of adaptive ensemble algorithm based on correctness and diversity

An ensemble pruning method considering classifiers' interaction based on information theory for facial expression recognition

Using dual evolutionary search to construct decision tree based ensemble classifier

Ensemble Pruning: A Submodular Function Maximization Perspective.

A multiclass classification using one-versus-all approach with the differential partition sampling ensemble

A Hybrid Ensemble Algorithm Combining AdaBoost and Genetic Algorithm for Cancer Classification with Gene Expression Data.

Ensemble Learning through Diversity Management: Theory, Algorithms, and Applications

When does Diversity Help Generalization in Classification Ensembles?

Learning to Diversify via Weighted Kernels for Classifier Ensemble

On the Diversity-Performance Relationship for Majority Voting in Classifier Ensembles.

A New Rotation Forest Ensemble Algorithm

Enhancing medical image classification through controlled diversity in ensemble learning

Pareto Ensemble Pruning

On the Relationships among Various Diversity Measures in Multiple Classifier Systems

Classifier Ensemble Selection for Language Verification System