Ensemble of classifiers based on score function defined by clusters and decision boundary of linear base learners

Pawel Trajdos,Robert Burduk
DOI: https://doi.org/10.1016/j.knosys.2024.112411
IF: 8.139
2024-08-30
Knowledge-Based Systems
Abstract:One possible type of base classifier output is a scoring function, which can be regarded as the probability that the class label is the true one. The measurement expressed by the score function can be of very different natures: distances, probabilities, or confidence. In this paper, we propose determining score function value based on two factors: the distance of the object from the decision boundary and the clustering of the object in the feature space. In the proposed framework, the above-mentioned scores are combined by a weighted average, and the classifier ensemble is created using the bagging or boosting technique. The proposed method was compared with five reference methods for determining the score function based on the distance between the object and the classifier decision boundary. The experimental results on 63 publicly available datasets clearly show that the proposed method outperforms the reference methods in the context of four classification performance metrics.
computer science, artificial intelligence
What problem does this paper attempt to address?