An empirical study of a simple incremental classifier based on vector quantization and adaptive resonance theory

Sylwester Czmil,Jacek Kluska,Anna Czmil
DOI: https://doi.org/10.61822/amcs-2024-0011
IF: 2.157
2024-01-01
International Journal of Applied Mathematics and Computer Science
Abstract:When constructing a new data classification algorithm, relevant quality indices such as classification accuracy (ACC) or the area under the receiver operating characteristic curve (AUC) should be investigated. End-users of these algorithms are interested in high values of the metrics as well as the proposed algorithm’s understandability and transparency. In this paper, a simple evolving vector quantization (SEVQ) algorithm is proposed, which is a novel supervised incremental learning classifier. Algorithms from the family of adaptive resonance theory and learning vector quantization inspired this method. Classifier performance was tested on 36 data sets and compared with 10 traditional and 15 incremental algorithms. SEVQ scored very well, especially among incremental algorithms, and it was found to be the best incremental classifier if the quality criterion is the AUC. The Scott–Knott analysis showed that SEVQ is comparable in performance to traditional algorithms and the leading group of incremental algorithms. The Wilcoxon rank test confirmed the reliability of the obtained results. This article shows that it is possible to obtain outstanding classification quality metrics while keeping the conceptual and computational simplicity of the classification algorithm.
automation & control systems,computer science, artificial intelligence,mathematics, applied
What problem does this paper attempt to address?