Abstract:Instance is important in data analysis and mining; it filters out unrepresentative, redundant, or noisy data from a given training set to obtain effective model learning. Various instance selection algorithms are proposed in the literature, and their potential and applicability in data cleaning and preprocessing steps are demonstrated. For multiclass classification datasets, the existing instance selection algorithms must deal with all the instances across the different classes simultaneously to produce a reduced training set. Generally, every multiclass classification dataset can be regarded as a complex domain problem, which can be effectively solved using the divide‐and‐conquer principle. In this study, the one‐versus‐all (OVA) and one‐versus‐one (OVO) decomposition approaches were used to decompose a multiclass dataset into multiple binary class datasets. These approaches have been widely employed when constructing the classifier but have never been considered in instance selection. The results of instance selection performance obtained with the OVA, OVO, and baseline approaches were assessed and compared for 20 different domain multiclass datasets as the first study and five medical domain datasets as the validation study. Furthermore, three instance selection algorithms were compared, including IB3, DROP3, and GA. The results demonstrate that using the OVO approach to perform instance selection can make the support vector machine (SVM) and k‐nearest neighbour (k‐NN) classifiers perform significantly better than the OVA and baseline approaches in terms of the area under the ROC curve (AUC) rate, regardless of the instance selection algorithm used. Moreover, the OVO approach can provide reasonably good data reduction rates and processing times, which are all better than those of the OVA approach.

A multiclass classification using one-versus-all approach with the differential partition sampling ensemble

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

Multi-Classification using One-versus-One Deep Learning Strategy with Joint Probability Estimates

An ensemble imbalanced classification method based on model dynamic selection driven by data partition hybrid sampling

Enhancing Multi-Class Classification in One-Versus-One Strategy: A Type of Base Classifier Modification and Weighted Voting Mechanism

Evolutionary Mahalanobis Distance-Based Oversampling for Multi-Class Imbalanced Data Classification

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Beyond one-against-all (OAA) and one-against-one (OAO): An exhaustive and parallel half-against-half (HAH) strategy for multi-class classification and applications to metabolomics

Instance selection using one‐versus‐all and one‐versus‐one decomposition approaches in multiclass classification datasets

VCOS: A Novel Synergistic Oversampling Algorithm in Binary Imbalance Classification

Two-step ensemble under-sampling algorithm for massive imbalanced data classification

An effective method using clustering-based adaptive decomposition and editing-based diversified oversamping for multi-class imbalanced datasets

A Classification Method for Imbalance Data Set Based on Hybrid Strategy

Experimental Study and Comparison of Imbalance Ensemble Classifiers with Dynamic Selection Strategy

Research on Imbalanced Data Classification Based on Ensemble and Under-Sampling

A Novel Multi-class Classification Architecture Combining Population-based Sampling and Multi-expert Classifier for Imbalanced Data.

One-sided Dynamic Undersampling No-Propagation Neural Networks for Imbalance Problem.

A New Sampling Approach for Classification of Imbalanced Data Sets with High Density.

Multi-Class Imbalance Problem: A Multi-Objective Solution