Abstract:Instance is important in data analysis and mining; it filters out unrepresentative, redundant, or noisy data from a given training set to obtain effective model learning. Various instance selection algorithms are proposed in the literature, and their potential and applicability in data cleaning and preprocessing steps are demonstrated. For multiclass classification datasets, the existing instance selection algorithms must deal with all the instances across the different classes simultaneously to produce a reduced training set. Generally, every multiclass classification dataset can be regarded as a complex domain problem, which can be effectively solved using the divide‐and‐conquer principle. In this study, the one‐versus‐all (OVA) and one‐versus‐one (OVO) decomposition approaches were used to decompose a multiclass dataset into multiple binary class datasets. These approaches have been widely employed when constructing the classifier but have never been considered in instance selection. The results of instance selection performance obtained with the OVA, OVO, and baseline approaches were assessed and compared for 20 different domain multiclass datasets as the first study and five medical domain datasets as the validation study. Furthermore, three instance selection algorithms were compared, including IB3, DROP3, and GA. The results demonstrate that using the OVO approach to perform instance selection can make the support vector machine (SVM) and k‐nearest neighbour (k‐NN) classifiers perform significantly better than the OVA and baseline approaches in terms of the area under the ROC curve (AUC) rate, regardless of the instance selection algorithm used. Moreover, the OVO approach can provide reasonably good data reduction rates and processing times, which are all better than those of the OVA approach.

Experimental Comparisons of Instances Set Reduction Algorithms

A relative position view-based instances set reduction algorithm

Analysis On Classification Performance Of Rough Set Based Reducts

Fast Data Reduction with Granulation-Based Instances Importance Labeling.

A Brief Survey of Dimension Reduction

Unsupervised Attribute Reduction: Improving Effectiveness and Efficiency

Experimental Comparisons of Multi-class Classifiers.

An Experimental Study of Four Typical Test Suite Reduction Techniques

Comparison of Instance Selection and Construction Methods with Various Classifiers

A Parallel Attribute Reduction Method Based on Classification

An Experimental Comparison of Four Test Suite Reduction Techniques.

Parallel Selector for Feature Reduction

FCNN-MR: A Parallel Instance Selection Method Based on Fast Condensed Nearest Neighbor Rule

Attribute Reduction of Data with Error Ranges and Test Costs

An In-Depth Analysis of Data Reduction Methods for Sustainable Deep Learning

An Empirical Comparison of Bias Reduction Methods on Real-World Problems in High-Stakes Policy Settings

An Accelerating Reduction Approach for Incomplete Decision Table Using Positive Approximation Set

A heuristic hybrid instance reduction approach based on adaptive relative distance and k-means clustering

The Rule-Matching Algorithm of Decision Tree Attribute Reduction

A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques

Instance selection using one‐versus‐all and one‐versus‐one decomposition approaches in multiclass classification datasets