Abstract:Most existing imbalanced data classification models mainly focus on the classification performance of majority class samples, and many clustering algorithms need to manually specify the initial cluster centers and the number of clusters. To solve these drawbacks, this study presents a novel feature reduction method for imbalanced data classification using similarity-based feature clustering with adaptive weighted k-nearest neighbors (AWKNN). First, the similarity between samples is evaluated by the difference and smaller value between samples on each dimension, a similarity measure matrix is then developed to measure the similarity between clusters, after which a new hierarchical clustering model is constructed. By combining the cluster center of each sample cluster with its nearest neighbor, new samples are generated. Then, a hybrid sampling model based on similarity measure is presented by putting the generated samples into imbalanced data and removing samples from majority classes. Thus, a balanced decision system is constructed based on generated samples and minority class samples. Second, to address the issues that the traditional symmetric uncertainty only considers the correlation between features, and mutual information ignores the added information after classification, the normalized information gain is introduced to design new symmetric uncertainty between each feature and the other features; then, the ordered sequence and the average of the symmetric uncertainty difference of each feature are provided to adaptively select the k-nearest neighbors of features. Moreover, the weight of the k-th nearest neighbor of features is defined to present the AWKNN density of features and their ordered sequence for clustering features. Finally, by combining the weighted average redundancy with the symmetric uncertainty between features and decision classes, the maximum relevance between each feature and decision classes, and the minimum redundancy among features in the same cluster is presented to select the optimal feature subset from the feature clusters. Experiments applied to 29 imbalanced datasets show that the developed algorithm is effective and can select the optimal feature subset with high classification accuracy for imbalanced data.

A heuristic hybrid instance reduction approach based on adaptive relative distance and k-means clustering

Feature reduction for imbalanced data classification using similarity-based feature clustering with adaptive weighted K-nearest neighbors

Natural Neighbor Reduction Algorithm for Instance-based Learning

Hybrid k-Nearest Neighbor Classifier.

PRLDPC: A Heuristics Prototype Reduction Method Based on Supervised Local Density Clustering for Instance-Based Classifiers

Hybrid Dynamic K-Nearest-neighbour and Distance and Attribute Weighted Method for Classification

Scaling KNN Multi-Class Twin Support Vector Machine Via Safe Instance Reduction

Feature and Instance Reduction for PNN Classifiers Based on Fuzzy Rough Sets

Efficient Knn Classification with Different Numbers of Nearest Neighbors.

A hybrid real-valued negative selection algorithm with variable-sized detectors and the k-nearest neighbors algorithm

Incremental Reduction of Imbalanced Distributed Mixed Data Based on K-Nearest Neighbor Rough Set

An adaptive highly improving the accuracy of clustering algorithm based on kernel density estimation

A Hybrid Outlier Detection Method for Health Care Big Data

A novel hybridization approach to improve the critical distance clustering algorithm: Balancing speed and quality

Attribute reduction for hybrid data based on statistical distribution of data and fuzzy evidence theory

A parameter-free hybrid instance selection algorithm based on local sets with natural neighbors

Combining Multiple K-Nearest Neighbor Classifiers Using Different Distance Functions

A new fast reduction technique based on binary nearest neighbor tree.

Constraint Nearest Neighbor for Instance Reduction.

A New K-Harmonic Nearest Neighbor Classifier Based on the Multi-Local Means

Attribute reduction based on overlap degree and k-nearest-neighbor rough sets in decision information systems