Abstract:Most existing imbalanced data classification models mainly focus on the classification performance of majority class samples, and many clustering algorithms need to manually specify the initial cluster centers and the number of clusters. To solve these drawbacks, this study presents a novel feature reduction method for imbalanced data classification using similarity-based feature clustering with adaptive weighted k-nearest neighbors (AWKNN). First, the similarity between samples is evaluated by the difference and smaller value between samples on each dimension, a similarity measure matrix is then developed to measure the similarity between clusters, after which a new hierarchical clustering model is constructed. By combining the cluster center of each sample cluster with its nearest neighbor, new samples are generated. Then, a hybrid sampling model based on similarity measure is presented by putting the generated samples into imbalanced data and removing samples from majority classes. Thus, a balanced decision system is constructed based on generated samples and minority class samples. Second, to address the issues that the traditional symmetric uncertainty only considers the correlation between features, and mutual information ignores the added information after classification, the normalized information gain is introduced to design new symmetric uncertainty between each feature and the other features; then, the ordered sequence and the average of the symmetric uncertainty difference of each feature are provided to adaptively select the k-nearest neighbors of features. Moreover, the weight of the k-th nearest neighbor of features is defined to present the AWKNN density of features and their ordered sequence for clustering features. Finally, by combining the weighted average redundancy with the symmetric uncertainty between features and decision classes, the maximum relevance between each feature and decision classes, and the minimum redundancy among features in the same cluster is presented to select the optimal feature subset from the feature clusters. Experiments applied to 29 imbalanced datasets show that the developed algorithm is effective and can select the optimal feature subset with high classification accuracy for imbalanced data.

KNN-based Maximum Margin and Minimum Volume Hyper-Sphere Machine for Imbalanced Data Classification

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

A Multi-Class Large Margin Classifier

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

Novel One-Vs-rest Classifier Based on SVM and Multi-Spheres

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

Homocentric quadratic surfaces and maximum margin approach for imbalanced data classification

One-Sided Fuzzy SVM Based on Sphere for Imbalanced Data Sets Learning

Binary classification for imbalanced datasets using twin hyperspheres based on conformal method

The Ensemble of Density-Sensitive SVDD Classifier Based on Maximum Soft Margin for Imbalanced Datasets.

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Feature reduction for imbalanced data classification using similarity-based feature clustering with adaptive weighted K-nearest neighbors

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Under-bagging Nearest Neighbors for Imbalanced Classification

Kernel-Free Universum Quadratic Surface Twin Support Vector Machines for Imbalanced Data

Learning Imbalanced Datasets with Maximum Margin Loss

Least squares KNN-based weighted multiclass twin SVM

Support Vector Classification Using Hypersphere

An Extended Fuzzy-Knn Approach to Solving Class-Imbalanced Problems

An Effective Multiclass Twin Hypersphere Support Vector Machine and Its Practical Engineering Applications

Three-way Imbalanced Learning based on Fuzzy Twin SVM