Abstract:Most existing imbalanced data classification models mainly focus on the classification performance of majority class samples, and many clustering algorithms need to manually specify the initial cluster centers and the number of clusters. To solve these drawbacks, this study presents a novel feature reduction method for imbalanced data classification using similarity-based feature clustering with adaptive weighted k-nearest neighbors (AWKNN). First, the similarity between samples is evaluated by the difference and smaller value between samples on each dimension, a similarity measure matrix is then developed to measure the similarity between clusters, after which a new hierarchical clustering model is constructed. By combining the cluster center of each sample cluster with its nearest neighbor, new samples are generated. Then, a hybrid sampling model based on similarity measure is presented by putting the generated samples into imbalanced data and removing samples from majority classes. Thus, a balanced decision system is constructed based on generated samples and minority class samples. Second, to address the issues that the traditional symmetric uncertainty only considers the correlation between features, and mutual information ignores the added information after classification, the normalized information gain is introduced to design new symmetric uncertainty between each feature and the other features; then, the ordered sequence and the average of the symmetric uncertainty difference of each feature are provided to adaptively select the k-nearest neighbors of features. Moreover, the weight of the k-th nearest neighbor of features is defined to present the AWKNN density of features and their ordered sequence for clustering features. Finally, by combining the weighted average redundancy with the symmetric uncertainty between features and decision classes, the maximum relevance between each feature and decision classes, and the minimum redundancy among features in the same cluster is presented to select the optimal feature subset from the feature clusters. Experiments applied to 29 imbalanced datasets show that the developed algorithm is effective and can select the optimal feature subset with high classification accuracy for imbalanced data.

An optimization approach with weighted SCiForest and weighted Hausdorff distance for noise data and redundant data

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

An Improved Data-Efficiency Algorithm Based on Combining Isolation Forest and Mean Shift for Anomaly Data Filtering in Wind Power Curve

SW: A Weighted Space Division Framework for Imbalanced Problems with Label Noise

Resampling approach for imbalanced data classification based on class instance density per feature value intervals

SCOD: A Novel Semi-supervised Outlier Detection Framework

An adaptive over-sampling method for imbalanced data based on simultaneous clustering and filtering noisy

Adaptively Weighted PCA Algorithm

Noise-robust Oversampling for Imbalanced Data Classification

Self-weighted Discriminative Feature Selection Via Adaptive Redundancy Minimization

Out-of-Distribution Detection with Hilbert-Schmidt Independence Optimization

Ordinal Outlier Detection Based On Recursive Uniform Partitioning

On Saving Outliers for Better Clustering over Noisy Data.

Novel hybrid ensemble credit scoring model with stacking-based noise detection and weight assignment

WeightLOFCC: A Heuristic Weight-Setting Strategy of LOF Applied to Outlier Detection in Time Series Data

An Optimization Model for Outlier Detection in Categorical Data

Research on Optimization of Random Forest Algorithm Based on Spark

A neighborhood weighted-based method for the detection of outliers

An Optimal Feature Subset Selection Method Based On Distance Discriminant And Distribution Overlapping

Feature reduction for imbalanced data classification using similarity-based feature clustering with adaptive weighted K-nearest neighbors

Adaptive Subspace Optimization Ensemble Method for High-Dimensional Imbalanced Data Classification