Abstract:Learning from imbalanced datasets poses a major challenge in data mining community. When dealing with imbalanced datasets, conventional classification algorithms generally perform poorly as they are originally designed to work under balanced class distribution scenarios. Although there exist different methods to addressing this issue, sampling methods especially over-sampling techniques have shown great potentials as they aim to improve datasets itself rather than the classifiers, which can allow them to be used for any classifier. In this paper, we propose a novel adaptive weighted over-sampling for imbalanced datasets based on density peaks clustering with heuristic filtering. Unlike other clustering-based over-sampling methods, the proposed approach applies modified density peaks clustering rather than traditional k-means clustering techniques to cluster the minority instances due to its capability of accurately identifying sub-clusters with different sizes and densities, which is beneficial for the proposed method to simultaneously accommodate for between-class and within-class imbalance issues caused by various reasons. Subsequently, the size for each identified sub-cluster to be oversampled is adaptively determined according to its own size and density and then the minority instances within each sub-cluster are oversampled based on their probabilities inversely proportional to their distances to the majority class and their densities with the aim of generating more synthetic minority instances for borderline and sparser ones. Finally, in order to avoid the generation of overlapping, a heuristic filtering strategy is also developed to iteratively move the possibly overlapped minority instances away from the majority class. The extensive experimental results on the different imbalanced datasets demonstrate that the proposed approach can achieve better classification performance in most datasets as compared to the other existing over-sampling techniques. (C) 2020 Elsevier Inc. All rights reserved.

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Adaptive Weighted Over-Sampling for Imbalanced Datasets Based on Density Peaks Clustering with Heuristic Filtering

A sub-sampling algorithm preventing outliers

Sample-weighted Clustering Methods

Unbalanced data processing using deep sparse learning technique

An optimization approach with weighted SCiForest and weighted Hausdorff distance for noise data and redundant data

SW: A Weighted Space Division Framework for Imbalanced Problems with Label Noise

A Novel Adaptive Boundary Weighted and Synthetic Minority Oversampling Algorithm for Imbalanced Datasets.

Mitigating Data Imbalance and Noise: A Divergence-Based Approach with Enhanced Sample Selection

Weighted subspace anomaly detection in high-dimensional space

Generalized Re-Weighting Local Sampling Mean Discriminant Analysis

Weighted Linear Discriminant Analysis: An Effective Feature Extraction Method for Multi-Class Imbalanced Datasets

Global Data Distribution Weighted Synthetic Oversampling Technique for Imbalanced Learning

A double-weighted outlier detection algorithm considering the neighborhood orientation distribution of data objects

Self-Weighted Adaptive Locality Discriminant Analysis

Combine Value Clustering and Weighted Value Coupling Learning for Outlier Detection in Categorical Data

OALDPC: Oversampling Approach Based on Local Density Peaks Clustering for Imbalanced Classification

A neighborhood weighted-based method for the detection of outliers

AREA: Adaptive Reweighting Via Effective Area for Long-Tailed Classification

Adaptively weighted three-way decision oversampling: A cluster imbalanced-ratio based approach