Abstract:Multi-label learning has attracted a great deal of research interests as it has a wide range of real-world applications. Although many multi-label learning methods have been proposed, very few of them have addressed the problem of class imbalance distribution in multi-label data. Moreover, most of the existing class imbalance multi-label learning algorithms only focus on solving the class imbalance problem, without taking into account the correlations among labels. To address these issues simultaneously, we propose to combine the well-known ensemble of classifier chain (ECC) algorithm with various binary-class imbalance learning techniques such as sampling, cost-sensitive learning, and threshold moving. This approach creates a new algorithm family called ECC++, designed specifically for class imbalance multi-label learning. ECC is already an excellent ensemble high-order binary relevance multi-label learning algorithm that is well-suited to exploiting correlations among labels. Combining it with binary-class imbalance learning techniques enables each link in a classifier chain (CC) to overcome the negative effect of skewed data distribution. ECC++ is a dynamic algorithm family that can be extended arbitrarily by applying any new binary-class imbalance learning techniques. To demonstrate the effectiveness and superiority of the proposed ECC++ algorithm family, we developed several ECC++ family members using some popular binary-class imbalance learning techniques. We then compared them with several state-of-the-art class imbalance multi-label learning algorithms on twelve benchmark and four real-world multi-label datasets. Our experimental results showed the effectiveness and superiority of the proposed ECC++ algorithm family over existing class imbalance multi-label learning algorithms. In conclusion, the proposed ECC++ algorithm family combines the strengths of the well-established ECC algorithm and binary-class imbalance learning techniques, resulting in a superior methodology for class imbalance multi-label learning.

SAMME.C2 algorithm for imbalanced multi-class classification

The SAMME.C2 algorithm for severely imbalanced multi-class classification

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

Multi-class AdaBoost ELM

CUSBoost: Cluster-based Under-sampling with Boosting for Imbalanced Classification

Cost-Sensitive Alternating Direction Method Of Multipliers For Large-Scale Classification

A cluster-based SMOTE both-sampling (CSBBoost) ensemble algorithm for classifying imbalanced data

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Cost-sensitive Multi-Layer Perceptron for Binary Classification with Imbalanced Data

ECC + +: An algorithm family based on ensemble of classifier chains for classifying imbalanced multi-label data

A New Sampling Approach for Classification of Imbalanced Data Sets with High Density.

An empirical study on the performance of cost-sensitive boosting algorithms with different levels of class imbalance

A Novel Multi-class Classification Architecture Combining Population-based Sampling and Multi-expert Classifier for Imbalanced Data.

Over-sampling Algorithm Based on Adaboost in Unbalanced Data Set

IMBALANCED DATA CLASSIFICATION ACTIVE LEARNING ALGORITHM BASED ON BOOSTING

Self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification

A hybrid ensemble and evolutionary algorithm for imbalanced classification and its application on bioinformatics

Totally-Corrective Multi-Class Boosting

Evolutionary Mahalanobis Distance-Based Oversampling for Multi-Class Imbalanced Data Classification

DCSVM: fast multi-class classification using support vector machines