Abstract:Imbalanced distributions present a great problem in machine learning classification tasks. Various algorithms based on cost-sensitive learning have been developed to address the imbalanced distribution problem. However, classes with a hierarchical tree structure create a new challenge for cost-sensitive learning. In this paper, we propose a cost-sensitive hierarchical classification method based on multi-scale information entropy. We construct an information entropy threshold for each level in the tree structure and assign cost-sensitive weights accordingly. First, we use the class hierarchy to divide a large hierarchical classification problem into several smaller sub-classification problems. In this way, a large-scale classification task can be decomposed into multiple, controllable, small-scale classification tasks. Second, we use a logistic regression algorithm to obtain the probabilities of classes at each level. Then, we consider the information entropy at each level as a threshold, which decreases inter-level error propagation in the tree structure. Finally, we design a cost-sensitive model based on the information of each class and use hierarchical information entropy weights as cost-sensitive weights. Information entropy measures the information of the majority and minority classes and allocates them different cost weights to solve imbalanced distribution problems. Experiments on four imbalanced distribution datasets demonstrate that the cost-sensitive hierarchical classification algorithm provides excellent efficiency and effectiveness.

A Study on the Effiect of Class Distribution Using Cost-Sensitive Learning

The Influence of Class Imbalance on Cost-Sensitive Learning: an Empirical Study.

On Multi-Class Cost-Sensitive Learning

Towards cost-sensitive learning for real-world applications

Cost-Sensitive Classification Using Decision Trees, Boosting and MetaCost

Cost Sensitive Support Vector Machines

Learning When Training Data are Costly: The Effect of Class Distribution on Tree Induction

SVM-Based Cost-sensitive Classification Algorithm with Error Cost and Class-dependent Reject Cost

Privacy-Preserving Cost-Sensitive Learning

Optimization of Selective Ensemble for Cost-Sensitive Classification: an Empirical Study

An adaptive cost-sensitive learning approach in neural networks to minimize local training–test class distributions mismatch

An empirical study on the performance of cost-sensitive boosting algorithms with different levels of class imbalance

Cost-Sensitive Large Margin Distribution Machine

Learning Only When It Matters: Cost-Aware Long-Tailed Classification

Nonparametric active learning for cost-sensitive classification

Cost-sensitive Collaborative Representation Based Classification Via Probability Estimation with Addressing the Class Imbalance

Cost-sensitive hierarchical classification for imbalance classes

Training cost-sensitive neural networks with methods addressing the class imbalance problem

Cost Sensitive Semi-Supervised Laplacian Support Vector Machine

Cost-sensitive Hierarchical Classification Via Multi-Scale Information Entropy for Data with an Imbalanced Distribution

An adaptive Cost-sensitive Classifier