Abstract:Performance metrics are usually evaluated only after the neural network learning process using an error cost function. This procedure can result in suboptimal model selection, particularly for imbalanced classification problems. This work proposes the direct use of these metrics as cost functions, which are often derived from the confusion matrix. Commonly used metrics are covered, namely AUC, G-mean, F1-score and AG-mean. The only implementation change for model training occurs in the backpropagation error term. The results were compared to the standard MLP using the Rprop learning algorithm, SMOTE, SMTTL, WWE and RAMOBoost. Sixteen classical benchmark datasets were used in the experiments. Based on average ranks, the proposed formulation outperformed Rprop and all sampling strategies, namely SMOTE, SMTTL and WWE, for all metrics. These results were statistically confirmed for AUC and G-mean in relation to Rprop. For F1-score and AG-mean, all algorithms were considered statistically equivalent. The proposal was also superior to RAMOBoost for G-mean given average ranks. However, it was statistically faster than RAMOBoost for all metrics. It was also faster than SMTTL and statistically equivalent to Rprop, SMOTE and WWE. More, the solutions obtained are generally non-dominated ones compared to all other techniques, for all metrics. The results showed that the direct use of performance metrics as cost functions for neural network training favors generalization capacity and also computation time in imbalanced classification problems. Its extension to other performance metrics derived directly from the confusion matrix is straightforward.

Financial Predictions Using Cost Sensitive Neural Networks for Multi-Class Learning

A Cost-Sensitive Deep Learning-Based Approach for Network Traffic Classification

An adaptive cost-sensitive learning approach in neural networks to minimize local training–test class distributions mismatch

Training cost-sensitive neural networks with methods addressing the class imbalance problem

Optimization of Selective Ensemble for Cost-Sensitive Classification: an Empirical Study

Adaptive Cost-Sensitive Learning in Neural Networks for Misclassification Cost Problems

Cost-Sensitive Variable Selection for Multi-Class Imbalanced Datasets Using Bayesian Networks

Adaptive learning cost‐sensitive convolutional neural network

Neyman-Pearson Multi-class Classification via Cost-sensitive Learning

On Multi-Class Cost-Sensitive Learning

Introducing cost-sensitive neural networks

Cost-Sensitive Learning based on Performance Metric for Imbalanced Data

Imbalanced Research of Deep Belief Network Based on Dynamic Cost Sensitive

Towards cost-sensitive learning for real-world applications

Imbalanced bearing fault diagnosis based on adaptive cost-sensitive neural network

A Cost-Sensitive Deep Belief Network for Imbalanced Classification

Cost Sensitive GNN-based Imbalanced Learning for Mobile Social Network Fraud Detection

Cost-Sensitive Deep Learning with Layer-Wise Cost Estimation

Cost-Sensitive Alternating Direction Method Of Multipliers For Large-Scale Classification

The Influence of Class Imbalance on Cost-Sensitive Learning: an Empirical Study.