Abstract:Intelligent computer systems aim to help humans in making decisions. Many practical decision-making problems are classification problems in their nature, but standard classification algorithms often not applicable since they assume balanced distribution of classes and constant misclassification costs. From this point of view, algorithms that consider the cost of decisions are essential since they are more consistent with the requirements of real life. These algorithms generate decisions that directly optimize parameters valuable for business, for example, the costs savings. But despite on practical value of cost-sensitive algorithms, the little number of works study this problem concentrating mainly on the case when the cost of a classifier error is constant and does not depend on a specific example. However, many real-world classification tasks are example-dependent cost-sensitive (ECS), where the costs of misclassification vary between examples and not only within classes. Existing methods of ECS learning include just modifications of the simplest models of machine learning (naive Bayes, logistic regression, decision tree). These models produce promising results, but there is a need for further improvement in performance that can be achieved by using gradient-based ensemble methods. To break this gap, we present the ECS generalization of AdaBoost. We study three models which differ by the ways to introduce cost into the loss function: inside the exponent, outside the exponent, and both inside and outside the exponent. The results of the experiments on three synthetic and two real datasets (bank marketing and insurance fraud) show that example-dependent cost-sensitive modifications of AdaBoost outperform other known models. Empirical results also show that critical factors influencing the choice of the model are not only the distribution of features, which is typical for cost-insensitive and class-dependent cost-sensitive problems but also the distribution of costs. Next, since the outputs of AdaBoost are not well calibrated posterior probabilities, we check three approaches to calibration of classifier scores: Platt scaling, isotonic regression, and ROC modification. The results show that calibration not only significantly improves the performance of specific ECS models but allows making better capabilities of original AdaBoost. Obtained results provide new insight regarding the behavior of the cost-sensitive model from a theoretical point of view and prove that the presented approach can significantly improve the practical design of intelligent systems.

A CS-AdaBoost-BP model for product quality inspection

ARIMA-AdaBoost hybrid approach for product quality prediction in advanced transformer manufacturing

A medical diagnosis model based on BP-AsymBoost algorithm

A manufacturing quality prediction model based on AdaBoost-LSTM with rough knowledge

Adaptive Soft Sensors for Quality Prediction under the Framework of Bayesian Network

Intelligent Product Quality Prediction for Highly Customized Complex Production Adopting Ensemble Learning Model

Multiscale Cost-Sensitive Learning-Based Assembly Quality Prediction Approach under Imbalanced Data

Failure Supervising Method for Electricity Meter Based on BP-AdaBoost Algorithm

A new approach for quality prediction and control of multistage production and manufacturing process based on Big Data analysis and Neural Networks

An Effective Fault Diagnosis Approach Based On Gentle AdaBoost and AdaBoost.MH

A Statistical Approach to Cost-Sensitive AdaBoost for Imbalanced Data Classification

A Model for Surface Defect Detection of Industrial Products Based on Attention Augmentation

A Network-Based Model Robustness Improvement Method for Product Quality Assurance

Product Quality Anomaly Recognition and Diagnosis Based on DRSN-SVM-SHAP

Product modeling design based on genetic algorithm and BP neural network

Application of an improved sparrow search algorithm in BP network classification of strip steel surface defect images

Example-dependent cost-sensitive adaptive boosting

Quality Prediction of Discrete Manufacturing Process Based on CGAN&Catboost Hybrid Model

A Defect Detection Model for Industrial Products Based on Attention and Knowledge Distillation

An Ensemble Learning Algorithm for Machinery Fault Diagnosis Based on Convolutional Neural Network and Gradient Boosting Decision Tree

A robust framework for enhancing cardiovascular disease risk prediction using an optimized category boosting model