Abstract:Classification is a common task in data mining that assigns a class label to an unseen situation. It has been widely used in decision making for various applications, and many machine learning algorithms have been developed to accomplish this task. Classification becomes critical when the problem under concern is related to serious situations such as fraud detection, cancer diseases, and quality control. Learning in these situations is characterized by predetermined asymmetric costs of incorrect class prediction, or critical consequences associated with erroneous class prediction. In this paper, a novel approach of cost-sensitive learning is proposed. The approach is constructed by employing the theory of logical analysis of data (LAD) to build accurate cost-sensitive classifiers. Two classifiers are proposed. The first classifier is established by solving a proposed pattern selection model, minimum misclassification cost model (MMCM), that aims at minimizing the asymmetric misclassification cost. The second classifier is established by solving another proposed pattern selection model, maximum precision–recall model (MPRM), that maximizes precision and recall willing to reach a 100% accuracy. A comparative study is conducted by using real datasets. The proposed MMCM has enabled LAD to realize up to 32.22% cost reduction from the misclassification cost realized by the traditional implementation of LAD. Moreover, MPRM has provided up to 19.15% increase in the precision and up to 37% increase in the recall. Also, MPRM has enhanced the performance of LAD while compared to common machine learning algorithms by providing better combinations of recall and false positive rate. This enabled LAD to provide the closet to the optimal point on the receiver operating characteristic (ROC) diagram when compared with existing machine learning methods. Incorporating the MMCM and the MPRM models into LAD establishes a novel implementation of LAD that makes LAD a promising cost-sensitive learning classifier compared to other machine learning classifiers.

Large Margin Distribution Learning with Cost Interval and Unlabeled Data.

Cost-Sensitive Large Margin Distribution Machine

Learning with cost intervals.

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

Towards cost-sensitive learning for real-world applications

A Multi-Class Large Margin Classifier

Cost-Sensitive Semi-Supervised Support Vector Machine

Completely Determined Known at Test Phrase Unknown at Test Phrase , but Some Information is Known Completely Unknown Impreciseness of Costs Previous CSL

Cost Sensitive Support Vector Machines

Scalable Label Distribution Learning for Multi-Label Classification

Universum driven cost-sensitive learning method with asymmetric loss function

Large-Margin Label-Calibrated Support Vector Machines for Positive and Unlabeled Learning

Large Margin Partial Label Machine

Semi-Supervised Dual Relation Learning for Multi-Label Classification

Cost-sensitive label embedding for multi-label classification

Label Distribution Learning: A Local Collaborative Mechanism

Cost-sensitive learning using logical analysis of data

On Multi-Class Cost-Sensitive Learning

Regularized Large Margin Distance Metric Learning.

Cost Sensitive Ranking Support Vector Machine for Multi-label Data Learning.

Multi-label Optimal Margin Distribution Machine