Abstract:Cost-sensitive decision trees have a great success in building models for classification tasks in data mining and machine learning. Decision tree pruning technique is regarded as an important component of the optimization of decision tree. However, many previous cost-sensitive decision trees researches focus on minimizing the misclassification rate and removing nodes when the cost of the pruned tree is less than the original one. In this paper, we propose an effective method for building cost-sensitive decision tree and a probabilistic pruning mechanism for the decision tree. There are two major contributions of this paper. Firstly, the cost-sensitive decision tree is built to make predictions to minimize the total cost of test costs and different costs associated with different types of misclassification. Compared with existing models, leaves are labeled by minimizing the total cost instead of the majority class. Secondly, we design a probabilistic pruning mechanism where the pruning probability is related to the change of costs around pruning. The pruning results yield worse performance on the training set, but better performance on the testing set. Therefore, the probabilistic pruning mechanism improves the performance of the cost-sensitive decision tree. Experimental results show the efficiency of the probabilistic pruning mechanism for cost-sensitive decision tree.

Pruning Decision Tree Using Genetic Algorithms

Dynamic Split-point Selection Method for Decision Tree Evolved by Gene Expression Programming

Cost-sensitive decision trees with post-pruning and competition for numeric data

Cost-Sensitive Decision Trees with Pre-pruning

A Non-Revisiting Genetic Algorithm Based on a Novel Binary Space Partition Tree

Pruning algorithm of classificaiton and regression decision tree based on Akaike information criteria

Test cost constraint attribute reduction through a genetic approach

Cost-sensitive C4.5 with Post-Pruning and Competition

A Memetic Genetic Programming with Decision Tree-Based Local Search for Classification Problems

Research and Improvement of Decision Tree's Prune Algorithm

Applying Genetic Algorithms to Game Search Trees

A novel method for pruning decision trees

A Decision Tree Scoring Model Based on Genetic Algorithm and K-Means Algorithm

Design of fuzzy classification system based on decision-tree and genetic algorithm

A Pruning Method Based on Conditional Misclassification

A New Pruning Method for Solving Decision Trees and Game Trees

Optimal feed-forward neural networks based on the combination of constructing and pruning by genetic algorithms

An Improved Genetic Algorithm and Its Performance Analysis

Innovative Application of Genetic Algorithms in the Computer Games

Cost-sensitive Decision Tree with Probabilistic Pruning Mechanism

Genetic Reduction Algorithm Based on Feasible Region