Abstract:Decision tree classifiers are a widely used tool in data stream mining. The use of confidence intervals to estimate the gain associated with each split leads to very effective methods, like the popular Hoeffding tree algorithm. From a statistical viewpoint, the analysis of decision tree classifiers in a streaming setting requires knowing when enough new information has been collected to justify splitting a leaf. Although some of the issues in the statistical analysis of Hoeffding trees have been already clarified, a general and rigorous study of confidence intervals for splitting criteria is missing. We fill this gap by deriving accurate confidence intervals to estimate the splitting gain in decision tree learning with respect to three criteria: entropy, Gini index, and a third index proposed by Kearns and Mansour. Our confidence intervals depend in a more detailed way on the tree parameters. We also extend our confidence analysis to a selective sampling setting, in which the decision tree learner adaptively decides which labels to query in the stream. We furnish theoretical guarantee bounding the probability that the classification is non-optimal learning the decision tree via our selective sampling strategy. Experiments on real and synthetic data in a streaming setting show that our trees are indeed more accurate than trees with the same number of leaves generated by other techniques and our active learning module permits to save labeling cost. In addition, comparing our labeling strategy with recent methods, we show that our approach is more robust and consistent respect all the other techniques applied to incremental decision trees.

Efficient building algorithms of decision tree for uniformly distributed uncertain data.

Rough set based decision tree

Handling Missing Data in Decision Trees: A Probabilistic Approach

A cost sensitive decision tree algorithm with two adaptive mechanisms

Mining Uncertain Data Streams Using Clustering Feature Decision Trees

Efficient Tree Classifiers for Large Scale Datasets.

Learning decision trees through Monte Carlo tree search: An empirical evaluation

Toward the Better Modeling and Visualization of Uncertainty for Streaming Data

Differentially- and non-differentially-private random decision trees

Building Trees for Probabilistic Prediction via Scoring Rules

Simple is better: Making Decision Trees faster using random sampling

Geological Hazard Susceptibility Prediction Based on Decision Tree Algorithm

Unifying Decision Trees Split Criteria Using Tsallis Entropy

Improving Decision Trees by Tsallis Entropy Information Metric Method.

Uncertainty-Aware Fairness-Adaptive Classification Trees

A Communication-Efficient Parallel Algorithm for Decision Tree

An improved decision tree algorithm based on boundary mixed attribute dependency

Confidence Decision Trees via Online and Active Learning for Streaming (BIG) Data

Online active learning of decision trees with evidential data

A less-greedy two-term Tsallis Entropy Information Metric approach for decision tree classification

Application of variable precision rough set model in building decision tree