Abstract:Decision tree classifiers are a widely used tool in data stream mining. The use of confidence intervals to estimate the gain associated with each split leads to very effective methods, like the popular Hoeffding tree algorithm. From a statistical viewpoint, the analysis of decision tree classifiers in a streaming setting requires knowing when enough new information has been collected to justify splitting a leaf. Although some of the issues in the statistical analysis of Hoeffding trees have been already clarified, a general and rigorous study of confidence intervals for splitting criteria is missing. We fill this gap by deriving accurate confidence intervals to estimate the splitting gain in decision tree learning with respect to three criteria: entropy, Gini index, and a third index proposed by Kearns and Mansour. Our confidence intervals depend in a more detailed way on the tree parameters. We also extend our confidence analysis to a selective sampling setting, in which the decision tree learner adaptively decides which labels to query in the stream. We furnish theoretical guarantee bounding the probability that the classification is non-optimal learning the decision tree via our selective sampling strategy. Experiments on real and synthetic data in a streaming setting show that our trees are indeed more accurate than trees with the same number of leaves generated by other techniques and our active learning module permits to save labeling cost. In addition, comparing our labeling strategy with recent methods, we show that our approach is more robust and consistent respect all the other techniques applied to incremental decision trees.

Constructing Decision Trees for Mining High-Speed Data Streams

A New Fuzzy Decision Tree Classification Method For Mining High-Speed Data Streams Based On Binary Search Trees

A New Decision Tree Classification Method For Mining High-Speed Data Streams Based On Threaded Binary Search Trees

Extremely Fast Decision Tree Mining for Evolving Data Streams

Optimized very fast decision tree with balanced classification accuracy and compact tree size

Approximate mining of global closed frequent itemsets over data streams

Mining Uncertain Data Streams Using Clustering Feature Decision Trees

Mining Fuzzy Association Rules in Data Streams

An Incremental Fuzzy Decision Tree Classification Method for Data Streams Mining Based on Threaded Binary Search Trees

A Semi-Random Multiple Decision-Tree Algorithm for Mining Data Streams

An Incremental Fuzzy Decision Tree Classification Method for Mining Data Streams

An Efficient Classification System Based on Binary Search Trees for Data Streams Mining

An Efficient Decision Tree Classification Method Based on Extended Hash Table for Data Streams Mining

Gc-Tree: A Fast Online Algorithm For Mining Frequent Closed Itemsets

FROD: an Efficient Framework for Optimizing Decision Trees in Packet Classification

Decision Stream: Cultivating Deep Decision Trees

Speeding Up Very Fast Decision Tree with Low Computational Cost

OVFDT with Functional Tree Leaf — Majority Class, Naive Bayes and Adaptive Hybrid Integrations

Superfast Selection for Decision Tree Algorithms

Confidence Decision Trees via Online and Active Learning for Streaming (BIG) Data

An Effective RTRC-TFD Method for Detecting Traffic Flow Using Data Stream Mining