Abstract:In real world situations, explanations for the same observations may be different depending on perceptions or contexts. They may change with time especially when concept drift occurs. This phenomenon incurs ambiguities. It is useful if an algorithm can learn to reflect ambiguities and select the best decision according to context or situation. Based on this viewpoint, we study the problem of deriving ambiguous decision trees from data streams to cope with concept drift. CVFDT (Concept-adapting Very Fast Decision Tree) is one of the most well-known streaming data mining methods that can learn decision trees incrementally. In this paper, we establish a method called ambiguous CVFDT (aCVFDT), which integrates ambiguities into CVFDT by exploring multiple options at each node whenever a node is to be split. When aCVFDT is used to make class predictions, it is guaranteed that the best and newest knowledge is used. When old concepts recur, aCVFDT can immediately relearn them by using the corresponding options recorded at each node. Furthermore, CVFDT does not automatically detect occurrences of concept drift and only scans trees periodically, whereas an automatic concept drift detecting mechanism is used in aCVFDT. In our experiments, hyperplane problem and two benchmark problems from the UCI KDD Archive, namely Network Intrusion and Forest CoverType, are used to validate the performance of aCVFDT. The experimental results show that aCVFDT obtains significantly improved results over traditional CVFDT.

A Framework of Cluster Decision Tree in Data Stream Classification

New algorithm for online classification over data streams based on max-frequency patterns

Data Stream Classification with Data Uncertainty and Concept Drift

Improving the performance of data stream classifiers by mining recurring contexts

A Concept Drifting Based Clustering Framework for Data Streams

An Improved Algorithm of Decision Trees for Streaming Data Based on VFDT

An Efficient Decision Tree Classification Method Based on Extended Hash Table for Data Streams Mining

A concept similarity based data stream classification model

Mining Uncertain Data Streams Using Clustering Feature Decision Trees

Research on Decision Tree Classification Algorithm of Distributed Data Stream

Mining Concept-Drifting Data Streams with Multiple Semi-Random Decision Trees

An Incremental Fuzzy Decision Tree Classification Method for Data Streams Mining Based on Threaded Binary Search Trees

Dynamic Clustering Forest: an Ensemble Framework to Efficiently Classify Textual Data Stream with Concept Drift.

Constructing Decision Trees for Mining High-Speed Data Streams

A Selectively Re-train Approach Based on Clustering to Classify Concept-Drifting Data Streams with Skewed Distribution

A New Decision Tree Classification Method For Mining High-Speed Data Streams Based On Threaded Binary Search Trees

A Method for Classifying Data Stream Based on Reverse Classifier

An Incremental Fuzzy Decision Tree Classification Method for Mining Data Streams

A New Fuzzy Decision Tree Classification Method For Mining High-Speed Data Streams Based On Binary Search Trees

An Efficient Classification System Based on Binary Search Trees for Data Streams Mining

Ambiguous Decision Trees for Mining Concept-Drifting Data Streams.