Abstract:While recognizing the significance of data in machine learning, we focus on addressing the challenge of concept drift, particularly in dynamic data streams. We propose an innovative incremental decision tree algorithm tailored for learning regression trees and model trees from evolving data streams. Vital to ensuring the quality and accuracy of predictive models is addressing this challenge. In this context, we present a novel solution: an incremental decision tree algorithm tailored for learning regression trees and model trees from time-varying data streams. Our algorithm is designed to operate at high speeds, effectively accommodating the influx of data at any scale, including scenarios with potentially unlimited data. Key innovations of our approach include a probabilistic defined sampling strategy that enhances the learning process and an advanced automatic method capable of handling non-stationary data distributions. However, the primary innovation lies in our methodology for detecting concept drift. Unlike conventional methods that reactively respond to increased errors, we introduce a proactive approach: monitoring the quality of individual subtrees by tracking their error evolution. This method allows us to detect changes in the objective function promptly, leading to timely adaptations in the model structure. Through extensive experimentation and evaluation, we demonstrate the effectiveness of our proposed algorithm in terms of prediction accuracy, model size, and change detection capabilities. Representing a significant advancement in the field of machine learning, particularly in addressing the challenge of concept drift in data streams, the proposed algorithm offers a competitive alternative to existing flow classifiers. Showcasing superior performance in terms of precision, recall, Fisher measure, and scalability, it underscores its potential to enhance decision-making processes across various domains by adapting swiftly to changing data patterns and maintaining high accuracy. The algorithm's innovative approach to incremental learning of decision rules, coupled with its adaptive extension for handling concept drift, holds promise for real-world applications where accurate and timely insights are paramount. Overall, the algorithm's robustness, adaptability, and efficiency position it as a valuable asset in stream data classification and decision support systems.

Change detection and adaptation in multi-target regression on data streams

A Probabilistic Framework for Adapting to Changing and Recurring Concepts in Data Streams

Concept-drifting Data Streams are Time Series; The Case for Continuous Adaptation

TS-DM: A Time Segmentation-Based Data Stream Learning Method for Concept Drift Adaptation

Concept Drift Detection and Adaptation with Weak Supervision on Streaming Unlabeled Data

Roadmap of Concept Drift Adaptation in Data Stream Mining, Years Later

Handling Adversarial Concept Drift in Streaming Data

Mitigating concept drift in data streams: an incremental decision tree approach

Temporal Attention for Few-Shot Concept Drift Detection in Streaming Data

A reliable adaptive prototype-based learning for evolving data streams with limited labels

Addressing Concept Shift in Online Time Series Forecasting: Detect-then-Adapt

An Adaptive Learning Approach for Noisy Data Streams

Transfer learning for concept drifting data streams in heterogeneous environments

Fast Unsupervised Online Drift Detection Using Incremental Kolmogorov-Smirnov Test

On the Reliable Detection of Concept Drift from Streaming Unlabeled Data

ADES: A New Ensemble Diversity-Based Approach for Handling Concept Drift

Concept Drift Detection in Data Stream Mining : A literature review

Data Stream Concept Drift Detection Method Based on Mixture Ensemble Method

Autoencoder-based Anomaly Detection in Streaming Data with Incremental Learning and Concept Drift Adaptation

Online Active Learning for Drifting Data Streams

Employing chunk size adaptation to overcome concept drift