Abstract:The distribution of streaming data may change over time, making the knowledge previously learned by machine learning models outdated. This phenomenon is known as concept drift. It is common in many fields, such as weather forecasting, electricity prediction, and computer vision. To address this issue, concept drift adaptation is conducted by updating the parameters or adjusting the architecture of models. However, it may involve changing complex model structures and lead to slow convergence. This challenge is further exacerbated in scenarios with scarce labels, where instance labels are difficult to obtain and only a small amount of labeled data are available. The key to overcoming these challenges is to learn the good feature representations for incoming instances. Accordingly, we propose a novel concept drift adaptation method called CDAL, which incorporates diffusion learning into an adversarial network structure to polish up feature extraction under scarce labels. By simulating a graph-based diffusion process, diffusion learning enhances feature correlation among similar instances and weakens the feature correlation among different instances. On the other hand, adversarial learning enhances the feature extractor by guiding the latter to compete with a pair of specially designed classifiers. With these two techniques, CDAL can facilitate concept drift adaptation and ensure robust performance in scenarios with scarce labels. Additionally, our model exhibits strong performance despite its simple structure, enabling rapid adaptation in the presence of concept drift. We compared our method with four existing state-of-the-art methods on seven public datasets, including synthetic and real-world datasets. The results show that our method achieves superior performance across all datasets.

DDAL: A Drift Detection Active Learning Mechanism

Automatic Learning to Detect Concept Drift

Online Drift Detection with Maximum Concept Discrepancy

Meta-ADD: A Meta-Learning Based Pre-Trained Model for Concept Drift Active Detection

A Better Algorithm for Classifying Data Streams with Concept Drifting

ADTCD: An Adaptive Anomaly Detection Approach Toward Concept Drift in IoT

A Multiscale Concept Drift Detection Method for Learning from Data Streams

DDD: A New Ensemble Approach for Dealing with Concept Drift

Online Active Learning for Drifting Data Streams

Concept Drift Adaptation with Scarce Labels

Learning with Drift Detection Based on K Time Sub-concept Windows

Concept Drift Adaptation with Scarce Labels: A Novel Approach Based on Diffusion and Adversarial Learning

ReCDA: Concept Drift Adaptation with Representation Enhancement for Network Intrusion Detection

Online Drift Compensation by Adaptive Active Learning on Mixed Kernel for Electronic Noses

Recent Advances in Concept Drift Adaptation Methods for Deep Learning.

Active Fuzzy Weighting Ensemble for Dealing with Concept Drift

Robust Online Active Learning with Cluster-Based Local Drift Detection for Unbalanced Imperfect Data

Mining Recurring Concept Drifts with Limited Labeled Streaming Data

Drift-detection Based Incremental Ensemble for Reacting to Different Kinds of Concept Drift

DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptation

A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data