Abstract:Financial markets and weather prediction are generating streaming data at a rapid rate. The frequent concept drifts in these data streams pose significant challenges to learners during training and prediction. Concept drift means the distribution of data in the data stream changes dramatically at any time, and it can lead to decreased effectiveness in many data-driven systems. So, obtaining online models that adapt to concept drift is essential. In the face of concept drifts in data streams, most proposed evolving fuzzy systems (EFSs) suffer from two problems. First, it is difficult to quickly adapt to a drastic change in a short period, such as sudden drift. Second, most ensemble EFSs adjust the weights according to the error, which will easily lead to the risk of under-training and repeated training of the base model. To solve the above problems, we propose a new type of ensemble EFS called dynamic similarity weighted evolving fuzzy system (DSW-EFS). Unlike existing ensemble EFSs, DSW-EFS assigns weights to base learners based on the similarity between data distributions, and each base learner describes only one data distribution in the data stream. This ensemble method enables DSW-EFS to describe multiple data distributions in the data stream and quickly adapt to multiple concept drifts. To ensure the accuracy of drift detection, we propose a Gaussian mixture model (GMM)-based concept drift detection algorithm that can obtain the similarity between data distributions. This detection method can achieve high accuracy based on a smaller sliding window size. The DSW-EFS model is tested from concept drifts and prediction accuracy in the experimental part. The results show that DSW-EFS can quickly adapt to concept drift by assigning weights to base learners based on similarity when concept drifts occur. Moreover, DWS-EFS achieves high prediction accuracy on most datasets.

An Improving Fuzzy C-means Algorithm for Concept-Drifting Data Stream

New algorithm for online classification over data streams based on max-frequency patterns

A Concept Drift Detection Algorithm for Power Data Stream

A dynamic similarity weighted evolving fuzzy system for concept drift of data streams

The Application of a Double CUSUM Algorithm in Industrial Data Stream Anomaly Detection

A Classification and Novel Class Detection Algorithm for Concept Drift Data Stream Based on the Cohesiveness and Separation Index of Mahalanobis Distance

Concept Drift Detection Based on Typicality and Eccentricity

TS-DM: A Time Segmentation-Based Data Stream Learning Method for Concept Drift Adaptation

Temporal Attention for Few-Shot Concept Drift Detection in Streaming Data

Diagnosing Concept Drift in Streaming Data

A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data

A Drift Region-Based Data Sample Filtering Method

Tracking Concept Drifting with an Online-Optimized Incremental Learning Framework

Online Drift Detection with Maximum Concept Discrepancy

Online Active Learning for Drifting Data Streams

Concept Drift Detection Delay Index

An Ensemble Classifier Algorithm for Mining Data Streams Based on Concept Drift

Cost-Sensitive Classification for Evolving Data Streams with Concept Drift and Class Imbalance

Data-driven decision support under concept drift in streamed big data

Data Stream Concept Drift Detection Method Based on Mixture Ensemble Method

Resource Constrained Data Stream Clustering with Concept Drifting for Processing Sensor Data