Abstract:Prediction in streaming data is an important activity in the modern society. Two major challenges posed by data streams are (1) the data may grow without limit so that it is difficult to retain a long history of raw data; and (2) the underlying concept of the data may change over time. The novelties of this paper are in four folds. First, it uses a measure of conceptual equivalence to organize the data history into a history of concepts. This contrasts to the common practice that only keeps recent raw data. The concept history is compact while still retains essential information for learning. Second, it learns concept-transition patterns from the concept history and anticipates what the concept will be in the case of a concept change. It then proactively prepares a prediction model for the future change. This contrasts to the conventional methodology that passively waits until the change happens. Third, it incorporates proactive and reactive predictions. If the anticipation turns out to be correct, a proper prediction model can be launched instantly upon the concept change. If not, it promptly resorts to a reactive mode: adapting a prediction model to the new data. Finally, an efficient and effective system RePro is proposed to implement these new ideas. It carries out prediction at two levels, a general level of predicting each oncoming concept and a specific level of predicting each instance's class. Experiments are conducted to compare RePro with representative existing prediction methods on various benchmark data sets that represent diversified scenarios of concept change. Empirical evidence offers inspiring insights and demonstrates the proposed methodology is an advisable solution to prediction in data streams.

An Algorithm for Predictive Queries over Data Stream Based on Energy and Frequent Pattern

A New Algorithm for Frequency Tendency Prediction over Data Streams

Mining Fuzzy Association Rules in Data Streams

Effective and Efficient Shape-Based Pattern Detection over Streaming Time Series

Predictive Queries Algorithm Based on Probability Model over Data Streams

Real-time Algorithm for Trend Analysis of Dynamic Data Streams

An Algorithm for Data Stream Speed Anomaly Detection Based on RCSW

Continually Evaluating Similarity-Based Pattern Queries on a Streaming Time Series

Mining Algorithm for Frequent Pattern in Data Stream Based on Stream-cube

Efficient Discovery of Emerging Frequent Patterns in ArbitraryWindows on Data Streams

Estimation and maintenance of frequent pattern on data streams

State-of-the-art on Frequent Pattern Mining in Data Streams

StreamEnsemble: Predictive Queries over Spatiotemporal Streaming Data

Survey of the Study on Frequent Pattern Mining in Data Streams

DELAY: A Lazy Approach for Mining Frequent Patterns over High Speed Data Streams

Methods for Mining Frequent Items in Data Streams: an Overview

A Probabilistic Approach to Detect Local Dependencies in Streams.

A new predictive method supporting streaming data with hybrid recurring concept drifts in process industry

Adaptive Processing Algorithm of Ad Hoc Query in Data Streams

Mining in Anticipation for Concept Change: Proactive-Reactive Prediction in Data Streams

Mining and Predicting Duplication over Peer-to-Peer Query Streams