Abstract:A summary can immensely reduce the time and space complexity of an algorithm. This concept is considered a research hotspot in the field of data stream mining Data streams are characterized as having continuous data arrival, rapid speed, large scale, and cannot be completely stored in memory simultaneously. A summary is often formed in the memory to approximate the database query or data mining task. A sampling technique is a commonly used method for constructing data stream summaries. Traditional simple random sampling algorithms do not consider the conceptual drift of data distributions that change over time. Therefore, a challenging task is sampling the summary of the data distribution in multi-dimensional data streams of a concept drift. This study proposes a sampling algorithm that ensures the consistency of the data distribution with the data streams of the concept drift. First, probability statistics is used on the data stream cells in the reference window to obtain data distribution. A probability sampling is performed on the basis of this distribution. Second, the sliding window is used to continuously detect whether the data distribution has changed. If the data distribution does not change, then the original sampling data are maintained. Otherwise, the data distribution in the statistical window is restated to form a new sampling probability. The proposed algorithm ensures that the data distribution in the data profile is continually consistent with the population distribution. We compare our algorithm with the state-of-the-art algorithms on synthetic and real data sets. Experimental results demonstrate the effectiveness of our algorithm.

New Sampling-Based Summary Structures for Sliding Windows over Data Streams

Construction of summary structures from sliding windows over data streams

Construction of synopsis for periodically updating sliding windows over data streams

A Basic-Window Based Priority-Sample Algorithm For Sliding Windows Over Data Streams

An Algorithm for Data Stream Sampling Based on Ring Circular Sliding Window Tightly-Coupled with Buffer

A Dynamic Weighted Random Sampling Algorithm On Time-Based Sliding Window Over Data Stream

A simple, yet effective and efficient, sliding window sampling algorithm

A Priority Random Sampling Algorithm For Time-Based Sliding Windows Over Weighted Streaming Data

Feature-Selected and -Preserved Sampling for High-Dimensional Stream Data Summary

RANDOM SAMPLING ALGORITHMS FOR LANDMARK WINDOWS OVER DATA STREAMS

A Sketch Framework for Approximate Data Stream Processing in Sliding Windows

Concept Drift Based Multi-dimensional Data Streams Sampling Method.

Adaptive weighted random sampling algorithm based on time sliding window

Weighted Sampling from Landmark Windows over Data Streams

An Algorithmic View of Streaming Submodular Data Summarization with A Knapsack Constraint

MRST—An Efficient Monitoring Technology of Summarization on Stream Data

Dynamic Adjustment of Sliding Windows over Data Streams

Sliding Sketches: A Framework Using Time Zones for Data Stream Processing in Sliding Windows

A self-adaptive sliding window technique for mining data streams

Optimal Algorithm of Data Streams Clustering on Sliding Window Model

Design of a Sliding Window over Asynchronous Event Streams