Abstract:Along with the prosperity of the Mobile Internet, a large amount of stream data has emerged. Stream data cannot be completely stored in memory because of its massive volume and continuous arrival. Moreover, it should be accessed only once and handled in time due to the high cost of multiple accesses. Therefore, the intrinsic nature of stream data calls facilitates the development of a summary in the main memory to enable fast incremental learning and to allow working in limited time and memory. Sampling techniques are one of the commonly used methods for constructing data stream summaries. Given that the traditional random sampling algorithm deviates from the real data distribution and does not consider the true distribution of the stream data attributes, we propose a novel sampling algorithm based on feature-selected and -preserved algorithm. We first use matrix approximation to select important features in stream data. Then, the feature-preserved sampling algorithm is used to generate high-quality representative samples over a sliding window. The sampling quality of our algorithm could guarantee a high degree of consistency between the distribution of attribute values in the population (the entire data) and that in the sample. Experiments on real datasets show that the proposed algorithm can select a representative sample with high efficiency.

A Basic-Window Based Priority-Sample Algorithm For Sliding Windows Over Data Streams

A Priority Random Sampling Algorithm For Time-Based Sliding Windows Over Weighted Streaming Data

An Algorithm for Data Stream Sampling Based on Ring Circular Sliding Window Tightly-Coupled with Buffer

New Sampling-Based Summary Structures for Sliding Windows over Data Streams

Construction of summary structures from sliding windows over data streams

A simple, yet effective and efficient, sliding window sampling algorithm

Construction of synopsis for periodically updating sliding windows over data streams

RANDOM SAMPLING ALGORITHMS FOR LANDMARK WINDOWS OVER DATA STREAMS

A Dynamic Weighted Random Sampling Algorithm On Time-Based Sliding Window Over Data Stream

Adaptive weighted random sampling algorithm based on time sliding window

Weighted Sampling from Landmark Windows over Data Streams

Dynamic Adjustment of Sliding Windows over Data Streams

Approximately Detecting Duplicates for Probabilistic Data Streams over Sliding Windows

A Sketch Framework for Approximate Data Stream Processing in Sliding Windows

Research on a Sliding Window Bats Code Method

Feature-Selected and -Preserved Sampling for High-Dimensional Stream Data Summary

A self-adaptive sliding window technique for mining data streams

Sliding-Window QPS (SW-QPS)

Space Efficient Quantile Summary for Constrained Sliding Windows on a Data Stream

Gdsw: A General Framework for Distributed Sliding Window over Data Streams

A Deadline-Sensitive Sliding Window Processing Strategy over Data Streams