Abstract:Real-time surveillance systems, telecommunication systems, and other dynamic environments often generate tremendous (potentially infinite) volume of stream data: the volume is too huge to be scanned multiple times. Much of such data resides at rather low level of abstraction, whereas most analysts are interested in relatively high-level dynamic changes (such as trends and outliers). To discover such high-level characteristics, one may need to perform on-line multi-level, multi-dimensional analytical processing of stream data. In this paper, we propose an architecture, called stream_cube, to facilitate on-line, multi-dimensional, multi-level analysis of stream data. For fast online multi-dimensional analysis of stream data, three important techniques are proposed for efficient and effective computation of stream cubes. First, a tilted time frame model is proposed as a multi-resolution model to register time-related data: the more recent data are registered at finer resolution, whereas the more distant data are registered at coarser resolution. This design reduces the overall storage of time-related data and adapts nicely to the data analysis tasks commonly encountered in practice. Second, instead of materializing cuboids at all levels, we propose to maintain a small number of critical layers. Flexible analysis can be efficiently performed based on the concept of observation layer and minimal interesting layer . Third, an efficient stream data cubing algorithm is developed which computes only the layers (cuboids) along a popular path and leaves the other cuboids for query-driven, on-line computation. Based on this design methodology, stream data cube can be constructed and maintained incrementally with a reasonable amount of memory, computation cost, and query response time. This is verified by our substantial performance study.

Data Stream Mining Based on Time and Space Partitioning

Mining Fuzzy Association Rules in Data Streams

An Algorithm for Data Stream Speed Anomaly Detection Based on RCSW

Mining Spread Patterns of Spatio-temporal Co-occurrences over Zones

Distributed scheduling and storage scheme based on LSM-OCTree for spatiotemporal stream

Multi-Dimensional Regression Analysis of Time-Series Data Streams.

State-of-the-art on Frequent Pattern Mining in Data Streams

Mining Scalable Pattern Based on Temporal Logic over Data Streams

Data Partitioning View of Mining Big Data

Survey of the Study on Frequent Pattern Mining in Data Streams

A Study of Performance Optimization Method for Massive Spaito-temporal Data Based on Spatio-temporal Partition Clustering

Stream Clustering Model and Its Unified Representation

Study of Seamless Organization and Storage Structure for Massive Spatio-Temporal Data

A Problem Oriented Approach to Data Mining in Distributed Spatio-temporal Database

Stream Cube: an Architecture for Multi-Dimensional Analysis of Data Streams

An analytical framework for data stream mining techniques based on challenges and requirements

Data Mining in Time Series: Current Study and Future Trend

Mining Algorithm for Frequent Pattern in Data Stream Based on Stream-cube

Multi-Dimensional Regression Analysis of

Novel structures for counting frequent items in time decayed streams

Subspace Clustering of High Dimensional Data Streams