Abstract:Real-time surveillance systems, telecommunication systems, and other dynamic environments often generate tremendous (potentially infinite) volume of stream data: the volume is too huge to be scanned multiple times. Much of such data resides at rather low level of abstraction, whereas most analysts are interested in relatively high-level dynamic changes (such as trends and outliers). To discover such high-level characteristics, one may need to perform on-line multi-level, multi-dimensional analytical processing of stream data. In this paper, we propose an architecture, called stream_cube, to facilitate on-line, multi-dimensional, multi-level analysis of stream data. For fast online multi-dimensional analysis of stream data, three important techniques are proposed for efficient and effective computation of stream cubes. First, a tilted time frame model is proposed as a multi-resolution model to register time-related data: the more recent data are registered at finer resolution, whereas the more distant data are registered at coarser resolution. This design reduces the overall storage of time-related data and adapts nicely to the data analysis tasks commonly encountered in practice. Second, instead of materializing cuboids at all levels, we propose to maintain a small number of critical layers. Flexible analysis can be efficiently performed based on the concept of observation layer and minimal interesting layer . Third, an efficient stream data cubing algorithm is developed which computes only the layers (cuboids) along a popular path and leaves the other cuboids for query-driven, on-line computation. Based on this design methodology, stream data cube can be constructed and maintained incrementally with a reasonable amount of memory, computation cost, and query response time. This is verified by our substantial performance study.

Real-time Business Intelligence System Architecture with Stream Mining

Socialanalysis: A Real-Time Query And Mining System From Social Media Data Streams

Olaping stream data: Is it feasible

Stream Cube: an Architecture for Multi-Dimensional Analysis of Data Streams

From Smart Meter Data to Pricing Intelligence - Visual Data Mining Towards Real-Time BI.

An analytical framework for data stream mining techniques based on challenges and requirements

Data stream analysis and research

Real-time Intelligent Big Data Processing:Technology, Platform, and Applications

From Business Intelligence To Real-Time Business Intelligence: Imperatives And Guidelines

Scalable and Parameterized Architecture for Efficient Stream Mining.

Real-time intelligent big data processing: technology, platform, and applications

A Cube Analytical Mining Framework for Stream Data

Noval Stream Data Mining Framework under the Background of Big Data

Data Mining in the Era of Big Data: from the Application Perspective

Multi-Dimensional Regression Analysis of Time-Series Data Streams.

Streamdm: Advanced Data Mining In Spark Streaming

A Scalable Data Mining Architecture for Bioinformation

Extremely Fast Decision Tree Mining for Evolving Data Streams

Powerful Tool to Expand Business Intelligence: Text Mining

Business process intelligence system: Architecture and data models

FIU-Miner (a Fast, Integrated, and User-Friendly System for Data Mining) and Its Applications.