Abstract:More and more organizations, such as business, health care providers and scientific enterprises, rely on Online Analytical Processing (OLAP) to analyze massive data sets at a variety of summary levels and in a multidimensional way. In OLAP systems, one of the most computationally intensive tasks is to execute the Cube query, which was proposed by Gray et al. in 1997 as an extension of the Structured Query Language (SQL). A cube query generates a set of group-bys/views over all combinations of a set of attributes/dimensions from a table. The result of the query is a collection of multidimensional data, called a Data Cube. Pre-computing of data cubes can dramatically reduce the response time of other queries. Recently many sequential algorithms have been proposed to generate data cubes efficiently, however as the size of data sets grows, there is a need for even more scalable algorithms. Currently, for large data sets, the cube queries may require hours or even days to run on standard sequential machines. Parallel Computing can provide two key ingredients for dealing with large data size: (1) increased computational power through multiple processors and (2) increased I/O bandwidth through multiple parallel disks. The work presented in this thesis combines (1) the design of efficient parallel cube generation algorithms for the three basic types of data cubes: full cubes, partial cubes and iceberg cubes, with (2) careful system work associated with parallelism and external memory issues, and (3) extensive experiments and evaluation. The proposal algorithms are both external memory and parallel. They are designed for shared-nothing clusters, and use explicitly represented cost models which aid in performance tuning and portability. Our experiments show that the relative speedup of the algorithms is close to optimal/linear speedup for a wide range of input parameters, and the scalability is almost linear on large data sets. The proposed algorithms have been carefully implemented in our cgmOLAP prototype, which is to our knowledge the first fully functional parallel OLAP system able to build data cubes at a rate of more than half terabyte per hour.

OLGM: AN ONLINE CUBE GRADIENT MINING TOOL

The Research of the Cube Gradient Mining

Significant Gradients Mining Based on Data Cube Computation

The mining of fuzzy gradient in the case of materialized cube

Mining Constrained Cube Gradient for Materialized Cube

Mining Constrained Cube Gradient Using Condensed Cube

CubeExplorer: online exploration of data cubes.

The Incremental Mining of Constrained Cube Gradients

g-Miner: Interactive Visual Group Mining on Multivariate Graphs.

Efficient Constraint-Based Exploratory Mining on Large Data Cubes

Meta Galaxy: A Flexible and Efficient Cube Model for Data Retrieval in OLAP

A Cube Analytical Mining Framework for Stream Data

EasyGML

Holistic Cube Analysis: A Query Framework for Data Insights

Parallel Generation of Rolap Data Cubes

OIDM: Online Interactive Data Mining

G-Ola: Generalized On-Line Aggregation For Interactive Analysis On Big Data

<i>Cool</i>: a COhort OnLine analytical processing system

Research on Big Data Query Online Analysis and Processing Technology on the Basis of Decision Tree Model

A Data Mining Algorithm Based On Grid

Constructing Cube Blocks Effectively for Stream Data Analysis