Abstract:More and more organizations, such as business, health care providers and scientific enterprises, rely on Online Analytical Processing (OLAP) to analyze massive data sets at a variety of summary levels and in a multidimensional way. In OLAP systems, one of the most computationally intensive tasks is to execute the Cube query, which was proposed by Gray et al. in 1997 as an extension of the Structured Query Language (SQL). A cube query generates a set of group-bys/views over all combinations of a set of attributes/dimensions from a table. The result of the query is a collection of multidimensional data, called a Data Cube. Pre-computing of data cubes can dramatically reduce the response time of other queries. Recently many sequential algorithms have been proposed to generate data cubes efficiently, however as the size of data sets grows, there is a need for even more scalable algorithms. Currently, for large data sets, the cube queries may require hours or even days to run on standard sequential machines. Parallel Computing can provide two key ingredients for dealing with large data size: (1) increased computational power through multiple processors and (2) increased I/O bandwidth through multiple parallel disks. The work presented in this thesis combines (1) the design of efficient parallel cube generation algorithms for the three basic types of data cubes: full cubes, partial cubes and iceberg cubes, with (2) careful system work associated with parallelism and external memory issues, and (3) extensive experiments and evaluation. The proposal algorithms are both external memory and parallel. They are designed for shared-nothing clusters, and use explicitly represented cost models which aid in performance tuning and portability. Our experiments show that the relative speedup of the algorithms is close to optimal/linear speedup for a wide range of input parameters, and the scalability is almost linear on large data sets. The proposed algorithms have been carefully implemented in our cgmOLAP prototype, which is to our knowledge the first fully functional parallel OLAP system able to build data cubes at a rate of more than half terabyte per hour.

Dynamic construction of user defined virtual cubes

Adapting OLAP Analysis to the User’s Interest Through Virtual Cubes

Towards the Building of a Dense-Region-based OLAP System

Requirement-Based Data Cube Schema Design

Data Warehouse Native Feature Based OLAP Querying with Keywords

DROLAP - A Dense-Region Based Approach to On-Line Analytical Processing

A High Performance Hierarchical Cubing Algorithm And Efficient Olap In High-Dimensional Data Warehouse

NestedCube: Towards Online Analytical Processing on Information-Enhanced Multidimensional Network.

AQP++: Connecting Approximate Query Processing with Aggregate Precomputation for Interactive Analytics

PHC: A Rapid Parallel Hierarchical Cubing Algorithm on High Dimensional OLAP

Parallel Generation of Rolap Data Cubes

Meta Galaxy: A Flexible and Efficient Cube Model for Data Retrieval in OLAP

An Algebra for Online Analytical Processing Data Cube

High-dimensional hierarchical OLAP:A prefix- index hierarchical cubing approach

Design and Implementation of OLAP System Based on Relational Database

Holistic Cube Analysis: A Query Framework for Data Insights

A parallel and distributed method for computing high dimensional MOLAP

CubeExplorer: online exploration of data cubes.

Strategies for Complex Data Cube Queries

Research on Data Cube Technology of Dwarf Based Semantic OLAP

A MapReduceMerge-based Data Cube Construction Method