Abstract:With the popularity of column-store databases, modern multi-core CPUs, and general-purpose computing on graphics processing units (GPGPUs), there will be radical changes in how processing is done in the online analytical processing (OLAP) and data warehousing fields. Cube computation is a core and time-consuming problem which has been researched extensively. However, most of the algorithms have been proposed without considering the prevalent multi-core architectures and column storage. This paper presents a new parallel cube algorithm that takes advantage of multi-core architectures. We first propose a cache-conscious bottom-up computation (BUC) algorithm called CC-BUC that adopts an integrated bottom-up and breadth-first partitioning order. Each dimension is separately stored and processed. In processing each dimension, breadth-first data scanning and results outputting reduce memory I/O and enhance cache locality. Cache misses are limited in a dimension scope, and translation lookaside buffer (TLB) misses are reduced. Based on CC-BUC, we give a multi-core architecture-based cube algorithm called MC-Cubing. Multiple partitions are processed simultaneously and multiple threads undergo parallel execution inside each partition. MC-Cubing is consistent with multi-core architectures and high parallelism. The layout and associated algorithms take advantage of single instruction, multiple data (SIMD) instructions and thread-level parallelism (TLP). We implement and demonstrate the effectiveness of MC-Cubing on two multi-core architectures: multi-core CPUs and GPUs. Experimental results show that the MC-Cubing algorithm can speed up nearly six times faster than BUC in real datasets.

An Array-based Algorithm for Data Cube Computation with PC Cluster

A parallel computing method for irregular work

A Clustered Dwarf Structure to Speed Up Queries on Data Cubes

Closed Cubing on PC Clusters

A Parallel Algorithm for Closed Cube Computation

Requirement-Based Data Cube Schema Design

SCANCHUNK:AN EFFICIENT ALGORITHM FOR HUNTING DENSE REGIONS IN DATA CUBE

A High Performance Hierarchical Cubing Algorithm And Efficient Olap In High-Dimensional Data Warehouse

Star Cube -An Approach to Implementing Data Cube Efficiently

A MapReduceMerge-based Data Cube Construction Method

A parallel and distributed method for computing high dimensional MOLAP

Parallel Data Cube Computation on Graphic Processing Units

ParaCube: A Scalable OLAP Model Based on Distributed Aggregate Computing with Sibling Cubes

New Algorithm for Computing Cube on Very Large Compressed Data Sets.

Parallel cube computation on modern CPUs and GPUs

PHC: A Rapid Parallel Hierarchical Cubing Algorithm on High Dimensional OLAP

A Parallel Closed-Cubing Algorithm Based on MapReduce

APIC: An Efficient Algorithm for Computing Iceberg Datacubes

Cache-Conscious Data Cube Computation on a Modern Processor

CLUSTER-BASED OCEAN REMOTE SENSING IMAGE FUSION PARALLEL COMPUTING STRATEGY

Hierarchical Cube Storage Structure for Data Warehouses