Abstract:Many data insight questions can be viewed as searching in a large space of tables and finding important ones, where the notion of importance is defined in some adhoc user defined manner. This paper presents Holistic Cube Analysis (HoCA), a framework that augments the capabilities of relational queries for such problems. HoCA first augments the relational data model and introduces a new data type AbstractCube, defined as a function which maps a region-features pair to a relational table (a region is a tuple which specifies values of a set of dimensions). AbstractCube provides a logical form of data, and HoCA operators are cube-to-cube transformations. We describe two basic but fundamental HoCA operators, cube crawling and cube join (with many possible extensions). Cube crawling explores a region space, and outputs a cube that maps regions to signal vectors. Cube join, in turn, is critical for composition, allowing one to join information from different cubes for deeper analysis. Cube crawling introduces two novel programming features, (programmable) Region Analysis Models (RAMs) and Multi-Model Crawling. Crucially, RAM has a notion of population features, which allows one to go beyond only analyzing local features at a region, and program region-population analysis that compares region and population features, capturing a large class of importance notions. HoCA has a rich algorithmic space, such as optimizing crawling and join performance, and physical design of cubes. We have implemented and deployed HoCA at Google. Our early HoCA offering has attracted more than 30 teams building applications with it, across a diverse spectrum of fields including system monitoring, experimentation analysis, and business intelligence. For many applications, HoCA empowers novel and powerful analyses, such as instances of recurrent crawling, which are challenging to achieve otherwise.

SCANCHUNK:AN EFFICIENT ALGORITHM FOR HUNTING DENSE REGIONS IN DATA CUBE

Towards the Building of a Dense-Region-based OLAP System

DROLAP - A Dense-Region Based Approach to On-Line Analytical Processing

Requirement-Based Data Cube Schema Design

Data Warehouse Native Feature Based OLAP Querying with Keywords

RCFile: A Fast and Space-Efficient Data Placement Structure in MapReduce-based Warehouse Systems

A Clustered Dwarf Structure to Speed Up Queries on Data Cubes

New Distributed Spatial Query Optimization Approach by Using Query Analyzer

Design on Strong Associative OLAP-based Dense Set Retrieval Method

Strategies for Complex Data Cube Queries

Approaches for Scaling Dbscan Algorithm to Large Spatial Databases

A Cube Analytical Mining Framework for Stream Data

QUEST: An Efficient Query Evaluation Scheme Towards Scan-Intensive Cross-Model Analysis

Effective Data Stream Cube Structure

Holistic Cube Analysis: A Query Framework for Data Insights

A Multidimensional OLAP Engine Implementation in Key-Value Database Systems.

An Efficient Method to Build a Standard Data Entry System by Extracting OLAP Cubes from NoSQL Data Sources

Towards effective and efficient mining of arbitrary shaped clusters

Range Top/Bottom k Queries in OLAP Sparse Data Cubes

Block Storage Optimization and Parallel Data Processing and Analysis of Product Big Data Based on the Hadoop Platform

OLAP Query Processing Algorithm Based on Relational Storage.