Abstract:Many data insight questions can be viewed as searching in a large space of tables and finding important ones, where the notion of importance is defined in some adhoc user defined manner. This paper presents Holistic Cube Analysis (HoCA), a framework that augments the capabilities of relational queries for such problems. HoCA first augments the relational data model and introduces a new data type AbstractCube, defined as a function which maps a region-features pair to a relational table (a region is a tuple which specifies values of a set of dimensions). AbstractCube provides a logical form of data, and HoCA operators are cube-to-cube transformations. We describe two basic but fundamental HoCA operators, cube crawling and cube join (with many possible extensions). Cube crawling explores a region space, and outputs a cube that maps regions to signal vectors. Cube join, in turn, is critical for composition, allowing one to join information from different cubes for deeper analysis. Cube crawling introduces two novel programming features, (programmable) Region Analysis Models (RAMs) and Multi-Model Crawling. Crucially, RAM has a notion of population features, which allows one to go beyond only analyzing local features at a region, and program region-population analysis that compares region and population features, capturing a large class of importance notions. HoCA has a rich algorithmic space, such as optimizing crawling and join performance, and physical design of cubes. We have implemented and deployed HoCA at Google. Our early HoCA offering has attracted more than 30 teams building applications with it, across a diverse spectrum of fields including system monitoring, experimentation analysis, and business intelligence. For many applications, HoCA empowers novel and powerful analyses, such as instances of recurrent crawling, which are challenging to achieve otherwise.

MiTexCube: MicroTextCluster Cube for online analysis of text cells and its applications

A Clustered Dwarf Structure to Speed Up Queries on Data Cubes

Constructing Cube Blocks Effectively for Stream Data Analysis

Regression Cubes with Lossless Compression and Aggregation

CubeExplorer: online exploration of data cubes.

A Cube Analytical Mining Framework for Stream Data

Holistic Cube Analysis: A Query Framework for Data Insights

Stream Cube: an Architecture for Multi-Dimensional Analysis of Data Streams

Temporal Graph Cube

X-DMM: Fast and Scalable Model Based Text Clustering

Mining Interestingness Sub-cubes in Multi-dimensional Data

MC-Tree: Dynamic Index Structure for Partially Clustered Multi-Dimensional Database

Turning Multidimensional Big Data Analytics into Practice: Design and Implementation of ClustCube Big-Data Tools in Real-Life Scenarios

Compression and Aggregation for Logistic Regression Analysis in Data Cubes

Strategies for Complex Data Cube Queries

SmartCube: an Adaptive Data Management Architecture for the Real-Time Visualization of Spatiotemporal Datasets.

Parallel Non-negative Matrix Tri-Factorization for Text Data Co-clustering

TCUAP: A Novel Approach of Text Clustering Using Asymmetric Proximity.

A Cube Algebra with Comparative Operations: Containment, Overlap, Distance and Usability

CubeNet: Multi-Facet Hierarchical Heterogeneous Network Construction, Analysis, and Mining

DIAS: A Disassemble-Assemble Framework for Highly Sparse Text Clustering