Abstract:On-Line Analytical Processing (OLAP) enables powerful analytics by quickly computing aggregate values of numerical measures over multiple hierarchical dimensions for massive datasets. However, many types of source data, e.g., from GPS, sensors, and other measurement devices, are intrinsically inaccurate (imprecise and/or uncertain) and thus OLAP cannot be readily applied. In this paper, we address the resulting data veracity problem in OLAP by proposing the concept of probabilistic data cubes. Such a cube is comprised of a set of probabilistic cuboids which summarize the aggregated values in the form of probability mass functions (pmfs in short) and thus offer insights into the underlying data quality and enable confidence-aware query evaluation and analysis. However, the probabilistic nature of data poses computational challenges, since a probabilistic database can have exponential number of possible worlds under the possible world semantics. Even worse, it is hard to share computations among different cuboids, as aggregation functions that are distributive for traditional data cubes, e.g., SUM, become holistic in probabilistic settings. In this paper, we propose a complete set of techniques for probabilistic data cubes, from cuboid aggregation, over cube materialization, to query evaluation. We study two types of aggregation: convolution and sketch-based, which take polynomial time complexities for aggregation and jointly enable efficient query processing. Also, our proposal is versatile in terms of: 1) its capability of supporting common aggregation functions, i.e., SUM, COUNT, MAX, and AVG; 2) its adaptivity to different materialization strategies, e.g., full versus partial materialization, with support of our devised cost models and parallelization framework; 3) its coverage of common OLAP operations, i.e., probabilistic slicing and dicing queries. Extensive experiments over real and synthetic datasets show that our techniques are effective and scalable.

Practical Inference Control for Data Cubes

Constraints, Inference Channels and Secure Databases.

A Clustered Dwarf Structure to Speed Up Queries on Data Cubes

Statistical-Computational Trade-offs for Density Estimation

Managing Your Private and Public Data: Bringing Down Inference Attacks Against Your Privacy

C-Cubing: Efficient Computation of Closed Cubes by Aggregation-Based Checking

APIC: An Efficient Algorithm for Computing Iceberg Datacubes

CDF-Intervals: A Reliable Framework to Reason about Data with Uncertainty

The P-Box CDF-Intervals: Reliable Constraint Reasoning with Quantifiable Information

Bounds for probabilistic programming with application to a blend planning problem

Auditing Interval-Based Inference

Scalable Computation of Causal Bounds

OLAP over Probabilistic Data Cubes II: Parallel Materialization and Extended Aggregates

Bayesian Analysis in Data Cubes

Inference Control in Distributed Environment: A Comparison Study

Conditional Lower Bounds for Dynamic Geometric Measure Problems

Estimating error bounds for binary subdivision curves/surfaces

Higher-dimensional Dedekind sums and their bounds arising from the discrete diagonal of the n-cube

Strategies for Complex Data Cube Queries

Variational Inference on the Boolean Hypercube with the Quantum Entropy

A High Performance Hierarchical Cubing Algorithm And Efficient Olap In High-Dimensional Data Warehouse