Abstract:On-Line Analytical Processing (OLAP) enables powerful analytics by quickly computing aggregate values of numerical measures over multiple hierarchical dimensions for massive datasets. However, many types of source data, e.g., from GPS, sensors, and other measurement devices, are intrinsically inaccurate (imprecise and/or uncertain) and thus OLAP cannot be readily applied. In this paper, we address the resulting data veracity problem in OLAP by proposing the concept of probabilistic data cubes. Such a cube is comprised of a set of probabilistic cuboids which summarize the aggregated values in the form of probability mass functions (pmfs in short) and thus offer insights into the underlying data quality and enable confidence-aware query evaluation and analysis. However, the probabilistic nature of data poses computational challenges, since a probabilistic database can have exponential number of possible worlds under the possible world semantics. Even worse, it is hard to share computations among different cuboids, as aggregation functions that are distributive for traditional data cubes, e.g., SUM, become holistic in probabilistic settings. In this paper, we propose a complete set of techniques for probabilistic data cubes, from cuboid aggregation, over cube materialization, to query evaluation. We study two types of aggregation: convolution and sketch-based, which take polynomial time complexities for aggregation and jointly enable efficient query processing. Also, our proposal is versatile in terms of: 1) its capability of supporting common aggregation functions, i.e., SUM, COUNT, MAX, and AVG; 2) its adaptivity to different materialization strategies, e.g., full versus partial materialization, with support of our devised cost models and parallelization framework; 3) its coverage of common OLAP operations, i.e., probabilistic slicing and dicing queries. Extensive experiments over real and synthetic datasets show that our techniques are effective and scalable.

Efficient Queries Evaluation on Block Independent Disjoint Probabilistic Databases

Generating Efficient Safe Query Plans for Probabilistic Databases.

Combining Intensional with Extensional Query Evaluation in Tuple Independent Probabilistic Databases

Efficient Sensitivity Analysis for Inequality Queries in Probabilistic Databases

Iquery: A Trustworthy and Scalable Blockchain Analytics Platform

Adaptive Multi-join Query Processing in PDBMS

H-Tree: a hybrid structure for confidence computation in probabilistic databases

Answering Frequent Probabilistic Inference Queries in Databases

Strategy and Algorithm of Probabilistic Query Based on Inconsistent Database

Computing Event Probability in Probabilistic Databases

Sensitivity Analysis and Explanations for Robust Query Evaluation in Probabilistic Databases.

Scalable Probabilistic Databases with Factor Graphs and MCMC

Ranking and Clustering in Probabilistic Databases

Faster Query Answering in Probabilistic Databases using Read-Once Functions

Online Inference Based on Approximate Factors for Probabilistic Knowledge Bases

AQP++: Connecting Approximate Query Processing with Aggregate Precomputation for Interactive Analytics

Independence in Infinite Probabilistic Databases

Probery: A Probability-based Incomplete Query Optimization for Big Data

PoBery: Possibly-complete Big Data Queries with Probabilistic Data Placement and Scanning

BayesDB: A probabilistic programming system for querying the probable implications of data

OLAP over Probabilistic Data Cubes II: Parallel Materialization and Extended Aggregates