Abstract:In the era of big-data, individuals and institutions store their sensitive data on clouds, and these data are often analyzed and computed by MapReduce frameworks (e.g., Spark). However, releasing the computation result on these data may leak privacy. Differential Privacy (DP) is a powerful method to preserve the privacy of an individual data record from a computation result. Given an input dataset and a query, DP typically perturbs an output value with noise proportional to sensitivity, the greatest change on an output value when a record is added to or removed from the input dataset. Unfortunately, directly computing the sensitivity value for a query and an input dataset is computationally infeasible, because it requires adding or removing every record from the dataset and repeatedly running the same query on the dataset: a dataset of one million input records requires running the same query for more than one million times. This paper presents UPA, the first automated, accurate, and efficient sensitivity inferring approach for big-data mining applications. Our key observation is that MapReduce operators often have commutative and associative properties in order to enable parallelism and fault tolerance among computers. Therefore, UPA can greatly reduce the repeated computations at runtime while computing a precise sensitivity value automatically for general big-data queries. We compared UPA with FLEX, the most relevant work that does static analysis on queries to infer sensitivity values. Based on an extensive evaluation on nine diverse Spark queries, UPA supports all the nine evaluated queries, while FLEX supports only five of the nine queries. For the five queries which both UPA and FLEX can support, UPA enforces DP with five orders of magnitude more accurate sensitivity values than FLEX. UPA has reasonable performance overhead compared to native Spark. UPA's source code is available on https://github.com/hku-systems/UPA.

Efficient Probabilistic Frequent Itemset Mining In Big Sparse Uncertain Data

Mining Noise-Tolerant Frequent Closed Itemsets in Very Large Database.

Mining Top-k Minimal Redundancy Frequent Patterns over Uncertain Databases.

Approximate mining of global closed frequent itemsets over data streams

Accelerated Frequent Closed Sequential Pattern Mining for Uncertain Data

MapReduce-based Parallelized Approximation of Frequent Itemsets Mining in Uncertain Data.

UPA: an Automated, Accurate and Efficient Differentially Private Big-Data Mining System

Mining Probabilistically Frequent Sequential Patterns in Large Uncertain Databases

Mining frequent itemset from uncertain data

Efficient Algorithm for Mining of Frequent Itemsets over Uncertain Data Streams

A STABLE PARALLEL DISTRIBUTED FREQUENT ITEMSET MINING ALGORITHM AND ITS APPLICATION

Mining Order-Preserving Submatrices Under Data Uncertainty: A Possible-World Approach and Efficient Approximation Methods

Mining Algorithm of Frequent Closed Itemsets Based on Uncertain Data

Multiobjective-integer-programming-based Sensitive Frequent Itemsets Hiding.

Mining Approximate Frequent Itemsets from Noisy Data

MapReduce-based Closed Frequent Itemset Mining with Efficient Redundancy Filtering

FRI-Miner: Fuzzy Rare Itemset Mining

A Two-Phase Approach for Unexpected Pattern Mining.

YAFIM: A Parallel Frequent Itemset Mining Algorithm with Spark

UHUOPM - High Utility Occupancy Pattern Mining in Uncertain Data.

Frequent Pattern Mining with Uncertain Data