Abstract:Joins are expensive, especially on large data and/or multiple relations. One promising approach in mitigating their high costs is to just return a simple random sample of the full join results, which is sufficient for many tasks. Indeed, in as early as 1999, Chaudhuri et al. posed the problem of sampling over joins as a fundamental challenge in large database systems. They also pointed out a fundamental barrier for this problem, that the sampling operator cannot be pushed through a join, i.e., sample( R bowtie S )≠ sample( R ) bowtie sample( S ). To overcome this barrier, they used precomputed statistics to guide the sampling process, but only showed how this works for two-relation joins. This paper revisits this classic problem for both acyclic and cyclic multi-way joins. We build upon the idea of Chaudhuri et al., but extend it in several nontrivial directions. First, we propose a general framework for random sampling over multi-way joins, which includes the algorithm of Chaudhuri et al. as a special case. Second, we explore several ways to instantiate this framework, depending on what prior information is available about the underlying data, and offer different tradeoffs between sample generation latency and throughput. We analyze the properties of different instantiations and evaluate them against the baseline methods; the results clearly demonstrate the superiority of our new techniques.

Sampling ensembles for frequent patterns

Quantitative Model and Fast Estimation Algorithm of Sampling Error for Association Rule Mining

Dtgc-Tree: A New Strategy Of Association Rules Mining

Random Sampling over Joins Revisited

A new sampling algorithm for association rule

Sampling over Union of Joins

Ensemble Pruning Based on Frequent Patterns

An Algorithm Research For Distributed Association Rules Mining With Constraints Based On Sampling

Incrementally Updating Association Rules Based On Multiple Previously Mined Results

Sampling Based Multi-Agent Joint Learning for Association Rule Mining.

On Addressing Accuracy Concerns in Privacy Preserving Association Rule Mining

Subsampled Ensemble Can Improve Generalization Tail Exponentially

Reservoir Sampling over Joins

IMPROVED DATA MINING ALGORITHMS FOR FREQUENT PATTERNS WITH COMPOSITE ITEMS

Ensemble-Based Annealed Importance Sampling

Ensemble approaches for improving community detection methods

Multi-Aspect Diversification of Samples and Features for Advanced Creation of Rule Ensemble

Learning and Synchronized Privacy Preserving Frequent Pattern Mining

A breadth-first search algorithm for mining generalized frequent itemsets based on set enumeration tree

A New Frequent Pattern Mining Algorithm with Weighted Multiple Minimum Supports

Efficient Association Rule Mining among Both Frequent and Infrequent Items