Abstract:A Bloom filter is a memory-efficient data structure for approximate membership queries used in numerous fields of computer science. Recently, learned Bloom filters that achieve better memory efficiency using machine learning models have attracted attention. One such filter, the partitioned learned Bloom filter (PLBF), achieves excellent memory efficiency. However, PLBF requires a $O(N^3k)$ time complexity to construct the data structure, where $N$ and $k$ are the hyperparameters of PLBF. One can improve memory efficiency by increasing $N$, but the construction time becomes extremely long. Thus, we propose two methods that can reduce the construction time while maintaining the memory efficiency of PLBF. First, we propose fast PLBF, which can construct the same data structure as PLBF with a smaller time complexity $O(N^2k)$. Second, we propose fast PLBF++, which can construct the data structure with even smaller time complexity $O(Nk\log N + Nk^2)$. Fast PLBF++ does not necessarily construct the same data structure as PLBF. Still, it is almost as memory efficient as PLBF, and it is proved that fast PLBF++ has the same data structure as PLBF when the distribution satisfies a certain constraint. Our experimental results from real-world datasets show that (i) fast PLBF and fast PLBF++ can construct the data structure up to 233 and 761 times faster than PLBF, (ii) fast PLBF can achieve the same memory efficiency as PLBF, and (iii) fast PLBF++ can achieve almost the same memory efficiency as PLBF. The codes are available at <a class="link-external link-https" href="https://github.com/atsukisato/FastPLBF" rel="external noopener nofollow">this https URL</a> .

Fast Partitioned Learned Bloom Filter

Fast Construction of Partitioned Learned Bloom Filter with Theoretical Guarantees

Two-layer partitioned and deletable deep bloom filter for large-scale membership query

Stable Learned Bloom Filters for Data Streams

A Pareto Optimal Bloom Filter Family with Hash Adaptivity

RobustBF: A High Accuracy and Memory Efficient 2D Bloom Filter

Ultra-Fast Bloom Filters Using SIMD Techniques

Low Computational Cost Bloom Filters

Bloom Filter with Noisy Coding Framework for Multi-Set Membership Testing

Split Bloom Filter

Noisy Bloom Filters for Multi-Set Membership Testing

Bloofi: Multidimensional Bloom filters

Hash Adaptive Bloom Filter

ID Bloom Filter: Achieving Faster Multi-Set Membership Query in Network Applications

Shed More Light on Bloom Filter's Variants

scaleBF: A High Scalable Membership Filter using 3D Bloom Filter

NameFilter: Achieving Fast Name Lookup with Low Memory Cost Via Applying Two-Stage Bloom Filters

Matrix Bloom Filter: An Efficient Probabilistic Data Structure for 2-tuple Batch Lookup

Optimizing Learned Bloom Filters by Sandwiching

Optimizing Collections of Bloom Filters within a Space Budget

FeCBF: A Novel Sub-Optimal Cascaded Bloom Filter Structure Based on Feature Extraction