Abstract:Learned Bloom Filters, i.e., models induced from data via machine learning techniques and solving the approximate set membership problem, have recently been introduced with the aim of enhancing the performance of standard Bloom Filters, with special focus on space occupancy. Unlike in the classical case, the "complexity" of the data used to build the filter might heavily impact on its performance. Therefore, here we propose the first in-depth analysis, to the best of our knowledge, for the performance assessment of a given Learned Bloom Filter, in conjunction with a given classifier, on a dataset of a given classification complexity. Indeed, we propose a novel methodology, supported by software, for designing, analyzing and implementing Learned Bloom Filters in function of specific constraints on their multi-criteria nature (that is, constraints involving space efficiency, false positive rate, and reject time). Our experiments show that the proposed methodology and the supporting software are valid and useful: we find out that only two classifiers have desirable properties in relation to problems with different data complexity, and, interestingly, none of them has been considered so far in the literature. We also experimentally show that the Sandwiched variant of Learned Bloom filters is the most robust to data complexity and classifier performance variability, as well as those usually having smaller reject times. The software can be readily used to test new Learned Bloom Filter proposals, which can be compared with the best ones identified here.

Learned Bloom Filter for Multi-key Membership Testing

Noisy Bloom Filters for Multi-Set Membership Testing

Two-layer partitioned and deletable deep bloom filter for large-scale membership query

Private Membership Test for Bloom Filters

Difference Bloom Filter: a Probabilistic Structure for Multi-set Membership Query

Stable Learned Bloom Filters for Data Streams

ID Bloom Filter: Achieving Faster Multi-Set Membership Query in Network Applications

LBFM: Multi-Dimensional Membership Index for Block-Level Data Skipping

PA-LBF: Prefix-Based and Adaptive Learned Bloom Filter for Spatial Data

CBFM:cutted Bloom Filter Matrix for Multi-Dimensional Membership Query

Matrix Bloom Filter: An Efficient Probabilistic Data Structure for 2-tuple Batch Lookup

Cardinality computing: a new step towards fully representing multi-sets by bloom filters

Magic Cube Bloom Filter: Answering Membership Queries for Multiple Sets

Optimizing Bloom Filter: Challenges, Solutions, and Comparisons

Bloofi: Multidimensional Bloom filters

Hash Adaptive Bloom Filter

Multi-Dimensional Bloom Filter: Design and Evaluation.

scaleBF: A High Scalable Membership Filter using 3D Bloom Filter

A Shifting Bloom Filter Framework for Set Queries.

A Critical Analysis of Classifier Selection in Learned Bloom Filters

A Pareto Optimal Bloom Filter Family with Hash Adaptivity