Abstract:Bloom filters are probabilistic data structures commonly used for approximate membership problems in many areas of Computer Science (networking, distributed systems, databases, etc.). With the increase in data size and distribution of data, problems arise where a large number of Bloom filters are available, and all of them need to be searched for potential matches. As an example, in a federated cloud environment, each cloud provider could encode the information using Bloom filters and share the Bloom filters with a central coordinator. The problem of interest is not only whether a given element is in any of the sets represented by the Bloom filters, but also which of the existing sets contain the given element. This problem cannot be solved by just constructing a Bloom filter on the union of all the sets. Instead, we effectively have a multidimensional Bloom filter problem: given an element, we wish to receive a list of candidate sets where the element might be.To solve this problem, we consider three alternatives. Firstly, we can naively check many Bloom filters. Secondly, we propose to organize the Bloom filters in a hierarchical index structure akin to a B+ tree that we call Bloofi. Finally, we propose another data structure that packs the Bloom filters in such a way as to exploit bit-level parallelism, which we call Flat-Bloofi.Our theoretical and experimental results show that Bloofi and Flat-Bloofi provide scalable and efficient solutions alternatives to search through a large number of Bloom filters.

TMBF: Bloom filter algorithms of time-dependent multi bit-strings for incremental set

ID Bloom Filter: Achieving Faster Multi-Set Membership Query in Network Applications

Difference Bloom Filter: a Probabilistic Structure for Multi-set Membership Query

A Shifting Bloom Filter Framework for Set Queries.

Bloom Filter with Noisy Coding Framework for Multi-Set Membership Testing

Noisy Bloom Filters for Multi-Set Membership Testing

A Compact In-memory Index for Managing Set Membership Queries on Streaming Data.

Split Bloom Filter

Multi-Dimensional Bloom Filter: Design and Evaluation.

Cardinality computing: a new step towards fully representing multi-sets by bloom filters

A Shifting Framework for Set Queries

Bloofi: Multidimensional Bloom filters

Optimizing Bloom Filter Settings in Peer-to-Peer Multikeyword Searching

An Approximate Duplicate-Elimination In Rfid Data Streams Based On D-Left Time Bloom Filter

Reducing the number of Bloom filters

Learned Bloom Filter for Multi-key Membership Testing

Counting Evolving Data Stream Based on Hierarchical Counting Bloom Filter

Research on Typical Bloom Filters and Their Data Stream Applications

scaleBF: A High Scalable Membership Filter using 3D Bloom Filter

Scalable Data Center Multicast Using Multi-Class Bloom Filter.

Tagged Cuckoo Filters