Compression of pending interest table with Bloom filter in content centric network

Zhaogeng Li,Jun Bi,Sen Wang,Xiaoke Jiang

DOI: https://doi.org/10.1145/2377310.2377326

2012-01-01

Abstract:We propose compressed PIT structure based on Bloom Filter. And we argue that United Bloom Filter is better than Counting Bloom Filter in the PIT compression.

What problem does this paper attempt to address?

DiPIT: A Distributed Bloom-Filter Based PIT Table for CCN Nodes

Wei You,Bertrand Mathieu,Patrick Truong,Jean-François Peltier,Gwendal Simon

DOI: https://doi.org/10.1109/ICCCN.2012.6289282

2012-01-01

Abstract:Content-Centric Network is a novel Internet design that investigates the shifting of the Internet usage from browsing to content dissemination. This new Internet architecture proposal can bring many benefits and it has attracted many research works. When we study on these research, we found that one of the important components, the Pending Interest Table (PIT), did not get much attention. Since that in CCN the networking behaviours are no longer based on endpoints location but rather on every piece of the content itself, and the PIT is involved in both the forwarding processes upstream and downstream, in case of large amount of requests, the table size is a big issue, that leads to a large required memory space for implementing such a CCN node. In this paper, we propose a distributed PIT table, named DiPIT, where a part of the PIT is on every interface. Our approach relies on Bloom Filters in order to reduce the necessary memory space for implementing the PIT, completed with a central Bloom Filter for limiting the false positives, generated by the individual Bloom Filters. The evaluations we have performed highlight that our DiPIT approach can significantly reduce the memory space (up to 63%) in the CCN node and support a higher incoming packet throughput, compared to the hash table technology, which is largely implemented in current routers.
Reducing the Size of Pending Interest Table for Content-Centric Networks with Hybrid Forwarding

Xiong Wang,Wei Wang,Chunhui Zeng,Rui Dai,Sheng Wang,Shizhong Xu

DOI: https://doi.org/10.1109/icc.2016.7510920

2016-01-01

Abstract:Content-Centric Networking (CCN) is a novel networking paradigm that treats the named contents, not the hosts, as the first-class citizens of the network. In the forwarding plane, CCN employs a stateful forwarding scheme, which maintains per-packet state information in Pending Interest Table (PIT). By employing stateful forwarding, CCN enables native support for content requests aggregation and multicast. However, the stateful forwarding scheme requires large-sized PITs with extremely high access speed to store per-packet state information, leading to scalability issue. To overcome the issue, this paper proposes a Hybrid forwarding scheme based on content POPularity (HyPOP) for CCN. HyPOP classifies the contents into popular and unpopular contents, and uses the stateful and Bloom Filter based stateless forwarding schemes to forward the popular and unpopular contents, respectively. The mathematical analysis results demonstrate that if PITs only store state information for popular contents, the small-sized PITs are sufficient for achieving satisfactory forwarding performance. Furthermore, the extensive simulation results also verify that HyPOP can reduce the size of PIT significantly and achieve promising forwarding performance.
DiCuPIT: Distributed Cuckoo Filter-based Pending Interest Table

Arman Mahmoudi,Mahmood Ahmadi

2023-08-05

Abstract:Named data networking is one of the recommended {\color{red}architectures} for the future of the Internet. In this communication architecture, the content name is used instead of the IP address. To achieve this purpose, a new data structure is added to the nodes of named data networking which is called Pending Interest Table (PIT). Scalability, memory consumption, and integration are the significant challenges in PIT design {\color{red} as} it needs to be updated for each packet, and it saves the name of the packet. This paper introduces a new data structure for PIT called DiCuPIT. DiCuPIT is a distributed data structure for the PIT table, {\color{red} that works} based on the Cuckoo filter and can cover the three features as above-mentioned. {\color{red} By} implementing this PIT, {\color{red} the lookup} time shows {\color{red} a 36\% reduction} compared to the methods based on the Bloom filter and 40\% based on hash tables. Moreover, the memory consumption is reduced by 68\% compared to the hash tables-based mechanisms and 31\% compared to the methods based on the Bloom filter.

Networking and Internet Architecture
Realistic Storage of Pending Requests in Content-Centric Network Routers

Wei You,Bertrand Mathieu,Patrick Truong,Jean-François Peltier,Gwendal Simon

DOI: https://doi.org/10.1109/iccchina.2012.6356864

2012-01-01

Abstract:Content-Centric Networking (CCN) is a novel network paradigm, which aims at moving from the traditional host-to-host network model to a client-to-content one. This shift brings many benefits but also leads a big challenge on the hardware technologies for implementing CCN nodes. For example the Pending Interest Table, one critical component in a CCN node, is involved in every CCN message forwarding process, and needs to be updated every time a packet comes in. The implementation of this table requires a memory that is fast for short access time and also large enough for storing the pending Interests. Unfortunately today's memory technologies cannot meet these requirements with the current hash-based architecture. After highlighting this limitation, we present a distributed PIT architecture which is based on the Bloom filter structure. The evaluations validate that our solution can reduce the PIT table size and support higher packet arrival rate. Our solution allows to implement this component on today's fast memory like SRAM. Therefore this proposal can improve the content fetching performance and improve the quality of content delivered in CCN network.
ID Bloom Filter: Achieving Faster Multi-Set Membership Query in Network Applications

Peng Liu,Hao Wang,Siang Gao,Tong Yang,Lei Zou,Lorna Uden,Xiaoming Li

DOI: https://doi.org/10.1109/icc.2018.8422627

2018-01-01

Abstract:The problem of multi-set membership query plays a significant role in many network applications, including routers and firewalls. Answering multi-set membership query means telling whether an element belongs to the multi-set, and if yes, which particular set it belongs to. Most traditional solutions for multi-set membership query are based on Bloom filters. However, these solutions cannot achieve high accuracy and high speed at the same time when the memory is tight. To address this issue, this paper presents the ID Bloom Filter (IBF) and ID Bloom Filter with ones' Complement (IBFC). The key technique in IBF is mapping each element to k positions in a filter and directly recording its set ID at these positions. It has a small memory usage as well as a high processing speed. To achieve higher accuracy, we propose IBFC that records the set ID and its ones' complement together. The experimental results show that our IBF and IBFC are faster than the state-of-the-art while achieving a high accuracy.
RAPIT: RTT-Aware Pending Interest Table for Content Centric Networking

Tan Yalei,Li Qing,Jiang Yong,Xia Shutao

DOI: https://doi.org/10.1109/PCCC.2015.7410287

2015-01-01

Abstract:The current Internet is facing a lot of challenges, including the transmission inefficiency due to the popularity of content-delivery applications. Content-Centric Networking (CCN) solves this problem by name-oriented routing and in network caching. As a core component of the CCN router, the Pending Interest Table (PIT) is crucial for the forwarding performance. In this paper, we propose the RTT-Aware PIT (RAPIT) to improve the PIT efficiency in CCN by reducing the residence time of non-responded PIT entries. First, we provide an approach to measure the Round-Trip Time (RTT) from a CCN router to the content publisher and set PIT entry residence time dynamically based on the measured RTT. Second, we prioritize the PIT entries based on their aggregated request amounts and the possibility of being responded. When the PIT is exhausted, the lowest-priority entry will be replaced by the latest one. The evaluation results show that: 1) compared with current PIT with scheme in CCNx, RAPIT reduces the PIT size to 57.6% and improve the network throughput by 200%; 2) when replacement is triggered as the PIT is full, RAPIT is more accurate and improves the PIT efficiency by 20-50% compared with FIFO.
Analysis of Tandem PIT and CS with Non-Zero Download Delay

Huichen Dai,Bin Liu,Haowei Yuan,Patrick Crowley,Jianyuan Lu

DOI: https://doi.org/10.1109/INFOCOM.2017.8057191

2017-01-01

Abstract:Collapsed forwarding has long been used in cache systems to reduce the load on servers by aggregating requests for the same content. Named Data Networking (NDN) as a future Internet architecture incorporates this technique through a data structure called Pending Interest Table (PIT). The request aggregation feature suggests that PIT can be viewed as a non-reset time-to-live (TTL) based cache. The Content Store (CS) is a content cache placed in front of the PIT on the NDN forwarding path, so they make up a tandem cache network. To investigate the metrics of interest in this network, like the hit probability for the PIT and the CS, the expected PIT size, non-zero download delay (non-ZDD) should be taken into consideration. Caching policies usually assume zero download delay (ZDD), i.e., request and object arrive simultaneously, and numerous analytical methods have been proposed to study the ZDD caching policies. In this paper, after dissecting the LRU policy, we for the first time propose two LRU variants considering non-ZDD by defining separate operations for the request and object arrivals. When CS adopts the proposed LRU variants, the analysis of the CS-PIT network can still take advantage of the existing models, so the metrics of interest can be computed. Especially, the distribution for the "inter-miss" time of this network can be derived, which has not been achieved by prior works. Finally, the analytical results are verified through simulations.
On Pending Interest Tablein Named Data Networking

Huichen Dai,Bin Liu,Yan Chen,Yi Wang

DOI: https://doi.org/10.1145/2396556.2396600

2012-01-01

Abstract:Internet has witnessed its paramount function transition from host to -host communication to content dissemination. Named Data Networking (NDN) and Content-Centric Networking (CCN) emerge as a clean slate network architecture to embrace this shift. Pending Interest Table (PIT) in NDN/CCN keeps track of the Interest packets that are received but yet un-responded, which brings NDN/CCN significant features, such as communicating without the knowledge of source or destination, loop and packet loss detection, multipath routing, better security, etc.This paper presents a thorough study of PIT for the first time. Using an approximate, application-driven translation of current IPgenerated trace to NDN trace, we firstly quantify the size and access frequencies of PIT. Evaluation results on a 20 Gbps gateway trace show that the corresponding PIT contains 1.5 M entries, and the lookup, insert and delete frequencies are 1.4 M/s, 0.9 M/s and 0.9 M/s, respectively. Faced with this challenging issue and to make PIT more scalable, we further propose a Name Component Encoding (NCE) solution to shrink PIT size and accelerate PIT access operations. By NCE, the memory consumption can be reduced by up to 87.44%, and the access performance significantly advanced, satisfying the access speed required by PIT. Moreover, PIT exhibits good scalability with NCE. At last, we propose to place PIT on (egress channel of) the outgoing line-cards of routers, which meets the NDN design and eliminates the cumbersome synchronization problem among multiple PITs on the line-cards.
On The Pit Of Named Data Manet

Li Zhang,Xuan Chen,Yue Wang,Chang-Wen Chen

2015-01-01

Abstract:Named Data Networking (NDN) has several advantages for supporting mobility. However, due to the use of variable-length names in huge name space, its Pending Interest Table (PIT) brings a significant challenge to mobile nodes in wireless net-works caused by the required storage space and the table lookup speed. It directly affects the packet forwarding speed. Existing PIT representations developed for wired networks cannot be directly applied to MANETs because of the mobility constraints. We present in this paper a Bloom Filter based approach to represent PIT in Named Date MANET (NDM) taking advantage of its performance in fast table looking up and space saving. Several technical issues associated with adopting Bloom Filter for PIT representation in NDM will be addressed in detail. These issues include false positive rate, hash function number, memory usage and entry deletion. We also analyze whether or not the names should be aggregated. Simulation results show that PIT with Bloom Filter representation can indeed reduce storage usage and improve the lookup speed of PIT in NDM.
Optimizing Bloom Filter Settings in Peer-to-Peer Multikeyword Searching

Hanhua Chen,Hai Jin,Lei Chen,Yunhao Liu,Lionel M. Ni

DOI: https://doi.org/10.1109/TKDE.2011.14

IF: 9.235

2012-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Peer-to-Peer multikeyword searching requires distributed intersection/union operations across wide area networks, raising a large amount of traffic cost. Existing schemes commonly utilize Bloom Filters (BFs) encoding to effectively reduce the traffic cost during the intersection/union operations. In this paper, we address the problem of optimizing the settings of a BF. We show, through mathematical proof, that the optimal setting of BF in terms of traffic cost is determined by the statistical information of the involved inverted lists, not the minimized false positive rate as claimed by previous studies. Through numerical analysis, we demonstrate how to obtain optimal settings. To better evaluate the performance of this design, we conduct comprehensive simulations on TREC WT10G test collection and query logs of a major commercial web search engine. Results show that our design significantly reduces the search traffic and latency of the existing approaches.
On the Analysis of Caches with Pending Interest Tables.

Mostafa Dehghan,Bo Jiang,Ali Dabirmoghaddam,Don Towsley

DOI: https://doi.org/10.1145/2810156.2810161

2015-01-01

Abstract:Collapsed forwarding has been used in cache systems to reduce the load on servers by aggregating requests for the same content. This technique has made its way into design proposals for the future Internet architecture through a data structure called Pending Interest Table (PIT). A PIT keeps track of interest packets that are received at a cache-router until they are responded to. PITs are considered useful for a variety of reasons e.g., communicating without the knowledge of source and destination, reducing bandwidth usage, better security, etc. Due to the high access frequency to the PIT, it is essential to understand its behavior, and the effect it has on cache performance. In this paper, we consider a TTL-based cache with a Pending Interest Table, and analyze the cache hit probability, mean response time perceived by the users, and size of the PIT, among other metrics of interest. In our analysis, we account for the time it takes for the cache to download a file from the server defined as a random variable. We apply our model to analyze traditional caching policies LRU, FIFO, and RANDOM, and verify the accuracy of our model through numerical simulations.
Performance Evaluation and Comparison of Three Counting Bloom Filter Schemes

Jin Zhang,Jiangxing Wu,Julong Lan,Jianqiang Liu

DOI: https://doi.org/10.1007/s11767-008-0031-x

2010-01-01

Journal of Software

Abstract:The Counting Bloom Filter (CBF) is a kind of space-efficient data structure that extends a Bloom filter so as to allow approximate multiplicity queries on a dynamic multi-set. This paper evaluates the performance of multiplicity queries of three simple CBF schemes-the Naïve Counting Bloom Filter (NCBF), the Space-Code Bloom Filter (SCBF) and the d-left Counting Bloom Filter (dlCBF)—using metrics of space complexity and counting error under both uniform and zipfian multiplicity distributions. We compare their counting error under same space complexity, and their space complexity when similar counting errors are achieved respectively. Our results show that dlCBF is the best while SCBF is the worst in terms of both space-efficiency and accuracy. Furthermore, the performance gap between dlCBF and the others has a trend of being enlarged with the increment of space occupation or counting accuracy.
Parallelizing FIB Lookup in Content Centric Networking

Ding, Shuai,Chen, Zhen,Liu, Zhi

DOI: https://doi.org/10.1109/ICNDC.2012.10

2012-01-01

Abstract:As a promising future Internet architecture, CCN(Content Centric Networking) is a pragmatic shift from host-to-host to named content model. Providing each piece of content with a specified name, CCN can either directly route a user's Interest for a specific piece of content to the content server, or simply pick the right piece of content from the in network cache and send it back to the user. The combination of content name and in-network cache makes CCN suitable for content distribution. Name based FIB (Forwarding Information Base) table lookup thus plays an important role in CCN routing, as FIB records the forwarding face set for different name prefixes. This paper leverages multi-core platform to accelerate the FIB lookup in CCN router. Based on TILEPro64 platform, which has 64 identical tiles, two parallel zed lookup algorithms, one is based on hash table and the other is based on Bloom filter, are implemented and evaluated. To better evaluate the performance, the size of FIB is estimated and the statistics of URLs are measured to simulate the generation of practical Interests packet traffic. Through theoretical evaluation and experiment, it shows that the parallelization can improve the FIB lookup performance efficiently.
Bloom Filter with Noisy Coding Framework for Multi-Set Membership Testing

Haipeng Dai,Jun Yu,Meng Li,Wei Wang,Alex X. Liu,Jinghao Ma,Lianyong Qi,Guihai Chen

DOI: https://doi.org/10.1109/tkde.2022.3199646

IF: 9.235

2022-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:This article is on designing a compact data structure for multi-set membership testing that allows fast set querying. Multi-set membership testing is a fundamental operation for computing systems. Most existing schemes for multi-set membership testing are built upon Bloom filter and fall short in either storage space cost or query speed. To address this issue, we propose Noisy Bloom Filter (NBF), Error Corrected Noisy Bloom Filter (NBF-E), and Data-driven Noisy Bloom Filter (NBF-D) in this paper. We optimize their misclassification and false positive rates by theoretical analysis and present criteria for selection between NBF, NBF-E, and NBF-D. The key novelty of the three schemes is to store set ID information in a compact but noisy way that allows fast recording and querying and use a denoising method for querying. Especially, NBF-E incorporates asymmetric error-correcting coding techniques into NBF, and NBF-D encodes set ID basedt membership testing. on their cardinality. To evaluate NBF, NBF-E, and NBF-D in comparison with the prior art, we conducted experiments using real-world network traces. The results show that NBF, NBF-E, and NBF-D significantly advance the state-of-the-art on multi-se
Reducing the number of Bloom filters

qingge gong,tong yang,hongwei tong,kai shi,jinghui li,xianyan wu

DOI: https://doi.org/10.1109/PIC.2014.6972399

2014-01-01

Abstract:Bloom Filters have been applied in many fields, including data base, network management, computer network, and computer communication etc., owing to its fast membership query and memory efficiency. In network field, Bloom Filters were used to lookup the forwarding tables in backbone routers and Data Centre switches. These solutions all build many Bloom Filters to achieve fast lookup. The main shortcoming of these solution is: too many Bloom Filters require too many hash computations and memory accesses, and the variety of Bloom Filter sizes poses challenges to system design and probably degrades the system performance. To address this issues, we proposed Set absorption algorithm to reduce the number of Bloom Filters, while balancing the size of Bloom Filters. Experimental results showed that after using our algorithm, better performance of the Bloom Filter-based solutions was obtained.
Low Computational Cost Bloom Filters

Jianyuan Lu,Tong Yang,Yi Wang,Huichen Dai,Xi Chen,Linxiao Jin,Haoyu Song,Bin Liu

DOI: https://doi.org/10.1109/tnet.2018.2869851

2018-01-01

IEEE/ACM Transactions on Networking

Abstract:Bloom filters (BFs) are widely used in many network applications but the high computational cost limits the system performance. In this paper, we introduce a low computational cost Bloom filter named One-Hashing Bloom filter (OHBF) to solve the problem. The OHBF requires only one base hash function plus a few simple modulo operations to implement a Bloom filter. While keeping nearly the same theoretical false positive ratio as a Standard Bloom filter (SBF), the OHBF significantly reduces the computational overhead of the hash functions. We show that the practical false positive ratio of an SBF implementation strongly relies on the selection of hash functions, even if these hash functions are considered good. In contrast, the practical false positive ratio of an OHBF implementation is consistently close to its theoretical bound. The stable false positive performance of the OHBF can be precisely derived from a proved mathematical foundation. As the OHBF has reduced computational overhead, it is ideal for high throughput and low-latency applications. We use a case study to show the advantages of the OHBF. In a BF-based FIB lookup system, the lookup throughput of OHBF-based solution can achieve twice as fast as the SBF-based solution.
False Negative Problem of Counting Bloom Filter

Deke Guo,Yunhao Liu,Xiangyang Li,Panlong Yang

DOI: https://doi.org/10.1109/TKDE.2009.209

IF: 9.235

2010-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Bloom filter is effective, space-efficient data structure for concisely representing a data set and supporting approximate membership queries. Traditionally, researchers often believe that it is possible that a Bloom filter returns a false positive, but it will never return a false negative under well-behaved operations. By investigating the mainstream variants, however, we observe that a Bloom filter does return false negatives in many scenarios. In this work, we show that the undetectable incorrect deletion of false positive items and detectable incorrect deletion of multiaddress items are two general causes of false negative in a Bloom filter. We then measure the potential and exposed false negatives theoretically and practically. Inspired by the fact that the potential false negatives are usually not fully exposed, we propose a novel Bloom filter scheme, which increases the ratio of bits set to a value larger than one without decreasing the ratio of bits set to zero. Mathematical analysis and comprehensive experiments show that this design can reduce the number of exposed false negatives as well as decrease the likelihood of false positives. To the best of our knowledge, this is the first work dealing with both the false positive and false negative problems of Bloom filter systematically when supporting standard usages of item insertion, query, and deletion operations.
Scalable Data Center Multicast Using Multi-Class Bloom Filter.

Dan Li,Henggang Cui,Yan Hu,Yong Xia,Xin Wang

DOI: https://doi.org/10.1109/icnp.2011.6089061

2011-01-01

Abstract:Multicast benefits data center group communications in saving network bandwidth and increasing application throughput. However, it is challenging to scale Multicast to support tens of thousands of concurrent group communications due to limited forwarding table memory space in the switches, particularly the low-end ones commonly used in modern data centers. Bloom Filter is an efficient tool to compress the Multicast forwarding table, but significant traffic leakage may occur when group membership testing is false positive. To reduce the Multicast traffic leakage, in this paper we bring forward a novel multi-class Bloom Filter (MBF), which extends the standard Bloom Filter by embracing element uncertainty. Specifically, MBF sets the number of hash functions in a per-element level, based on the probability for each Multicast group to be inserted into the Bloom Filter. We design a simple yet effective algorithm to calculate the number of hash functions for each Multicast group. We have prototyped a software based MBF forwarding engine on the Linux platform. Simulation and prototype evaluation results demonstrate that MBF can significantly reduce Multicast traffic leakage compared to the standard Bloom Filter, while causing little system overhead.
Multi-Dimensional Bloom Filter: Design and Evaluation.

Fei Xu,Pinxin Liu,Jing Xu,Jianfeng Yang,S. M. Yiu

DOI: https://doi.org/10.1587/transinf.2016inp0022

2017-01-01

IEICE Transactions on Information and Systems

Abstract:Bloom Filter is a bit array (a one-dimensional storage structure) that provides a compact representation for a set of data, which can be used to answer the membership query in an efficient manner with a small number of false positives. It has a lot of applications in many areas. In this paper, we extend the design of Bloom Filter by using a multidimensional matrix to replace the one-dimensional structure with three different implementations, namely OFFF, WOFF, FFF. We refer the extended Bloom Filter as Feng Filter. We show the false positive rates of our method. We compare the false positive rate of OFFF with that of the traditional one-dimensional Bloom Filter and show that under certain condition, OFFF has a lower false positive rate. Traditional Bloom Filter can be regarded as a special case of our Feng Filter.
Optimized hash lookup for bloom filter based packet routing

Li Dagang,Chen Pei

DOI: https://doi.org/10.1109/NBiS.2013.38

2013-01-01

Abstract:As an efficient data structure for membership testing, the Bloom filter has found wide applications in modern day data networks, including high-speed packet routing for IP-based networks as well as future data-centric networks. In packet routing, Bloom filters are mainly used to pre-process incoming routing queries so as to minimize unnecessary lookups in the main routing table, as the latter is normally stored in slow offchip memory in the form of a hash table due to its large size. In this paper an optimized hash lookup scheme is proposed to utilize the preceding Bloom filter for better forwarding performance and usability. With the help of a 'summary vector', internal hash calculations of the Bloom filter are reused in the operations of the routing table to get fast single-access table lookup. Compared with previous work, our scheme achieves improved space efficiency, less calculation overhead, more deterministic lookup performance, and simpler update procedures. The performance of our scheme is confirmed by simulations. © 2013 IEEE.

Compression of pending interest table with Bloom filter in content centric network

DiPIT: A Distributed Bloom-Filter Based PIT Table for CCN Nodes

Reducing the Size of Pending Interest Table for Content-Centric Networks with Hybrid Forwarding

DiCuPIT: Distributed Cuckoo Filter-based Pending Interest Table

Realistic Storage of Pending Requests in Content-Centric Network Routers

ID Bloom Filter: Achieving Faster Multi-Set Membership Query in Network Applications

RAPIT: RTT-Aware Pending Interest Table for Content Centric Networking

Analysis of Tandem PIT and CS with Non-Zero Download Delay

On Pending Interest Tablein Named Data Networking

On The Pit Of Named Data Manet

Optimizing Bloom Filter Settings in Peer-to-Peer Multikeyword Searching

On the Analysis of Caches with Pending Interest Tables.

Performance Evaluation and Comparison of Three Counting Bloom Filter Schemes

Parallelizing FIB Lookup in Content Centric Networking

Bloom Filter with Noisy Coding Framework for Multi-Set Membership Testing

Reducing the number of Bloom filters

Low Computational Cost Bloom Filters

False Negative Problem of Counting Bloom Filter

Scalable Data Center Multicast Using Multi-Class Bloom Filter.

Multi-Dimensional Bloom Filter: Design and Evaluation.

Optimized hash lookup for bloom filter based packet routing