Ccs: A Counter-Cascading Sketch-Based Solution for Data Streams on Fpga

Jianchao Yang,Mei Wen,Minjin Tang,Junzhong Shen,Xiaolei Zhao,Chuanyuan Zhang
DOI: https://doi.org/10.2139/ssrn.4112924
2022-01-01
SSRN Electronic Journal
Abstract:Obtaining item frequencies in data streams with limited space is a well-recognized and challenging problem in a wide range of applications. Sketch-based solutions have been widely used to address this challenge due to their ability to accurately record the data streams at a low memory cost. However, most sketches suffer from low memory utilization due to the adoption of a fixed counter size. Accordingly, in this work, we propose a counter-cascading scheduling algorithm to maximize the memory utilization of sketches without incurring any accuracy loss. In addition, we propose an FPGA-based system design that supports sketch parameter learning, counter-cascading record and online query. We implement our designs on Xilinx VCU118, and conduct evaluations on real-world traces, thereby demonstrating that our design can achieve higher accuracy with lower storage; the performance achieved is better than that of state-of-the-art sketches by a factor of 3×∼8× in memory overhead, 2× ∼ 10× in average absolute error and 3× ∼ 13× in average relative error.
What problem does this paper attempt to address?