Duplicate detection methodology for IP network traffic analysis

Inaki Ucar,Daniel Morato,Eduardo Magana,Mikel Izal
DOI: https://doi.org/10.48550/arXiv.1311.4168
2013-11-17
Networking and Internet Architecture
Abstract:Network traffic monitoring systems have to deal with a challenging problem: the traffic capturing process almost invariably produces duplicate packets. In spite of this, and in contrast with other fields, there is no scientific literature addressing it. This paper establishes the theoretical background concerning data duplication in network traffic analysis: generating mechanisms, types of duplicates and their characteristics are described. On this basis, a duplicate detection and removal methodology is proposed. Moreover, an analytical and experimental study is presented, whose results provide a dimensioning rule for this methodology.
What problem does this paper attempt to address?