Abstract:Due to the massive amount of data in high-speed network traffic and the limit on processing capability, it is a great challenge to accurately measure and monitor network traffic over high-speed links online. A new data structure is presented in this paper for locating the hosts associated with large connection degrees or significant changes in connection degrees based on the reversible connection degree sketch to monitor anomalous network traffic. The reversible connection degree sketch builds a compact summary of host connection degrees efficiently and accurately. For each packet coming, it only needs to set several bits selected in a bit array by a group of hash functions. These hash functions are designed based on the Chinese Remainder Theorem so that the in-degree or out-degree associated with a given host can be accurately estimated. With this new data structure, we develop a new reverse sketch method for locating abnormal hosts. Although the reversible connection degree sketch does not preserve any host address information, we can analytically reconstruct the host addresses associated with large connection degrees or significant changes in connection degrees by a simple calculation purely based on the characteristics of the hash functions. Furthermore, a reinforced reversible connection degree sketch, the double connection degree sketch, is developed to reduce false positives which are commonly encountered in the sketch-based methods. A traffic monitoring system based on this double connection degree is developed to detect and classify the abnormal hosts associated with large connection degrees or significant changes in connection degrees. The experiments are conducted based on the actual network traffic and the testing results show that our method is accurate and efficient.

Data Link Bit Stream Oriented Association Analysis On Unknown Frame

An Unknown Link Protocol Bit Stream Segmentation Algorithm Based on Frequent Statistics and Association Rules

Mining Fuzzy Association Rules in Data Streams

Bitstream-oriented Frequent Pattern Sequence Mining Algorithm

A Novel Trie and Sequential Feature Analysis-Based Algorithm for Unknown Frame Structure Recognition

Frame Synchronization Word Identification of Link Layer Protocol Based on Multi-fractal Spectrum

Study on Frame Structure Detection in Physical Layer Based on Multi-fractal Spectrum

A Preamble Mining Algorithm Oriented to Binary Protocol Using Random Probes

Bit Stream Oriented Enumeration Tree Pruning Algorithm

A Study on Cell Search Algorithms for IEEE 802.16e OFDMA Systems.

Motion attention based frame-level bit allocation scheme for H.264.

A Data Streaming Method for Monitoring Host Connection Degrees of High-Speed Links

An Algorithm for Data Stream Speed Anomaly Detection Based on RCSW

Algorithm and Performance Analysis for Frame Detection Based on Matched Filtering

Research on the Tag Estimation and Frame Length of the ALOHA Algorithm

A New Classification Algorithm for Data Stream

Enhanced Dynamic Framed Slotted ALOHA Algorithm

Topology Analysis Non-cooperative Path Measurement Localization Selected Paths Selected Paths Feature Vectors Detection Algorithm Detection Engine Measurement Schedule Measurement Schedule Feature Extraction 3

A New Identification Scheme for IPv6 based on Bit Stream

Analyze Large-Scale Communication Network Behavior Through Mining TCP Control Segment Information

Age of Information for Frame Slotted Aloha