Abstract:The continuous growth of Internet and its applications caused more difficulties for analyzing Internet communications which are becoming more and more complex, this has caused new challenges for monitoring and managing the huge and vast network traffic. It is not efficient to monitor and analyze individual IP addresses, so it is more useful to monitor groups of IP addresses that have similar behavior, which represents a certain application activity. Nowadays, such a grouping is either based on network prefixes that does not meet the requirement mentioned above as difference of traffic behavior of individual IP address not being considered, or clustering IP hosts based on their traffic patterns, which requires information about TCP/UDP port numbers (which are occasionally obfuscated) or packet payloads (which are sometimes encrypted or unavailable from aggregated flow records). This paper proposes a new methodology of clustering IP addresses within a managed network domain such as campus network or ISP clients with similar social relationship based on inter-IP connectivity structure. The key idea of this methodology is to split the entire IP address space into Internal (inside the managed domain) and External (outside) ones. The clustering strategy is to group inside IP addresses that communicate with common outside IP addresses, the similarity measure of two inside IP addresses is the unique number of the common outside IP addresses. We propose a novel approach with an approximation algorithm to discover communities on a large scale in the managed domain based on the bipartite networks and one mode projection and the basis of graph partitioning of the similarity graph. Bipartite networks were built using NetFlow datasets collected from a boundary router in an actual environment, and then a one-mode projection has been applied to build a social relationship similarity graph of the inside IP addresses. We propose a community detection algorithm to extract communities. Experimental results demonstrate that our approach can discover communities from real large scale managed domain networks with a high quality. We experimentally validate our approach in terms of IP networking by applying deep flow inspection (DFI) and deep packet inspection (DPI) on related traffic to prove that hosts with the same cluster tend to have some dominant network behavior. We demonstrated the practical benefits of exploring social behavior similarity of IP hosts in understanding application usage, users' behavior, detecting malicious users, and users of prohibited applications.

Complex Networks Analysis Based on IP Data of Mobile Communication System

Comprehensive Influence of Topological Location and Neighbor Information on Identifying Influential Nodes in Complex Networks.

A Novel Modeling Method for Analysis of IP Networks

Empirical analysis of Internet telephone network: from user ID to phone.

Community Detection in large-scale IP networks by Observing Traffic at Network Boundary

Complex networks properties analysis for mobile ad hoc networks.

Analysis of Human Interactive Behavior Based on Phone Communication Networks

Social Relationship Discovery of IP Addresses in the Managed IP Networks by Observing Traffic at Network Boundary

Community detection based on similarities of communication behavior in IP networks

Analysis on Evolution and Topological Features of a Real Mobile Social Network

Node Importance Ranking of Complex Network based on Degree and Network Density

Complex Network Theoretical Analysis on Information Dissemination over Vehicular Networks.

Complex Weighted Networks-Based Analysis of Mobile Collaboration Space

Community-Detection Method of Complex Network Based on Node Influence Analysis

Inferring properties and revealing geographical impacts of intercity mobile communication network of China using a subnet data set

The structure analysis of user behaviors for web traffic

Statistical Properties Analysis of Internet Traffic Dispersion Networks

Empirical study of complex network characteristic of intelligent optical network

Chinese IP-level Network Topology Measurement and Analysis

Social network topology model based on random walk and common points

Analysis to reveal evolution and topological features of a real mobile social network