Capture Method and Self-Similarity Assess of BitTorrent Traffic

LIU Gang,FANG Bin-xing,HU Ming-zeng,ZHANG Hong-li

DOI: https://doi.org/10.3969/j.issn.1001-3695.2006.05.073

2006-01-01

Abstract:The paper studies the capture method of BitTorrent traffic,designs and implements a real project according to the method,presents a quantitative result of the self-similarity parameter supporting modeling of self-similarity.

What problem does this paper attempt to address?

Modeling and Analysis of Upload Utilization in BitTorrent System

J.W. Zhang,Y.C. Wang,W. Xing,D.M. Lu

DOI: https://doi.org/10.4028/www.scientific.net/aef.1.230

2011-01-01

Advanced Engineering Forum

Abstract:Upload utilization is one of the most significant performance metrics in BitTorrent system, whereas there has been no accurate model which is suitable for it yet. For this reason, the delicate relation between some key parameters (maximum concurrent uploads, upload bandwidth, TFT round etc.) in BitTorrent is investigated, furthermore the piece diffusion model and the upload utilization model are proposed. Based on these models, we explore the effect of TFT round for the first time and find that the magnitude of TFT round has a significant influence on the transient stage as well as the end stage. Additionally, we show that when the seed’s upload bandwidth is fully utilized, to achieve optimal performance, each peer’s upload bandwidth should be proportional to its maximum concurrent uploads, and the file size should be large enough compared with the swarm size.
Modeling and Simulation of Self-Similar Traffic Based on FBM Model

卢颖,裴承艳,陈子辰,康凤举

DOI: https://doi.org/10.3969/j.issn.1674-6236.2011.17.039

2011-01-01

Abstract:Network traffic models are important basis of network programming and performance evaluation. The conventional models are mostly based on Poisson model and Markovian franc model,which is only Short-Range Dependence. With the continuous development of network services, studies found that the actual network traffic has a long-range dependence （LRD） now and in a very long time , which is a kind of self-similarity. In this paper, the RMD and Fourier algorithm were adopted to simulate and analyze FBM model, a self-similar model. They generated the necessary sequence of self-similar traffic. Then the article uses R/S method and variance-time method to verify Hurst value of the generated sequence of self-similar traffic in order to verify the self-similarity of the self-similar traffic sequence. The existence of self-similarity is verified by experiments, and the advantage and disadvantage of RMD and Fourier algorithm are analyzed.
Traffic Measurements of BitTorrent System Based on Netfilter

Liu Bin,Li Zhitang,Li Zhanchun

DOI: https://doi.org/10.1109/iccias.2006.295304

2006-01-01

Abstract:BitTorrent as a kind of P2P application for file-sharing has become tremendously popular over the last few years, now accounting for a significant share of the total network traffic. BitTorrent protocols used arbitrary ports to camouflage its traffic to avoid detection and recognition with standard measurement tools. Some new methods using application layer signature have good accuracy identification. However, these approaches would not be suitable for real-time measurement because of the high overhead. To overcome this problem, we present a measurement system which reliably detects and measures BitTorrent traffic in real-time in this paper. The measurement methodology is based on using application level signatures implemented by Netfilter extension as well as packet classifier. The results from test in a large university network indicate that this approach not only can significantly improve the BitTorrent traffic volume estimates over what pure network port based approaches provide, but also provided the performance required for practical applications
Region Tracker: An Effective Way to Localize Bittorrent Traffic

Chen Gong,Wu U. Chunming,Jiang Ming

DOI: https://doi.org/10.1109/WICOM.2010.5601267

2010-01-01

Abstract:Region tracker system can localize the Bittorrent traffic and accelerate user download speed by merging swarms. This paper proposes a concept of private domain name, which makes region tracker system transparent to users and easy to deploy. To reduce the traffic, previous researches focus on how to modify the chossing peer algorithm of a Bittorrent client. However, other peers visible to a Bittorrent client only account for a random portion, causing the previous algorithm to be extremely unstable. In this paper, we design a swarm auto-merging algotithm based on tracker to help user find seeds and significantly increase download speed automatically. Simulation results show that the proposed algorithm localize the tracffic efficiently and improve user download speed.
A Methodology Based on Netfilter for BitTorrent Traffic Measurement

LIU Bin,LI Zhi-Tang,LI Zhan-Chun,ZHOU Li-Juan

DOI: https://doi.org/10.3969/j.issn.1002-137X.2007.04.008

2007-01-01

Computer Science

Abstract:BitTorrent as a kind of P2P application for file-sharing is growing dramatically in recent years. BitTorrent application used dynamic port to camouflage its traffic, so it become more difficult to measure BitTorrent traffic. In this paper, a measurement approach based on application level signatures, which reliably detects and measures BitTorrent traffic is described. A presentation of the results from a successful field test in a large university network indicated that this approach is not only accurate, but also provided the performance and scalability required for practical applications.
Tracker algorithm based on upload capacity in BitTorrent network

Jianwei Zhang,Wei Xing,Dongming Lu

DOI: https://doi.org/10.1109/CSSS.2011.5974384

2011-01-01

Abstract:BitTorrent has proved to be the most effective and popular P2P file distribution application. In order to improve the topological features and take full advantage of each peer's upload capacity in BitTorrent overlay, the disadvantages of topological features and the utilization of each peer's upload capacity in BitTorrent overlay was analyzed and UC-track, a tracker algorithm based on upload capacity, was proposed. UC-track algorithm sends neighbor list to peer that contains certain percentage of peers with similar upload capacity. When a peer is connected with other peers, it drops the connection with a peer that differs greatly in upload capacity and accepts a new connection. Simulations show that, compared with default algorithm using random selection strategy, UC-track algorithm optimizes the topological features of the BitTorrent overlay and improves the efficiency of data transmission in BitTorrent system. © 2011 IEEE.
Measuring and Modeling Message-Level Characteristics of BitTorrent

Feng Liu,Zhitang Li,Lihui Huang

DOI: https://doi.org/10.1109/nswctc.2009.214

2009-01-01

Abstract:BitTorrent(BT) applications are very popular on the Internet. Measuring the impact it has on the network and understanding their behavior is an important field. From the perspective of network management, a thorough understanding of the stochastic properties of BT traffic is thus crucial to designing better traffic and resource control algorithms. However, previous works on measuring and analyzing BT application mostly focus on both data and message traffic. In order to gain insights into BT systems especially the message characteristics, we have undertaken an in-depth measurement and modeling study of BT message. Our results show that the Message model can well describe the BT incentive mechanism and the statistics collected on different files can fit equally well into distributions.
Traffic Measurement Between Peers in BitTorrent-like Networks

Hong Tang,Hu Wei,Guofeng Zhao,Yu Yan,Chao Xing

DOI: https://doi.org/10.1109/nces.2012.6543888

2012-01-01

Abstract:Our understanding for the traffic behaviors on P2P networks is, unfortunately, still incomplete in the sense that the current studies on traffic measurement primarily focus on the traffic in large, and insufficient efforts have been devoted to the investigation of the inter-peer traffic. Toward resolving this issue, we in this paper propose and implement a method for measuring the traffic between any individual peers. Through deploying this measurement method on the PlanetLab platform, traffic data are collected and analyzed in the following aspects: data correctness, Poisson property, traffic self-similarity of individual peers, and traffic self-similarity of the BT system. Results of these analyses suggest that the proposed method is feasible, effective, and can be extended to larger networks.
A Design and Implementation of P2p Network Traffic Identification System

Xiaoyu Ma,Feiyan Chen

DOI: https://doi.org/10.4028/www.scientific.net/amr.433-440.5193

2012-01-01

Advanced Materials Research

Abstract:The P2P streaming media technology is popular and promising in recent years, to ensure the correctness of the identification method, and improve the identification rate and accuracy of the network traffic, this paper proposes a identification principle and algorithm of the P2P network traffic, and gives the overall structure of the system, Finally, puts up the system test environment. The experimental results show that the identification method of the network traffic proposed in this paper can effectively improve the identification rate and accuracy of the network traffic, the scheme has the value of further research and promotion.
Measurements, analysis, and modeling of BitTorrent-like systems

Lei Guo,Songqing Chen,Zhen Xiao,Enhua Tan,Xiaoning Ding,Xiaodong Zhang

DOI: https://doi.org/10.1145/1330107.1330113

2005-01-01

Abstract:Existing studies on BitTorrent systems are single-torrent based, while more than 85% of all peers participate in multiple torrents according to our trace analysis. In addition, these studies are not sufficiently insightful and accurate even for single-torrent models, due to some unrealistic assumptions. Our analysis of representative Bit-Torrent traffic provides several new findings regarding the limitations of BitTorrent systems: (1) Due to the exponentially decreasing peer arrival rate in reality, service availability in such systems becomes poor quickly, after which it is difficult for the file to be located and downloaded. (2) Client performance in the BitTorrent-like systems is unstable, and fluctuates widely with the peer population. (3) Existing systems could provide unfair services to peers, where peers with high downloading speed tend to download more and upload less. In this paper, we study these limitations on torrent evolution in realistic environments. Motivated by the analysis and modeling results, we further build a graph based multi-torrent model to study inter-torrent collaboration. Our model quantitatively provides strong motivation for inter-torrent collaboration instead of directly stimulating seeds to stay longer. We also discuss a system design to show the feasibility of multi-torrent collaboration.
Active Measurement on Bittorrent Protocol

HUANG Li-Hui,LI Zhi-Tang,LIU Bin

2008-01-01

Periodical of Ocean University of China

Abstract:With increasingly attention to P2P,more and more researches have been launched into the flow characteristics of P2P.The traditional researches on the network always focus on analyzing network flow captured at intercepted export.But these methods are kind of passive way,not only can not find out the internal characteristics of P2P application,but also unable to explain some of the flow characteristics.By running a typical P2P application-a BitTorrent client in the actual network,we can approach the statistical information on the transceiver initiatively,observe and collect the internal characteristics of the client.According to these statistics,we summed up the characteristics of BT in the practical application,analyzed the strategy used by the agreement.And we also analyzed the characteristics which turned out when measuring passively.
Analyzing BitTorrent Traf?c Across Large Network

Jiayin Qi,Hongli Zhang,Zhenzhou Ji,Liu Yun

DOI: https://doi.org/10.1109/cw.2008.150

2008-01-01

Abstract:The use of peer-to-peer (P2P) applications is growing dramatically, particularly for BitTorrent system. In order to gain insights into BitTorrent systems and the network traffic load they place on ISPs, we have undertaken an measurement study. Our experimental evaluation is ISP oriented instead of peer oriented, which enables us to study the global characteristics of BitTorrent system. We have developed a dedicated BitTorrent sniffer platform to collected extensive packet across a large ISP network. The measurement results bring important insights into BitTorrent systems. Specifically,our results show that 1) BitTorrent flashcrowd appears around midnight due to the BitTorrent users habits of behavior; 2) workload generated by BitTorrent extention - DHT is much more than it generated by calssic BitTorrent; 3) overhead rather than data transfer is the dominant component of the totle BitTorrent traffic due to DHT; 4) Zipf and pareto are the suitable model to characterize the distribution of visits to both trackers and BitTorrent Websites.Insights obtained in this study will be valuable for the management and development of future P2P file transform systems.
The Study of Algorithms Generating Self-similar Traffic

LIANG ZHITAO,HE HUI,LI BIN

DOI: https://doi.org/10.3969/j.issn.1008-0570.2008.06.086

2008-01-01

Abstract:The Study of large-scale integrating network traffic plays a very important role in both improving the performance and enhancing the ability against intrusion. Network simulation is the most useful way of studying network under the large-scale condition. So it is important to generate network traffic correctly. Recent network traffic studies demonstrate that network traffic is self-similar. But there is no simple tool for generating self-similar traffic. This paper compares several math methods generating self-similar traffic,and concludes that Fast Fourier Transform is the best after the experiment comparison. Finally we implement a self-similar traffic generator in NS2.
Proposition And Provement Of A Tcp Feature Of P2p Traffic - An Example Of Bittorrent And Emule

Li-Juan Zhou,Zhi-Tang Li,Tu Hao

DOI: https://doi.org/10.1109/CHINACOM.2007.4469328

2007-01-01

Abstract:Over the last years, the large number of filesharing applications has resulted in a significant increase of P2P traffic. The P2P (Peer-to-Peer) technology is characterized by no utilization of any servers with centralized functions and the presence of many hosts acting both as servers and clients. The wide use of the P2P application has lead to the rapid growth of network traffic. Thus, the accurate classification of P2P traffic becomes a challenging problem,and becomes even more challenging. This paper proposes some new essential characteristics of TCP traffic to achieve its discrimination. To prove the universality of the values of our proposed features, we also present some analytic estimates of them using Pareto as the distribution of user lifetime in real P2P systems. Finally, we apply SVM (Support-Vector-Machine) to the discrimination of these features in order to automate the processing of the discrimination, and its accuracy is demonstrated as a result of some experiments.
Combining sFlow and Tracker traffic analysis: A novel estimation approach for network-wide BitTorrent distribution.

Wei Ye,Xuan Luo,Rui Xie,Haibin Zhang,Kaida Jiang,Yaohui Jin

DOI: https://doi.org/10.1109/APNOMS.2011.6076985

2011-01-01

Abstract:BitTorrent(BT) has emerged as one of the most popular protocols for content sharing in recent years. Most BT applications are network-oblivious which brings great challenges to traffic engineering. As basic input information, network-wide BT traffic distribution is of vital importance for service providers (SP) or carriers to enforce appropriate control policies. Direct online measurement of network-wide BT traffic faces scalability issue, for it requires deploying application identification deep packet inspection (DPI) device on every subject link. In this paper, we propose a novel approach to estimate network-wide BT traffic distribution through combining sFlow and Tracker traffic analysis. Owing to a noticeable increase of BT traffic using random port numbers, sFlow alone is no longer sufficient for BT recognition. We tackle this problem by combining sFlow with information collected from BT tracker's traffic. With assistance of this information, BT samples can be accurately distinguished from other sFlow samples. The efficacy of our approach is evaluated through experiments on backbone links of campus network. Evaluation results show that our approach can reach a high accuracy in network-wide BT traffic estimation. © 2011 IEEE.
Modeling Self-Similar Traffic for Network Simulation

Xiaofeng Bai,Abdallah Shami

DOI: https://doi.org/10.48550/arXiv.1308.3842

2013-08-18

Abstract:In order to closely simulate the real network scenario thereby verify the effectiveness of protocol designs, it is necessary to model the traffic flows carried over realistic networks. Extensive studies [1] showed that the actual traffic in access and local area networks (e.g., those generated by ftp and video streams) exhibits the property of self-similarity and long-range dependency (LRD) [2]. In this appendix we briefly introduce the property of self-similarity and suggest a practical approach for modeling self-similar traces with specified traffic intensity.

Networking and Internet Architecture
On Study and Implementation of Self-Similar Network Traffic

SHI Jiang-tao,WANG Yong-gang,DAI Xue-long,YAN Tian-xin

DOI: https://doi.org/10.3321/j.issn:1000-436x.2005.06.019

2005-01-01

Abstract:To evaluate accurately the performance of the network switching equipment and the scheduling algorithm, it was very important to use a simulated network traffic which represents the major characteristics of real network. The study and analysis on the network traffic in recent years showed the traffic distribution was long-rang-dependent and self-similar, not Poisson process. Combining the modern statistical result on network traffic with the existing traffic models, a practical traffic model was constructed. Based on Pareto distribution and truncated power-tail distribution the model presents nice self-similar property in macro-scale. A practical network traffic generating system is built for evaluating the performance of switch fabric and its scheduling algorithm.
Traffic analyzer for differentiating BitTorrent handshake failures from port-scans

Kamran Khan,Affan Syed,Ali Khayam

DOI: https://doi.org/10.48550/arXiv.1309.0276

2013-09-03

Abstract:This paper aims to improve the accuracy of port-scan detectors by analyzing traffic of BitTorrent hosts and differentiating their respective BitTorrent connection (attempts) from port-scans. It is shown that by looking at BitTorrent coordination traffic and modelling port-scanning behavior the number of BitTorrent-related false positives can be reduced by 80% without any loss of IDS accuracy.

Networking and Internet Architecture
A performance study of BitTorrent-like peer-to-peer systems

Lei Guo,Songqing Chen,Zhen Xiao,Enhua Tan,Xiaoning Ding,Xiaodong Zhang

DOI: https://doi.org/10.1109/JSAC.2007.070116

IF: 16.4

2007-01-01

IEEE Journal on Selected Areas in Communications

Abstract:This paper presents a performance study of BitTorrent-like P2P systems by modeling, based on extensive measurements and trace analysis. Existing studies on BitTorrent systems are single-torrent based and usually assume the process of request arrivals to a torrent is Poisson-like. However, in reality, most BitTorrent peers participate in multiple torrents and file popularity changes over time. Our study of representative BitTorrent traffic provides insights into the evolution of single-torrent systems and several new findings regarding the limitations of BitTorrent systems: (1) Due to the exponentially decreasing peer arrival rate in a torrent, the service availability of the corresponding file becomes poor quickly, and eventually it is hard to locate and download this file. (2) Client performance in the BitTorrent-like system is unstable, and fluctuates significantly with the changes of the number of online peers. (3) Existing systems could provide unfair services to peers, where a peer with a higher downloading speed tends to download more and upload less. Motivated by the analysis and modeling results, we have further proposed a graph based model to study interactions among multiple torrents. Our model quantitatively demonstrates that inter-torrent collaboration is much more effective than stimulating seeds to serve longer for addressing the service unavailability in BitTorrent systems. An architecture for inter-torrent collaboration under an exchange based instant incentive mechanism is also discussed and evaluated by simulations
Self-Similar Traffic Originating in the Transport Layer

Kensuke Fukuda,Misako Takayasu,Hideki Takayasu

DOI: https://doi.org/10.48550/arXiv.cond-mat/0012487

2000-12-28

Abstract:We performed a network traffic simulation to clarify the mechanism producing self-similar traffic originating in the transport layer level. Self-similar behavior could be observed without assuming a long-tailed distribution of the input file size. By repeating simulations with modified TCP we found that the feedback mechanism from the network, such as packet transmission driven by acknowledgement packets, plays an essential role in explaining the self-similarity observed in the actual traffic.

Statistical Mechanics

Capture Method and Self-Similarity Assess of BitTorrent Traffic

Modeling and Analysis of Upload Utilization in BitTorrent System

Modeling and Simulation of Self-Similar Traffic Based on FBM Model

Traffic Measurements of BitTorrent System Based on Netfilter

Region Tracker: An Effective Way to Localize Bittorrent Traffic

A Methodology Based on Netfilter for BitTorrent Traffic Measurement

Tracker algorithm based on upload capacity in BitTorrent network

Measuring and Modeling Message-Level Characteristics of BitTorrent

Traffic Measurement Between Peers in BitTorrent-like Networks

A Design and Implementation of P2p Network Traffic Identification System

Measurements, analysis, and modeling of BitTorrent-like systems

Active Measurement on Bittorrent Protocol

Analyzing BitTorrent Traf?c Across Large Network

The Study of Algorithms Generating Self-similar Traffic

Proposition And Provement Of A Tcp Feature Of P2p Traffic - An Example Of Bittorrent And Emule

Combining sFlow and Tracker traffic analysis: A novel estimation approach for network-wide BitTorrent distribution.

Modeling Self-Similar Traffic for Network Simulation

On Study and Implementation of Self-Similar Network Traffic

Traffic analyzer for differentiating BitTorrent handshake failures from port-scans

A performance study of BitTorrent-like peer-to-peer systems

Self-Similar Traffic Originating in the Transport Layer