Abstract:Flow-level traffic measurement is important for network traffic accounting, traffic engineering, and network security. However, flow-level measurement in high speed networks poses great challenges due to the requirements of high packet processing speed and large memory size (high time/space complexity). To reduce these demanding requirements, sampling is usually used and samplers are deployed in the network. But sampling incurs information loss. To address this issue, this paper studies the tradeoff between sampling loss and complexity in distributed sampling system. We formulate the distributed sampling problem as a constrained optimization problem; specifically, maximizing the measurement coverage (i.e., the percentage of sampled traffic among the total traffic) and minimizing the complexity/budget. Considering the stochastic nature of traffic flows, we further formulate the optimization problem under two stochastic criteria: Stochastic Expected Value Optimization criterion (which is concerned with average performance) and Stochastic Chance Constrained Optimization criterion (which is concerned with the distribution of performance measure). Then we propose a Hybrid Intelligent algorithm to decide the optimal deployment strategy for monitors' placement and the sampling rate at each monitor. Equipped with the proposed algorithm, we are able to address the optimal tradeoff between measurement coverage and deployment cost for networks with random traffic, which has not been studied before. The extensive simulations and experiments demonstrate the effectiveness of our models and algorithm: with careful deployment, monitoring over a small fraction of nodes in a high speed network is sufficient to maintain a high level of measurement coverage.

Accelerated Sampling Research under Task Optimized Strategy for Multistate Systems

An Accelerated Simulation Approach for Multistate System Mission Reliability and Success Probability under Complex Mission

Application of State-Space Partitioning Method in Power System Reliability Assessment

Task Strategy Optimization for Multi-State System Based on Virtual Ship

Dynamic Sampling Allocation under Finite Simulation Budget for Feasibility Determination

Accelerated State Evaluation and Latin Hypercube Sequential Sampling for Composite System Reliability Assessment

Optimization of Multilevel Inspection Strategy for Nonrepairable Multistate Systems

Multi-fidelity Sampling for Efficient Simulation-Based Decision Making in Manufacturing Management

Adaptive Sequential Importance Sampling Technique for Short-Term Composite Power System Adequacy Evaluation

Short-term Reliability Evaluation Using Control Variable Based Dagger Sampling Method

A New Method for the Fast Simulation of Models of Highly Dependable Markov System

Bayesian Annealed Sequential Importance Sampling: An Unbiased Version of Transitional Markov Chain Monte Carlo

A Multi-Constraint Failure-Pursuing Sampling Method for Reliability-Based Design Optimization Using Adaptive Kriging

Integrated Selective Maintenance and Task Assignment Optimization for Multi-State Systems Executing Multiple Missions

Research on improving parallel sequence sampling method in ship type optimization

Digital Twin Enabled Task Scheduling for State Monitoring in Aircraft Testing Process

A sequential sampling strategy to improve the global fidelity of metamodels in multi-level system design

Stochastic Optimization of Distributed Sampling System Placement for Passive Measurement

A Cross-Entropy-Based Three-Stage Sequential Importance Sampling for Composite Power System Short-Term Reliability Evaluation

Failure Probability Estimation for Black-Box Autonomous Systems using State-Dependent Importance Sampling Proposals

Mission risk control via joint optimization of sampling and abort decisions