Abstract:Network performance aware optimizations have long been a hot research topic to optimize distributed applications on traditional network environments. However, those optimization techniques rely on a few measurements on pair-wise network performance, and such direct use of network measurements is no longer valid on Infrastructure-as-a-service (IaaS) clouds. First, the direct calibration is ineffective. Network performance measurements may not represent the long-term performance (informally the stable component inside network performance) because of virtualization and network performance interference in the cloud. Second, the direct calibration is inefficient because the measurement overhead of all pair-wise link performance in a cluster becomes prohibitively high as the number of instances increases. To effectively and efficiently utilize existing network performance aware optimizations on IaaS clouds, we propose to reduce the measurement overhead and decouple the constant component from the dynamic network performance while minimizing the difference between the network performance and the constant component. For effectiveness, we use the constant component to guide the network performance aware optimizations. For efficiency, we exploit a non-negative matrix factorization (NMF) method to reduce the calibration overhead. Furthermore, we observe a tradeoff between effectiveness and efficiency, and develop an adaptive approach to capture this tradeoff. We demonstrate effectiveness and efficiency of our approach by adopting network performance aware optimizations on two kinds of basic applications, collective communications of MPI and generic topology mapping, and two real-world applications, namely N-body and conjugate gradient (CG). Our experiments on Amazon EC2 and simulations demonstrate significant calibration overhead reduction and performance improvement on guiding network performance aware optimizations, when comparing our approach to other state-of-the-art approaches.

Iphicles: Tuning Parameters of Data Center Networks with Differentiable Performance Model

Performance Tuning via Lean Measurements for Acceleration of Network Functions Virtualization

Hybrid Performance Modeling And Analyzing Of Parallel Systems

Network Performance Aware Optimizations on Iaas Clouds

Cost-effective Service Deployment and Balanced Traffic Management on Edge

Heuristic-based Optimization Framework for Customizable Design of Long-Haul Data Center Interconnect Networks

Adaptive Partitioning and Efficient Scheduling for Distributed DNN Training in Heterogeneous IoT Environment

NegotiaToR: Towards A Simple Yet Effective On-demand Reconfigurable Datacenter Network

Finding Constant From Change: Revisiting Network Performance Aware Optimizations On Iaas Clouds

Optimal Rate and Aggregate Bandwidth Allocation under Service Performance Requirements in Data Center Backbone Networks

Performance Impact Inference with Failures in Data Center Networks

Orchestrating Multicast-Oriented Nfv Trees In Inter-Dc Elastic Optical Networks

Xnet: Modeling Network Performance with Graph Neural Networks

Digital Twin for Networking: A Data-driven Performance Modeling Perspective

Computation-power Coupled Modeling for IDCs and Collaborative Optimization in ADNs

Online Optimization of DNN Inference Network Utility in Collaborative Edge Computing

DCMPTCP: Host-Based Load Balancing for Datacenters

When CPN Meets AI: Resource Provisioning for Inference Query Upon Computing Power Network

Intelligent load balancing in data center software‐defined networks

Do Data Center Network Metrics Predict Application-Facing Performance?

Hybrid Model-Data Driven Network Slice Reconfiguration by Exploiting Prediction Interval and Robust Optimization