Abstract:Network performance aware optimizations have long been a hot research topic to optimize distributed applications on traditional network environments. However, those optimization techniques rely on a few measurements on pair-wise network performance, and such direct use of network measurements is no longer valid on Infrastructure-as-a-service (IaaS) clouds. First, the direct calibration is ineffective. Network performance measurements may not represent the long-term performance (informally the stable component inside network performance) because of virtualization and network performance interference in the cloud. Second, the direct calibration is inefficient because the measurement overhead of all pair-wise link performance in a cluster becomes prohibitively high as the number of instances increases. To effectively and efficiently utilize existing network performance aware optimizations on IaaS clouds, we propose to reduce the measurement overhead and decouple the constant component from the dynamic network performance while minimizing the difference between the network performance and the constant component. For effectiveness, we use the constant component to guide the network performance aware optimizations. For efficiency, we exploit a non-negative matrix factorization (NMF) method to reduce the calibration overhead. Furthermore, we observe a tradeoff between effectiveness and efficiency, and develop an adaptive approach to capture this tradeoff. We demonstrate effectiveness and efficiency of our approach by adopting network performance aware optimizations on two kinds of basic applications, collective communications of MPI and generic topology mapping, and two real-world applications, namely N-body and conjugate gradient (CG). Our experiments on Amazon EC2 and simulations demonstrate significant calibration overhead reduction and performance improvement on guiding network performance aware optimizations, when comparing our approach to other state-of-the-art approaches.

Enabling Performance Intelligence for Application Adaptation in the Future Internet.

Performance Tuning via Lean Measurements for Acceleration of Network Functions Virtualization

Time-sharing Parallel Applications Through Performance-Targeted Feedback-Controlled Real-Time Scheduling.

Network Performance Aware Optimizations on Iaas Clouds

Research on Adaptive Future Internet Architecture

An Edge Computing Architecture for Internet Measurement Network to Measure and Analyze Protocol Data

A High-Speed Real-Time HTTP Performance Measurement Architecture Based on Network Processor

Time-Division Based Integrated Sensing, Communication, and Computing in Integrated Satellite-Terrestrial Networks

IFCIoT: Integrated Fog Cloud IoT Architectural Paradigm for Future Internet of Things

DiffPerf: Towards Performance Differentiation and Optimization with SDN Implementation

Measurement-Driven Design and Runtime Optimization in Edge Computing: Methodology and Tools

IO and data management for infrastructure as a service FPGA accelerators

In-Network Compute Extensions for Rate-Adaptive Content Delivery in Mobile Networks

Adaptive Data Transmission in the Cloud.

A reconfigurable fabric for accelerating large-scale datacenter services

Scalable Application-Specific Measurement Framework for High Performance Network Video

Finding Constant From Change: Revisiting Network Performance Aware Optimizations On Iaas Clouds

A Performance Measurement and Analysis Method for Software-Defined Networking of IoV

The Future Internet: Towards Convergence of Cognition, Cooperation, Cross-layer, Virtualization and Cloud-computing

A Survey on Architectures, Hardware Acceleration and Challenges for In-Network Computing

Smart and Adaptive Architecture for a Dedicated Internet of Things Network Comprised of Diverse Entities: A Proposal and Evaluation