Abstract:As the paradigm of cloud computing, a datacenter accommodates many co-running applications sharing system resources. Although highly concurrent applications improve resource utilization, the resulting resource contention can increase the uncertainty of quality of services (QoS). Previous studies have shown that achieving high resource utilization and high QoS simultaneously is challenging. Moreover, quantifying the intensity of interference across multiple concurrent applications in a datacenter, where applications can be either latency-critical (LC) or best-effort (BE), poses a significant challenge. To address these issues, we propose Ah-Q, which comprises two theorems, a metric, and a scheduling strategy. First, we present the necessary and sufficient conditions to precisely test whether a datacenter is both QoS guaranteed and high-throughput. We also present a theorem that reveals the relationship between tail latency and throughput. Our theoretical results are insightful and useful for building datacenters that have desirable performance. Second, we propose the "System Entropy" (E S) to quantitatively measure the interference within a datacenter. Interference arises due to resource scarcity or irrational scheduling, and effective scheduling can alleviate resource scarcity. To assess the effectiveness of a resource scheduling strategy, we introduce the concept of "resource equivalence". We evaluate various resource scheduling strategies to demonstrate the correctness and effectiveness of the proposed theory. Third, we introduce a new resource scheduling strategy, ARQ, that leverages both isolation and sharing of resources. Our evaluations show that ARQ significantly outperforms state-of-the-art strategies PARTIES and CLITE in reducing the tail latency of LC applications and increasing the IPC of BE applications.

Providing Bandwidth Guarantees, Work Conservation and Low Latency Simultaneously in the Cloud

Achieving bandwidth guarantees in multi-tenant cloud networks using a dual-hose model

Enabling Work-Conserving Bandwidth Guarantees for Multi-Tenant Datacenters Via Dynamic Tenant-Queue Binding

Towards bandwidth guarantee in multi-tenancy cloud computing networks

Guaranteeing Heterogeneous Bandwidth Demand in Multitenant Data Center Networks

Towards predictable performance via two-layer bandwidth allocation in cloud datacenter.

SpongeNet+: A Two-Layer Bandwidth Allocation Framework for Cloud Datacenter.

ProNet: Network-level Bandwidth Sharing among Tenants in Cloud

Adaptive Data Transmission in the Cloud.

Multi-tenant Multi-Objective Bandwidth Allocation in Datacenters Using Stacked Congestion Control

Towards Power Consumption-Delay Tradeoff by Workload Allocation in Cloud-Fog Computing.

Triton: A Flexible Hardware Offloading Architecture for Accelerating Apsara Vswitch in Alibaba Cloud

A Case for Pricing Bandwidth: Sharing Datacenter Networks With Cost Dominant Fairness

Multitenancy for Fast and Programmable Networks in the Cloud.

SpongeNet: Towards Bandwidth Guarantees of Cloud Datacenter with Two-Phase VM Placement

Suppressing the Interference Within a Datacenter: Theorems, Metric and Strategy

Higher bandwidth may sometimes reduce cloud application performance

Joint Virtual Middlebox and Application Placement with Bandwidth Guarantees in Multi-Tenant Datacenter

Eba: Efficient Bandwidth Guarantee under Traffic Variability in Datacenters

On Efficient Bandwidth Allocation for Traffic Variability in Datacenters

Maximizing the Bandwidth Multiplier Effect for Hybrid Cloud-P2p Content Distribution