Abstract:As applications become more distributed to improve user experience and offer higher availability, businesses rely on geographically dispersed datacenters that host such applications more than ever. Dedicated inter-datacenter networks have been built that provide high visibility into the network status and flexible control over traffic forwarding to offer quality communication across the instances of applications hosted on many datacenters. These networks are relatively small, with tens to hundreds of nodes and are managed by the same organization that operates the datacenters which make centralized traffic engineering feasible. Using coordinated data transmission from the services and routing over the inter-datacenter network, one can optimize the network performance according to a variety of utility functions that take into account data transfer deadlines, network capacity consumption, and transfer completion times. In this dissertation, we study techniques and algorithms for fast and efficient data transfers across geographically dispersed datacenters over the inter-datacenter networks. We discuss different forms and properties of inter-datacenter transfers and present a generalized optimization framework to maximize an operator selected utility function. Next, in the several chapters that follow, we study, in detail, the problems of admission control for transfers with deadlines and inter-datacenter multicast transfers. For the admission control problem, our solutions offer significant speed up in the admission control process while offering almost identical performance in the total traffic admitted into the network. For the bulk multicasting problem, our techniques enable significant performance gain in receiver completion times with low computational complexity, which makes them highly applicable to inter-datacenter networks.

Inter-Datacenter Bulk Transfers: Trends and Challenges

On Efficient Data Transfers Across Geographically Dispersed Datacenters

Bulk Savings for Bulk Transfers: Minimizing the Energy-Cost for Geo-Distributed Data Centers

Efficient Inter-Datacenter Bulk Transfers with Mixed Completion Time Objectives

Cost-Efficient Scheduling of Bulk Transfers in Inter-Datacenter WANs

Optimizing Bulk Transfers with Software-Defined Optical WAN

A Survey on Resource Scheduling for Data Transfers in Inter-Datacenter WANs

Deadline-Aware Fast One-to-Many Bulk Transfers over Inter-Datacenter Networks

Mitigating Routing Inefficiencies to Cloud-Storage Providers: A Case Study.

Congestion Control Mechanisms for Inter-Datacenter Networks

Survey on transport control in data center networks.

BDS+: an Inter-Datacenter Data Replication System with Dynamic Bandwidth Separation

Rethinking Transfer Optimization in a Datacenter: Integrating Load Balancing with Multipath Flow Control.

Large-Scale Deterministic Networks: Architecture, Enabling Technologies, Case Study and Future Directions

Reconfigurable Bandwidth Service Based on Optical Network State for Inter-Data Center Communication

Integration Of Data Center Into The Distributed Satellite Cluster Networks: Challenges, Techniques, And Trends

Highly Efficient Data Migration and Backup for Big Data Applications in Elastic Optical Inter-Data-center Networks

Efficient Multisource Data Delivery in Edge Cloud With Rateless Parallel Push

Scalability and Bandwidth Optimization for Data Center Networks

Demystifying the Performance of Data Transfers in High-Performance Research Networks

BigData Express: Toward Schedulable, Predictable, and High-Performance Data Transfer