Topology-aware Virtual Machine Placement in Optical Switching Based Small-world Datacenter Networks

Tong Chang,Cen Wang,Yinan Tang,Hongxiang Guo,Jian Wu

DOI: https://doi.org/10.1364/acpc.2017.m1c.2

2017-01-01

Abstract:This paper proposed a heuristic topology-aware virtual machine placement algorithm for optical small-world datacenter networks. Simulation results verify its effectiveness in terms of improving network performance.

What problem does this paper attempt to address?

Experimental Demonstration Of Efficient Topology Reconstruction In Optical Switching Based Data Center Network

Yinan Tang,Hongxiang Guo,Xiang Li,Jian Wu

DOI: https://doi.org/10.1109/icocn.2017.8121472

2017-01-01

Abstract:We review our previously proposed topology reconstruction mechanism in the small world topology based optical data center network (DCN). We also present some recent experimental demonstration results, which verified that the topology reconstruction can reduce the number of hotspots and thus further accelerate data analysis jobs in DCN.
Virtual Topology Design in IP/WDM Networks

Yi-ning CAO,Xiao-ping ZHENG,Yan-he LI,Han-yi ZHANG

DOI: https://doi.org/10.3969/j.issn.1000-3428.2010.05.002

2010-01-01

Abstract:A short-light path preferred establishment mechanism is proposed to solve the virtual topology design problem in IP/WDM networks.The proposed mechanism limits the hop counts of the light path in optical layer to avoid overuse of bandwidth by the long-light path,and establishes more light paths with small hops.Simulation results show that the designed virtual topology with this mechanism effectively reduces network blocking probability and increases the traffic grooming efficiency in a large scale of traffic loads.
Soft-Computing-Based Virtual Topology Design Methods in IP/DWDM Optical Internet

Xingwei Wang,Minghua Chen,Min Huang,Wendong Xiao

DOI: https://doi.org/10.1007/978-3-540-30501-9_92

2004-01-01

Abstract:Virtual topology design is considered to be one of the key problems in the IP/DWDM optical Internet. Due to its NP-hard nature, with the objective of minimizing the sum of traffic-weighted hop count, two soft-computing-based methods to design the virtual topology are presented, adopting genetic algorithm and simulated annealing algorithm respectively. A simulation environment is developed and performance evaluations have also been done.
Topology-aware virtual network embedding based on closeness centrality

Zihou Wang,Yanni Han,Tao Lin,Yuemei Xu,Song Ci,Hui Tang

DOI: https://doi.org/10.1007/s11704-013-2108-4

IF: 2.6688

2013-01-01

Frontiers of Computer Science

Abstract:Network virtualization aims to provide a way to overcome ossification of the Internet. However, making efficient use of substrate resources requires effective techniques for embedding virtual networks: mapping virtual nodes and virtual edges onto substrate networks. Previous research has presented several heuristic algorithms, which fail to consider that the attributes of the substrate topology and virtual networks affect the embedding process. In this paper, for the first time, we introduce complex network centrality analysis into the virtual network embedding, and propose virtual network embedding algorithms based on closeness centrality. Due to considering of the attributes of nodes and edges in the topology, our studies are more reasonable than existing work. In addition, with the guidance of topology quantitative evaluation, the proposed network embedding approach largely improves the network utilization efficiency and decreases the embedding complexity. We also investigate our algorithms on real network topologies (e.g., AT&T, DFN) and random network topologies. Experimental results demonstrate the usability and capability of the proposed approach.
Virtual topology reconfiguration for wide-area WDM networks

Takagi, H.,Yongbing Zhang,Xiaohua Jia,Takagi, H.

DOI: https://doi.org/10.1109/ICCCAS.2002.1180743

2002-01-01

Abstract:We propose several algorithms that reconfigure virtual topologies in wide area wavelength-routed optical networks. The reconfiguration algorithms attempt to keep the the network availability as much as possible during the reconfiguration process. For this purpose, a lightpath is taken as the minimum unit of reconfiguration, which is an all-optical wavelength-division multiplexed (WDM) channel. The proposed algorithms are evaluated by using an NFSNET-like network model with 16 nodes and 25 links. The results show that very simple algorithms provide very small computational complexity but poor performance, i.e., bad network availability, and that an efficient algorithm provides reasonable computational complexity and very good performance. More complex algorithms may improve performance somewhat further but have unrealistically large computational complexity.
Vtopology: Virtual MAC Address Aided Network Slicing in Multi-Tenant Data Centers

Fekri Saleh,Saleem Karmoshi,Shuangwu Chen,Feng Yang,Jian Yang

DOI: https://doi.org/10.1109/mnet.106.2100617

IF: 10.294

2023-01-01

IEEE Network

Abstract:The shared nature of the network in Multi-Tenant Data Centers (MTDC) implies that network performance for tenants varies significantly. Efficient utilization of limited resources in MTDC is a challenge. Network virtualization is a promising technology for MTDC to provide customized and isolated networks to accommodate various tenants' demands. Driven by the massive increase of data traffic in MTDC, efficient and flexible network virtualization schemes are essential to guarantee seamless network resource sharing and complete isolation. This article presents a novel approach to customizing Virtual Topology (vTopology) for each tenant with self-control capability based on network slicing technology. The key technology behind this, a novel virtual MAC address (vMAC) is used to define network slices and act as a data link layer unique identifier in communications within vTopology virtual switches. Moreover, we propose Optimal Back-Forwarding Path (OBFP) to overcome interconnecting and data forwarding challenges between virtual switch ports allocated on different physical switches. With vTopology, we believe that the customization of virtual networks through network slicing technology enables MTDC operators to create more agile and flexible virtual networks and guarantee isolation and self-control for each tenant.
Study on Topology Reconfiguration of Optical Interconnection Network in Data Center

YANG Wen,GUO Bing-li,YANG Hong-zhen,WANG Yan-bo,FAN Chao,MENG Ling-yu,HUANG Shan-guo

DOI: https://doi.org/10.13756/j.gtxyj.2022.01.003

2022-01-01

Abstract:Aiming at preventing the network performance deterioration caused by fixed link topology connections in optically switched networks, this paper proposes and validates an interconnection and control mechanism that can automatically optimize and reconfigure network topology according to the network traffic volume. This mechanism combines deep reinforcement learning with software defined network technology. Based on the real-time network performance parameters collected by the software-defined network control plane and the performance feedback of the network simulation system, the continuous training of the topology structure can be realized in the model of deep reinforcement learning. The automatic network topology reconfiguration is achieved with improved network performance. The experimental results show that for a given traffic intensity, the model trained by deep reinforcement learning can learn the topology reconstruction strategy and realize automatic selection. The optimal network topology structure can be achieved in one step, with reduced average network delay and average packet loss.
OCBridge: an Efficient Topology Reconfiguration Strategy in Optical Data Center Network

Yinan Tang,Hongxiang Guo,Jian Wu

DOI: https://doi.org/10.1364/ofc.2018.w2a.18

2018-01-01

Abstract:We proposed an algorithm named OCBridge to effectively reconfigure the topology of optical data center network. Simulation results show it can reduce hotspots and achieve better throughput in data center networks compared with relative proposals.
A Heuristic Virtual Topology Design Method in IP/DWDM Optical Internet

X Wang,MH Chen,W Qiang,H Min

DOI: https://doi.org/10.1117/12.574652

2005-01-01

Abstract:IP/DWDM optical Internet is considered to be one of the most potential candidates for NGI (Next Generation Internet) backbone. However, the bottlenecks caused by the electronics still exist. A solution to this problem is to design an optimal virtual topology. In this paper. a novel virtual topology design method is presented. minimizing the sum of traffic-weighted hop count. Based on the given physical topology and the specific traffic matrix, the corresponding virtual topology is designed, and then, over which the traffic is routed. Due to its NP-hard nature, the design problem is decomposed into three subproblems: virtual topology construction, wavelength assignment and traffic routing, which are solved with heuristic algorithms respectively. To verify the feasibility and the effectiveness of the proposed method, a simulation environment is developed and simulation has been done over some actual network topologies. Simulation results have shown that the proposed method is both feasible and effective.
Greenway: Joint Vm Placement and Topology Adaption for Green Data Center Networking

Shenghui Yan,Shihan Xiao,Yuchi Chen,Yong Cui,Jiangchuan Liu

DOI: https://doi.org/10.1109/icccn.2017.8038372

2017-01-01

Abstract:Energy consumption has become a key issue for running large-scale data center networks (DCN) nowadays. Previous studies mainly focus on energy saving through reducing the number of active servers or network switches with traffic consolidation. However, since this mechanism benefits from the routing flexibility, both the gained energy savings and flow performance are limited by the conventional static network topology. Recent advances in DCN architecture propose to implement an adaptive network topology with reconfigurable optical/wireless links (i.e., topology-adaptive DCNs), which has shown a great potential to improve the transmission performance of existing static wired network. In this paper, we propose GreenWay, an energy-efficient solution to jointly optimize the virtual machine (VM) placement and flow transmissions under the new paradigm of topology adaption. Based on the VM traffic demands, it can construct a proper run-time network topology to lower both the energy cost and communication cost among VMs. We first formulate the energy optimization problem in topology-adaptive DCNs. After showing the its NP-hardness, we then develop heuristic algorithms to address the VM placement and topology adaption effectively. Extensive trace-based simulations show that GreenWay consumes much less energy than other state-of-th-eart solutions while ensuring better flow performance. We finally implement an OpenvSwitch-based testbed and demonstrate the efficiency of our solution.
Scalable Data Center Network with distributed placement of component sets in optical networks

Jie Xiao,Bin Wu,Xiaohong Jiang,Achille Pattavina,Hong Wen,Lei Zhang

DOI: https://doi.org/10.1109/ICCChina.2013.6671115

2013-01-01

Abstract:Cloud services are fundamentally supported by Data Center Networks (DCNs). With the fast growth of cloud services, the scale of DCNs increases rapidly, leading to a big concern on system scalability due to multiple constraints. Based on optical switching and transmission, this paper proposes a scalable DCN architecture with distributed placement of optical switches and server racks at different nodes in a given optical network. This solves the scalability issue by relaxing power and cooling constraints, and reducing the number of (electronic) switches using high-capacity optical switches, as well as simplifying internal connections of the DCN using wavelengths in the optical network. Moreover, the distributed optical switches provide service access interfaces to demands in vicinities, and thus reduce the transmission cost of the external traffic. The major concern is the additional delay and cost for remote transmissions of the DCN internal traffic. To this end, we study the component placement problem in DCNs under a given set of external demands and internal traffic patterns. By leveraging among multiple conflicting factors such as scalability and internal overhead of the DCN as well as the transmission cost of external traffic, we propose an ILP (Integer Linear Program) to minimize the overall cost of a DCN while satisfying all service demands in the network. This addresses both scalability and cost minimization issues from a network point of view.
Traffic-aware Virtual Machine Migration in Topology-Adaptive DCN

Yong Cui,Zhenjie Yang,Shihan Xiao,Xin Wang,Shenghui Yan

DOI: https://doi.org/10.1109/tnet.2017.2744643

2017-01-01

IEEE/ACM Transactions on Networking

Abstract:Virtual machine (VM) migration is a key technique for network resource optimization in modern data center networks (DCNs). Previous work generally focuses on how to place the VMs efficiently in a static network topology by migrating the VMs with large traffic demands to close servers. When the VM demands change, however, a great cost will be paid on the VM migration. With the advance of software-defined network (SDN), recent studies have shown great potential to implement an adaptive network topology at a low cost. Taking advantage of the topology adaptability, in this paper, we propose a new paradigm for VM migration by dynamically constructing a topology based on the VM demands to lower the cost of both VM migration and communication. We formulate the traffic-aware VM migration problem in an adaptive topology and show its NP-hardness. Then we develop a novel progressive-decompose-rounding (PDR) algorithm to solve this problem in polynomial time with a proved approximation ratio. Extensive trace-based simulations show that PDR can achieve higher flow throughput among VMs with only a quarter of the migration cost compared to other state-of-art VM migration solutions. We finally implement an OpenvSwitch-based testbed and demonstrate the efficiency of our solution.
Shaping Physical Machine Topology In Distributed Data Center Networks

Shanshan Xin,Jie Xiao,Bin Wu,Hong Wen,Shu Yang,Jianing Guo

DOI: https://doi.org/10.1109/icocn.2015.7203748

2015-01-01

Abstract:Physical machines (PMs) constitute the hardware infrastructure in data centers. Proper distribution and placement of PMs plays an important role in determining the system performance. Existing PM placement approaches generally ignore the demands of virtual machines (VMs), resulting in a poor resource utilization and service QoS. In this paper, we focus on the PM placement problem in a given optical network (called the optical layer) with given traffic demands on the VM-layer. By jointly considering optical and VM layers, we formulate an ILP (Integer Linear Program) to shape the PM-layer topology, while minimizing the overall cost of PM placement and VM mapping. To combine delay and transmission costs on each optical link, we define a cost factor., which can be used to adjust the impact of service delay. Extensive numerical simulations are carried out to validate the correctness of our ILP and the flexibility of our scheme.
Toward Full Virtualization of the Network Topology

Konglin Zhu,Zhihan Yao,Ning He,Dan Li,Lin Zhang

DOI: https://doi.org/10.1109/jsyst.2018.2851240

IF: 4.802

2018-01-01

IEEE Systems Journal

Abstract:With the emergence of new enabling technologies including software-defined networking and network function virtualization, network virtualization has been reemphasized in recent years, such as network slicing in 5G networks. As an important aspect of network virtualization, network topology virtualization is studied in this work—from traditional network embedding toward full network topology virtualization. By full virtualization, the tenant virtual network can specify whatever network topology without knowing the underlying physical network and get the same experience as building a physical network by his own. Based on the switches with a late-binding key extractor, not only one-to-one and many-to-one mapping, but also one-to-many mappings are enabled in full virtualization of network topologies. In this paper, we propose a restricted differential evolution topology virtualization algorithm to achieve efficient mapping from a virtual network to a physical network in full virtualization. Furthermore, migration approaches are carried out to tackle the mapping failure of the virtual network topology. The extensive evaluation results show that the proposed algorithms can accept 30% more virtual network requests and gain more than 25% profit for physical network operators compared with baseline mechanisms.
Energy Efficient Virtual Machine Placement with an Improved Ant Colony Optimization over Data Center Networks

Wenting Wei,Huaxi Gu,Wanyun Lu,Tong Zhou,Xuanzhang Liu

DOI: https://doi.org/10.1109/access.2019.2911914

IF: 3.9

2019-01-01

IEEE Access

Abstract:Virtualization has achieved widespread adoption in various fields. As one of the most significant technologies in network virtualization, an effective virtual machine placement can facilitate to improve resource utilization in data center networks and cut down the enterprises' operation cost. In this paper, we proposed an energy efficient virtual machine placement scheme, which pursued to reduce communication cost and power consumption over traffic-aware data center networks. To solve such an optimization problem, an improved ant colony optimization with adaptive parameter setting was presented to balance its fast convergence and robust search capability. Compared with existing algorithms, simulation results demonstrated that our scheme achieved improvements in power consumption and communication cost, and had a significant reduction in run time under different traffic patterns and configurations.
Virtual Network Deployment in Hybrid Data Center Networks.

Wei Zhang,Sheng Zhang,Zhuzhong Qian,Kaiyuan Wen,Sanglu Lu

DOI: https://doi.org/10.1109/trustcom.2016.0202

2016-01-01

Abstract:Data Center is a multifunctional infrastructure that consists of thousands of compute servers and network devices. The fat-tree topology is widely adopted because of its efficiency and safety. However, the fat-tree topology can not completely meet the time-varying communication needs from physical and virtual machines. 60 GHz wireless technology was then incorporated into data centers for its high speed transmission with low cost. It together with traditional wired network, can provide a stable and cheap transmission. This paper focuses on how to reduce the maximum load in such hybrid environments. Considering that only if we have deployed virtual machines can we arrange the transmission paths, we should complete these two steps in order. In this paper, we propose two algorithms to handle this problem. Our algorithms could handle both online and offline requests. Simulation results demonstrate that the proposed algorithms are able to greatly reduce the maximum load in hybrid data center networks with low time cost.
Virtual Optical Network Mapping and Core Allocation in Elastic Optical Networks Using Multi-Core Fibers

Hejun Xuan,Yuping Wang,Zhanqi Xu,Shanshan Hao,Xiaoli Wang

DOI: https://doi.org/10.1016/j.optcom.2017.05.065

IF: 2.4

2017-01-01

Optics Communications

Abstract:Virtualization technology can greatly improve the efficiency of the networks by allowing the virtual optical networks to share the resources of the physical networks. However, it will face some challenges, such as finding the efficient strategies for virtual nodes mapping, virtual links mapping and spectrum assignment. It is even more complex and challenging when the physical elastic optical networks using multi-core fibers. To tackle these challenges, we establish a constrained optimization model to determine the optimal schemes of optical network mapping, core allocation and spectrum assignment. To solve the model efficiently, tailor-made encoding scheme, crossover and mutation operators are designed. Based on these, an efficient genetic algorithm is proposed to obtain the optimal schemes of the virtual nodes mapping, virtual links mapping, core allocation. The simulation experiments are conducted on three widely used networks, and the experimental results show the effectiveness of the proposed model and algorithm.
A New Optimisation Model And Algorithm For Virtual Optical Networks

Shanshan Hao,Yuping Wang,Beicong Lv

DOI: https://doi.org/10.1504/IJSNET.2019.098555

2019-01-01

International Journal of Sensor Networks

Abstract:Virtual optical network is considered to be the next generation internet architecture and has many unsolved issues, e.g., node mapping, link mapping and spectrum assignment. More and more challenges will be faced when there are privileged nodes through which certain connection requests cannot pass in the physical topology. To address these issues, this paper proposes a new optimisation model in virtual optical network considering privileged nodes, and aims to minimise the maximum index of used frequency slots. A routing algorithm is designed for the model, an adaptive strategy is put forward to determine the crossover rate and mutation rate. In addition, a new crossover and mutation operator are proposed. Based on these, a novel genetic algorithm is proposed to solve the problem. The simulation results show the feasibility of the model and the effectiveness of the algorithm.
Virtualized controller placement for multi-domain optical transport networks using machine learning

Sabidur Rahman,Tanjila Ahmed,Sifat Ferdousi,Partha Bhaumik,Pulak Chowdhury,Massimo Tornatore,Goutam Das,Biswanath Mukherjee

DOI: https://doi.org/10.1007/s11107-020-00895-8

IF: 1.768

2020-07-10

Photonic Network Communications

Abstract:Optical multi-domain transport networks are often controlled by a hierarchical distributed architecture of controllers. Optimal placement of these controllers is very important for efficient management and control. Traditional SDN controller placement methods focus mostly on controller placement in datacenter networks. But the problem of virtualized controller placement for multi-domain transport networks needs to be solved in the context of geographically distributed heterogeneous multi-domain networks. In this context, edge datacenters have enabled network operators to place virtualized controller instances closer to users, besides providing more candidate locations for controller placement. In this study, we propose a dynamic controller placement method for optical transport networks that considers the heterogeneity of optical controllers, resource limitations at edge hosting locations, and latency requirements. We also propose a machine-learning framework that helps the controller placement algorithm with proactive prediction (instead of traditional <i>reactive</i> threshold-based approach). Simulation studies, considering practical scenarios and temporal variation of load, show significant cost savings compared to traditional placement approaches.

computer science, information systems,telecommunications,optics
Hybrid Packet/Fine-Grained-Optical Switching Architectures for Future Large-Scale Data Center Networks

Nan Hua,Yao Li,Xiaoping Zheng

DOI: https://doi.org/10.1109/piers.2016.7734967

2016-01-01

Abstract:The rise of big data and cloud computing applications is driving an explosion in the growth of data centers (DCs), and is already resulting in networking bottlenecks and performance degradation. The size and capacity of DCs are being constrained by the traditional packet-based switching architectures due to high energy consumption.Introducing optical circuit switching (OCS) into the packet-based switching architectures becomes a promising solution to reduce energy consumption in future large-scale high-capacity DC networks. Current fiber/wavelength-switching-based OCS, however, requires each lightpath to occupy the full bandwidth of a fiber/wavelength, leading to coarse switching granularity, low bandwidth utilization, and weak scalability. In order to raise bandwidth utilization in high-capacity DC networks, we proposed and realized a novel hybrid packet/fine-grained optical switching architecture in a prototype DC test bed. In this architecture, optical time slice switching (OTSS) is used for sub-wavelength optical switching in the temporal domain. With high-precision time synchronization and accurate control of optical switches, ultra-fine switching granularity and much higher bandwidth utilization can be achieved. Similar to the spectrum fragments in spectrum-sliced elastic optical switching networks, time slot fragments exist in OTSS networks, which hinder the improvement of bandwidth utilization. In this work, we propose a new overlay hybrid packet/OTSS DC network architecture to get full utilization of time slot fragments. Compared with the peer-to-peer hybrid packet/OTSS architecture, the overlay architecture achieves better bandwidth utilization.

Topology-aware Virtual Machine Placement in Optical Switching Based Small-world Datacenter Networks

Experimental Demonstration Of Efficient Topology Reconstruction In Optical Switching Based Data Center Network

Virtual Topology Design in IP/WDM Networks

Soft-Computing-Based Virtual Topology Design Methods in IP/DWDM Optical Internet

Topology-aware virtual network embedding based on closeness centrality

Virtual topology reconfiguration for wide-area WDM networks

Vtopology: Virtual MAC Address Aided Network Slicing in Multi-Tenant Data Centers

Study on Topology Reconfiguration of Optical Interconnection Network in Data Center

OCBridge: an Efficient Topology Reconfiguration Strategy in Optical Data Center Network

A Heuristic Virtual Topology Design Method in IP/DWDM Optical Internet

Greenway: Joint Vm Placement and Topology Adaption for Green Data Center Networking

Scalable Data Center Network with distributed placement of component sets in optical networks

Traffic-aware Virtual Machine Migration in Topology-Adaptive DCN

Shaping Physical Machine Topology In Distributed Data Center Networks

Toward Full Virtualization of the Network Topology

Energy Efficient Virtual Machine Placement with an Improved Ant Colony Optimization over Data Center Networks

Virtual Network Deployment in Hybrid Data Center Networks.

Virtual Optical Network Mapping and Core Allocation in Elastic Optical Networks Using Multi-Core Fibers

A New Optimisation Model And Algorithm For Virtual Optical Networks

Virtualized controller placement for multi-domain optical transport networks using machine learning

Hybrid Packet/Fine-Grained-Optical Switching Architectures for Future Large-Scale Data Center Networks