Adaptive Resource Provisioning for the Cloud Using Online Bin Packing

SongWeijia,XiaoZhen,ChenQi,LuoHaipeng

IF: 3.183

2014-01-01

IEEE Transactions on Computers

Abstract:Data center applications present significant opportunities for multiplexing server resources. Virtualization technology makes it easy to move running application across physical machines. In this p...

What problem does this paper attempt to address?

Adaptive Resource Provisioning for the Cloud Using Online Bin Packing.

Weijia Song,Zhen Xiao,Qi Chen,Haipeng Luo

DOI: https://doi.org/10.1109/tc.2013.148

2014-01-01

Abstract:Data center applications present significant opportunities for multiplexing server resources. Virtualization technology makes it easy to move running application across physical machines. In this paper, we present an approach that uses virtualization technology to allocate data center resources dynamically based on application demands and support green computing by optimizing the number of servers actively used. We abstract this as a variant of the relaxed on-line bin packing problem and develop a practical, efficient algorithm that works well in a real system. We adjust the resources available to each VM both within and across physical servers. Extensive simulation and experiment results demonstrate that our system achieves good performance compared to the existing work.
Elastic Application Container: A Lightweight Approach for Cloud Resource Provisioning

Sijin He,Li Guo,Yike Guo,Chao Wu,Moustafa Ghanem,Rui Han

DOI: https://doi.org/10.1109/aina.2012.74

2012-01-01

Abstract:Virtual machine (VM) based virtual infrastructure has been adopted widely in cloud computing environment for elastic resource provisioning. Performing resource management using VMs, however, is a heavyweight task. In practice, we have identified two scenarios where VM based resource management is less feasible and less resource-efficient. In this paper, we propose a lightweight resource management model that is called Elastic Application Container (EAC). EAC is a virtual resource unit for delivering better resource efficiency and more scalable cloud applications. We describe the EAC system architecture and components, and also present an algorithm for EAC resource provisioning. We also describe an implementation of the EAC-oriented platform to support multi-tenant cloud use. To evaluate our approach and implementation, we conducted experiments and collected performance data by comparing VM-based and EAC-based resource management with regards to their feasibility and resource-efficiency. The experiment results show that our proposed EAC-based resource management approach outperforms the VM-based approach in terms of feasibility and resource-efficiency.
Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment

XiaoZhen,SongWeijia,ChenQi

IF: 5.3

2013-01-01

IEEE Transactions on Parallel and Distributed Systems

Abstract:Cloud computing allows business customers to scale up and down their resource usage based on needs. Many of the touted gains in the cloud model come from resource multiplexing through virtualizatio...
Multi-resource balance optimization for virtual machine placement in cloud data centers

Wenting Wei,Kun Wang,Kexin Wang,Huaxi Gu,Hong Shen

DOI: https://doi.org/10.1016/j.compeleceng.2020.106866

2020-12-01

Abstract:<p>Network virtualization is widely regarded as a key enabler to improve the desired flexibility and scalability of cloud computing services. With the rapid expansion of data centers, it remains a challenge to provide efficient management of resources for virtual machine placement. Due to multi-dimensional physical resources in servers, there maybe resource fragmentation causing by an imbalanced usage of multi-dimensional resources, when multiple virtual machines carrying diverse requests are deployed on the same server simultaneously. In this paper, we devote to how to balance multiple resources usage to alleviate resource fragmentation while maximizing the service rate for virtual machine placement, so that it can prevent waste of physical resources and undesirable performance. In order to solve such a bi-objective optimization problem, we present a joint bin-packing heuristic and genetic algorithm which achieves an approximate optimal solution with much lower time complexity.</p>

engineering, electrical & electronic,computer science, interdisciplinary applications, hardware & architecture
An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

Lei Xu,Zonghui Wang,Wenzhi Chen

2014-01-01

Journal of information science and engineering

Abstract:The biggest advantage of employing virtualization in cloud is the ability to provision resource flexibly which makes "pay-as-use" model possible. However, since the workload of virtual machine constantly changes, it is still a challenge that efficiently schedule resource by migrating virtual machines among lots of hosts, especially with multi-objective to meet, like power and QoS constraints. In this paper, we present a dynamic resource scheduling solution, named Smart-DRS, which can well determines when to schedule, which to schedule, and where to schedule. It is an integrated framework that aims to deal well with hotspot mitigation, load balancing and server consolidation which are classic problems to solve in on-demand clouds. The experimental results show that our framework strikes a balance between efficiency, overhead and instantaneity.
Affinity and Conflict-Aware Placement of Virtual Machines in Heterogeneous Data Centers.

Kui Su,Lei Xu,Cong Chen,Wenzhi Chen,Zonghui Wang

DOI: https://doi.org/10.1109/isads.2015.42

2015-01-01

Abstract:Virtual machine placement (VMP) problem has been a key issue in IaaS/PaaS cloud infrastructures. Many recent works on VMP prove that inter-VM relations such as memory share, traffic dependency and resource competition should be seriously considered to save energy, increase the performance of infrastructure, reduce service level agreement violation rates and provide better administrative capabilities to the cloud provider. However, most existing works consider the inter-VM relations without taking the heterogeneity of cloud data centers into account. In practice, heterogeneous physical machines (PM) in a heterogeneous data center are often partitioned into logical groups for load balancing and specific services, cloud users always assigned their VMs with specific PM requirements, which make the inter-VM relations far more complex. In this paper, we propose an efficient solution for VMP with inter-VM relation constraints in a heterogeneous data center. The experimental results prove that our solution can efficiently solve the complex problem with an acceptable runtime.
An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

Lei Xu,Zonghui Wang,Wenzhi Chen

2014-01-01

Journal of information science and engineering

Abstract:The biggest advantage of employing virtualization in cloud is the ability to provision resource flexibly which makes “pay-as-use” model possible. However, since the workload of virtual machine constantly changes, it is still a challenge that efficiently schedule resource by migrating virtual machines among lots of hosts, especially with multi-objective to meet, like power and QoS constraints. In this paper, we present a dynamic resource scheduling solution, named Smart-DRS, which can well determines when to schedule, which to schedule, and where to schedule. It is an integrated framework that aims to deal well with hotspot mitigation, load balancing and server consolidation which are classic problems to solve in on-demand clouds. The experimental results show that our framework strikes a balance between efficiency, overhead and instantaneity.
Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

Lei Xu,Wenzhi Chen,Zonghui Wang,Shuangquan Yang

DOI: https://doi.org/10.1109/ClusterW.2012.14

2012-01-01

Abstract:The biggest advantage of employing virtualization is the ability to flexibly remap physical resources to virtual servers in order to handle the resource redistribution. So virtual machine is the fundamental unit in cloud data center. However, the load of virtual machine constantly changes owing to the needs of applications. In order to improve the resource utilization and reduce power energy, data center needs an automatic, quick and dynamic resource scheduling strategy which treats virtual machine as a scheduling unit to balance load and consolidate servers. In this paper, we present a two-steps dynamic resource scheduling strategy, named Smart-DRS, which fits cloud data center well and strikes a balance between efficiency, cost and instantaneity. Firstly, we employ a prediction technique based on Single Exponential Smoothing algorithm. Then a novel and efficient migration algorithm based on Vector Projection was applied. For evaluating the performance of Smart-DRS, we develop a complete resource management prototype system in which resource scheduling is just only a module. Then we build a cluster with 32 physical machines running with 3200 virtual machines to simulate data center environment. Experiment results tell us that Smart-DRS has a high forecast accuracy and also can deal well with load balancing and load consolidation.
Application-Aware Dynamic Fine-Grained Resource Provisioning in a Virtualized Cloud Data Center

Jing Bi,Haitao Yuan,Wei Tan,MengChu Zhou,Yushun Fan,Jia Zhang,Jianqiang Li

DOI: https://doi.org/10.1109/tase.2015.2503325

IF: 6.636

2015-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:A key factor of win–win cloud economy is how to trade off between the application performance from customers and the profit of cloud providers. Current researches on cloud resource allocation do not sufficiently address the issues of minimizing energy cost and maximizing revenue for various applications running in virtualized cloud data centers (VCDCs). This paper presents a new approach to optimize the profit of VCDC based on the service-level agreements (SLAs) between service providers and customers. A precise model of the external and internal request arrival rates is proposed for virtual machines at different service classes. An analytic probabilistic model is then developed for non-steady VCDC states. In addition, a smart controller is developed for fine-grained resource provisioning and sharing among multiple applications. Furthermore, a novel dynamic hybrid metaheuristic algorithm is developed for the formulated profit maximization problem, based on simulated annealing and particle swarm optimization. The proposed algorithm can guarantee that differentiated service qualities can be provided with higher overall performance and lower energy cost. The advantage of the proposed approach is validated with trace-driven simulations.
Dynamic Resource Balancing in Cloud Computing Framework

WANG Zhi-gang,WANG Xiao-lin,LUO Ying-wei

2012-01-01

Journal of Integration Technology

Abstract:Cloud computing brings the potential to deliver flexibility, consolidation, and high resource utilization to data centers, and virtualization is the key layer. High resource utilization as well as high performance promised by virtualization largely depends on an effective and efficient resource management scheme. There is a great demand on building a multi-layered resource management mechanism via virtualization: using the characters of the virtual machine to build a predictive resource model and then export the allocation strategy, finally the resource can be allocated dynamically on demand. We should focus not only on the resource utilization rate on the physical machines, but also the change of resource demand while running for the application on the virtual machines. The final target is to get a suit of virtual resource management technology, which could be widely used in the static deployment, dynamic prediction, and resource management between virtual machines or physical machines, to support the cloud computing powerfully.
Provisioning Virtual Resources Adaptively in Elastic Compute Cloud Platforms

Fan Zhang,Junwei Cao,Hong Cai,Cheng Wu

DOI: https://doi.org/10.4018/jwsr.2011070103

2011-01-01

International Journal of Web Services Research

Abstract:Provisioning Virtual machines on demand is significant in elastic compute cloud for reliable service delivery. The importance and major difficulty lies in satisfying the conflicting objectives of satisfying contracted service level agreement while lowering used resource costs. In this paper, the authors propose a mathematical multi-tier framework for adaptive virtual resource allocation problem. The framework captures the performance of the virtualized cloud platform gracefully. The authors first use simulations to derive virtual resource allocation policies, and later use real benchmarking applications, to verify the effectiveness of this framework. Experimental results show that the model can be simply and effectively used to satisfy the response time requirement as well as lowering the cost of using the virtual machine resources.
Automatic Scaling of Internet Applications for Cloud Computing Services

Zhen Xiao,Qi Chen,Haipeng Luo

DOI: https://doi.org/10.1109/tc.2012.284

IF: 3.183

2014-01-01

IEEE Transactions on Computers

Abstract:Many Internet applications can benefit from an automatic scaling property where their resource usage can be scaled up and down automatically by the cloud service provider. We present a system that provides automatic scaling for Internet applications in the cloud environment. We encapsulate each application instance inside a virtual machine (VM) and use virtualization technology to provide fault isolation. We model it as the Class Constrained Bin Packing (CCBP) problem where each server is a bin and each class represents an application. The class constraint reflects the practical limit on the number of applications a server can run simultaneously. We develop an efficient semi-online color set algorithm that achieves good demand satisfaction ratio and saves energy by reducing the number of servers used when the load is low. Experiment results demonstrate that our system can improve the throughput by 180% over an open source implementation of Amazon EC2 and restore the normal QoS five times as fast during flash crowds. Large scale simulations demonstrate that our algorithm is extremely scalable: the decision time remains under 4 s for a system with 10 000 servers and 10 000 applications. This is an order of magnitude improvement over traditional application placement algorithms in enterprise environments.
An Energy-Efficient Scheme for Cloud Resource Provisioning Based on CloudSim

Yuxiang Shi,Xiaohong Jiang,Kejiang Ye

DOI: https://doi.org/10.1109/CLUSTER.2011.63

2011-01-01

Cluster Computing

Abstract:Cloud computing has recently received considerable attention. With the fast development of cloud computing, the data center is becoming larger in scale and consumes more energy. There is an emergency need to develop efficient energy-saving methods to reduce the huge energy consumption in the cloud data center. In this paper, we achieve this goal by dynamically allocating resources based on utilization analysis and prediction. We use ``Linear Predicting Method" (LPM) and ``Flat Period Reservation-Reduced Method" (FPRRM) to get useful information from the resource utilization log, and make M/M/1 queuing theory predicting method have better response time and less energy-consuming. Experimental evaluation performed on CloudSim cloud simulator shows that the proposed methods can effectively reduce the violation rate and energy-consuming in the cloud.
Adaptive Virtual Machine Provisioning in Elastic Multi-tier Cloud Platforms

Fan Zhang,Junwei Cao,Hong Cai,James J. Mulcahy,Cheng Wu

DOI: https://doi.org/10.1109/NAS.2011.20

2011-01-01

Abstract:Virtual machines are allocated on demand in virtualized cloud platforms to provide flexible and reliable services. The major difficulty lies in satisfying the conflicting objectives of reducing response time while lowering resource costs. In this paper, a mathematical multi-tier framework for virtual machine allocation is proposed, which can be used to capture the performance of the cloud platform. We first use simulations to derive virtual resource allocation policies, and later use real benchmarking applications to verify the effectiveness of this framework. Experimental results show that the model can be simply and effectively used to satisfy the response time requirement as well as lowering the cost of using the virtual machine resources.
Prepartition: Load Balancing Approach for Virtual Machine Reservations in a Cloud Data Center

Wenhong Tian,Minxian Xu,Guangyao Zhou,Kui Wu,Chengzhong Xu,Rajkumar Buyya

DOI: https://doi.org/10.48550/arXiv.2110.09913

2021-10-19

Abstract:Load balancing is vital for the efficient and long-term operation of cloud data centers. With virtualization, post (reactive) migration of virtual machines after allocation is the traditional way for load balancing and consolidation. However, reactive migration is not easy to obtain predefined load balance objectives and may interrupt services and bring instability. Therefore, we provide a new approach, called Prepartition, for load balancing. It partitions a VM request into a few sub-requests sequentially with start time, end time and capacity demands, and treats each sub-request as a regular VM request. In this way, it can proactively set a bound for each VM request on each physical machine and makes the scheduler get ready before VM migration to obtain the predefined load balancing goal, which supports the resource allocation in a fine-grained manner. Simulations with real-world trace and synthetic data show that Prepartition for offline (PrepartitionOff) scheduling has 10%-20% better performance than the existing load balancing algorithms under several metrics, including average utilization, imbalance degree, makespan and Capacity_makespan. We also extend Prepartition to online load balancing. Evaluation results show that our proposed approach also outperforms existing online algorithms.

Distributed, Parallel, and Cluster Computing
Overbooking-Based Resource Allocation in Virtualized Data Center

Tianyu Wo,Qian Sun,Bo Li,Chunming Hu

DOI: https://doi.org/10.1109/isorcw.2012.34

2012-01-01

Abstract:Efficient resource management in the virtualized data center is always a practical concern and has attracted significant attention. In particularly, economic allocation mechanism is desired to maximize the revenue for commercial cloud providers. This paper uses overbooking from Revenue Management to avoid resource over-provision according to its runtime demand. We propose an economic model to control the overbooking policy while provide users probability based performance guarantee using risk estimation. To cooperate with overbooking policy, we optimize the VM placement with traffic-aware strategy to satisfy application's QoS requirement. We design GreedySelePod algorithm to achieve traffic localization in order to reduce network bandwidth consumption, especially the network bottleneck bandwidth, thus to accept more requests and increase the revenue in the future. The simulation results show that our approach can greatly improve the request acceptance rate and increase the revenue by up to 87% while with acceptable resource confliction.
Prepartition: Paradigm for the Load Balance of Virtual Machine Allocation in Data Centers

Minxian Xu,Guangchun Luo,Ling Tian,Aiguo Chen,Yaqiu Jiang,Guozhong Li,Wenhong Tian

DOI: https://doi.org/10.48550/arXiv.1508.06350

2015-08-26

Abstract:It is significant to apply load-balancing strategy to improve the performance and reliability of resource in data centers. One of the challenging scheduling problems in Cloud data centers is to take the allocation and migration of reconfigurable virtual machines (VMs) as well as the integrated features of hosting physical machines (PMs) into consideration. In the reservation model, the workload of data centers has fixed process interval characteristics. In general, load-balance scheduling is NP-hard problem as proved in many open literatures. Traditionally, for offline load balance without migration, one of the best approaches is LPT (Longest Process Time first), which is well known to have approximation ratio 4/3. With virtualization, reactive (post) migration of VMs after allocation is one popular way for load balance and traffic consolidation. However, reactive migration has difficulty to reach predefined load balance objectives, and may cause interruption and instability of service and other associated costs. In view of this, we propose a new paradigm, called Prepartition, it proactively sets process-time bound for each request on each PM and prepares in advance to migrate VMs to achieve the predefined balance goal. Prepartition can reduce process time by preparing VM migration in advance and therefore reduce instability and achieve better load balance as desired. We also apply the Prepartition to online (PrepartitionOn) load balance and compare it with existing online scheduling algorithms. Both theoretical and experimental results are provided.

Distributed, Parallel, and Cluster Computing
Economical and Robust Provisioning of N-Tier Cloud Workloads: A Multi-level Control Approach

Pengcheng Xiong,Zhikui Wang,Simon Malkowski,Qingyang Wang,Deepal Jayasinghe,Calton Pu

DOI: https://doi.org/10.1109/ICDCS.2011.88

2011-01-01

Abstract:Resource provisioning for N-tier web applications in Clouds is non-trivial due to at least two reasons. First, there is an inherent optimization conflict between cost of resources and Service Level Agreement (SLA) compliance. Second, the resource demands of the multiple tiers can be different from each other, and varying along with the time. Resources have to be allocated to multiple (virtual) containers to minimize the total amount of resources while meeting the end-to-end performance requirements for the application. In this paper we address these two challenges through the combination of the resource controllers on both application and container levels. On the application level, a decision maker (i.e., an adaptive feedback controller) determines the total budget of the resources that are required for the application to meet SLA requirements as the workload varies. On the container level, a second controller partitions the total resource budget among the components of the applications to optimize the application performance (i.e., to minimize the round trip time). We evaluated our method with three different workload models -- open, closed, and semi-open - that were implemented in the RUBiS web application benchmark. Our evaluation indicates two major advantages of our method in comparison to previous approaches. First, fewer resources are provisioned to the applications to achieve the same performance. Second, our approach is robust enough to address various types of workloads with time-varying resource demand without reconfiguration.
Page-sharing-based Virtual Machine Packing with Multi-Resource Constraints to Reduce Network Traffic in Migration for Clouds

Huixi Li,Wenjun Li,Shigeng Zhang,Haodong Wang,Yi Pan,Jianxin Wang

DOI: https://doi.org/10.1016/j.future.2019.02.043

IF: 7.307

2019-01-01

Future Generation Computer Systems

Abstract:Virtual machine (VM) packing plays an important role in improving resource utilization in cloud data centers. Recently, memory content similarity among VM instances has been used to speed up multiple VM migration in large clouds. Based on this, many VM packing algorithms have been proposed, which only considered the memory capacity of physical machines (PMs) as the resource constraint. However, in practice the results of such algorithms are not feasible, because thy may not satisfy the constraints of multiple resources (e.g., CPU of the PMs). Besides, the granularities of memory sharing in existing studies are very coarse, and they cannot fully leverage the benefits of memory content similarity which mainly appears at memory page level. In this paper, we study the page-sharing-based VM packing that considers constraints in multiple resources. Given a set of VM instances that share a large number of common memory pages, we pack them into the minimum number of PMs, subject to the constraints in the multiple resources on the PMs. This problem is solved in two steps. First, we pack the maximum number of VMs into a given PM, and then propose an approximation algorithm. The approximation ratio is better than that of the existing algorithm. Then, based on this approximation algorithm, we propose a heuristic algorithm to solve the general problem. Experimental results show that our heuristic algorithm outperforms existing approaches with at most 25% less required PMs and at most 40% less memory page transferring.

Adaptive Resource Provisioning for the Cloud Using Online Bin Packing

Adaptive Resource Provisioning for the Cloud Using Online Bin Packing.

Elastic Application Container: A Lightweight Approach for Cloud Resource Provisioning

Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment

Multi-resource balance optimization for virtual machine placement in cloud data centers

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

Affinity and Conflict-Aware Placement of Virtual Machines in Heterogeneous Data Centers.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

Application-Aware Dynamic Fine-Grained Resource Provisioning in a Virtualized Cloud Data Center

Dynamic Resource Balancing in Cloud Computing Framework

Provisioning Virtual Resources Adaptively in Elastic Compute Cloud Platforms

Automatic Scaling of Internet Applications for Cloud Computing Services

An Energy-Efficient Scheme for Cloud Resource Provisioning Based on CloudSim

Adaptive Virtual Machine Provisioning in Elastic Multi-tier Cloud Platforms

Prepartition: Load Balancing Approach for Virtual Machine Reservations in a Cloud Data Center

Overbooking-Based Resource Allocation in Virtualized Data Center

Prepartition: Paradigm for the Load Balance of Virtual Machine Allocation in Data Centers

Economical and Robust Provisioning of N-Tier Cloud Workloads: A Multi-level Control Approach

Page-sharing-based Virtual Machine Packing with Multi-Resource Constraints to Reduce Network Traffic in Migration for Clouds