Cloud Resource Scheduling Strategies

Wenhong Tian,Yong Zhao

DOI: https://doi.org/10.1016/b978-0-12-801476-9.00004-5

2015-01-01

Abstract:Scheduling strategies determine the objectives of resource scheduling and ensure that user requests and quality of service can be satisfied. This chapter mainly analyzes scheduling strategies in Cloud data centers, and then the current major scheduling strategies are classified and compared.

What problem does this paper attempt to address?

Optimized Cloud Resource Management and Scheduling: Theories and Practices

Wenhong Tian,Yong Zhao

2014-01-01

Abstract:Optimized Cloud Resource Management and Scheduling identifies research directions and technologies that will facilitate efficient management and scheduling of computing resources in cloud data centers supporting scientific, industrial, business, and consumer applications. It serves as a valuable reference for systems architects, practitioners, developers, researchers and graduate level students.Explains how to optimally model and schedule computing resources in cloud computingProvides in depth quality analysis of different load-balance and energy-efficient scheduling algorithms for cloud data centers and Hadoop clustersIntroduces real-world applications, including business, scientific and related case studiesDiscusses different cloud platforms with real test-bed and simulation tools
Cloud Scheduling Algorithm Based on Fuzzy Clustering

Wen-juan LI,Qi-fei ZHANG,Ling-di PING,Xue-zeng PAN

2012-01-01

Abstract:In order to better serve cloud’s objective of providing low-cost and on-demand services,a two-level and fuzzy clustering based cloud scheduling algorithm named FCTLBS(fuzzy clustering and two level based task scheduling algorithm) was proposed.Scheduling was divided into two levels:user scheduling and task cheduling.It used fuzzy clustering method to cluster resources according to their capabilities and computed tasks’resource bias coefficient according to their parameters.Thus tasks with different resource preference were able to choose different capability resources in the corresponding clusters.The new algorithm reduces the scale of resource choice,better reflects cloud tasks’ service requirements.Simulation results show that the proposed algorithm has some advantages compared to other kindred algorithms.
A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Wenjuan Li,Xuezeng Pan,Qifei Zhang,Lingdi Ping

DOI: https://doi.org/10.5220/0003381101520157

2011-01-01

Abstract:: Job scheduling and resource allocation are the key factors which affect the performance of parallel and distributed systems. This paper first analyzed several common used job scheduling models in large and distributed environment. Since the main purpose of cloud computing is to provide “low-cost” and “on-demand” services, this paper introduced a novel two-level based cloud scheduling model. In our model, job scheduling in the cloud is divided into User Scheduling and Task Scheduling which were designed to implement different scheduling strategies. In the User Scheduling level, it applies the distribution justice theory in the sociology area to achieve the highest average user fairness. While in Task Scheduling level, it applies adaptive strategies to achieve the binding of micro tasks and the virtual machines according to different objectives of tasks. The new model redefined the messaging mechanism between main cloud entities and a new advertising mode was introduced for cloud providers to promote their services. The results of emulation experiments show that compared to traditional algorithms the proposed model can guarantee the user expectations and the relative fairness of the services on the basis of high overall efficiency of cloud systems.
Resource Allocation Strategies for Cloud Platform

QIN Zhiguang,KE Tao,LIU Mengjuan,WANG Cong

DOI: https://doi.org/10.3724/sp.j.1087.2013.00299

2013-01-01

Journal of Computer Applications

Abstract:Resource allocation strategy has been the hot and difficult research topic in the field of cloud computation.Research and analysis of current resource allocation strategies were carried out.Firstly,the challenges facing cloud platform resource allocation were analyzed.Then the formalization description of cloud platform resource allocation was given.The current mainstream of resource allocation strategies were described from the perspectives of heuristic allocation algorithms,economic theory based strategy,and other allocation strategies,and their advantages and disadvantages were discussed.Finally,a comprehensive comparison of the mainstream strategies based on specific indicators was made,and some future research directions were pointed out.
Cloud platform resource scheduling strategy design based on stochastic model

Shaoka ZHAO,Liyao LI,Cong XU,Jiahai YANG

DOI: https://doi.org/10.3778/j.issn.1002-8331.1306-0101

2014-01-01

Abstract:In view of cloud computing actual needs of resource management, cloud platform scheduling strategy based on stochastic model is proposed, and reasonable and efficient resource scheduling algorithm is designed in order to reduce the request loss rate of traditional algebraic model and improve poor load balancing performance of other stochastic mod-els. Through load balancing on the basis of service performance and efficiency, cloud platform stability is ensured. Experi-mental results show that the scheduling strategy can optimize the efficiency of virtual resource usage and the response time of the service while being able to achieve better load balance and reduce operating costs.
An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

Lei Xu,Zonghui Wang,Wenzhi Chen

2014-01-01

Journal of information science and engineering

Abstract:The biggest advantage of employing virtualization in cloud is the ability to provision resource flexibly which makes "pay-as-use" model possible. However, since the workload of virtual machine constantly changes, it is still a challenge that efficiently schedule resource by migrating virtual machines among lots of hosts, especially with multi-objective to meet, like power and QoS constraints. In this paper, we present a dynamic resource scheduling solution, named Smart-DRS, which can well determines when to schedule, which to schedule, and where to schedule. It is an integrated framework that aims to deal well with hotspot mitigation, load balancing and server consolidation which are classic problems to solve in on-demand clouds. The experimental results show that our framework strikes a balance between efficiency, overhead and instantaneity.
Comparative Study of Energy-efficient Scheduling in Cloud Data Centers

Wenhong Tian,Yong Zhao

DOI: https://doi.org/10.1016/b978-0-12-801476-9.00008-2

2015-01-01

Abstract:This chapter focuses on offline and online energy-efficient scheduling for Cloud data centers. We introduce the main concept and comparative study of offline scheduling algorithms and online scheduling algorithms for energy-efficient scheduling in Cloud data centers. Both theoretical analysis and performance evaluation by simulation are provided.
An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

Lei Xu,Zonghui Wang,Wenzhi Chen

2014-01-01

Journal of information science and engineering

Abstract:The biggest advantage of employing virtualization in cloud is the ability to provision resource flexibly which makes “pay-as-use” model possible. However, since the workload of virtual machine constantly changes, it is still a challenge that efficiently schedule resource by migrating virtual machines among lots of hosts, especially with multi-objective to meet, like power and QoS constraints. In this paper, we present a dynamic resource scheduling solution, named Smart-DRS, which can well determines when to schedule, which to schedule, and where to schedule. It is an integrated framework that aims to deal well with hotspot mitigation, load balancing and server consolidation which are classic problems to solve in on-demand clouds. The experimental results show that our framework strikes a balance between efficiency, overhead and instantaneity.
Resource scheduling strategy for the enterprise extended cloud

Yuan Zhengwu,Sang Xinguang

2012-01-01

Abstract:In view of the problem of resource scheduling strategy for the enterprise extended cloud,a kind of parallel strategy with emergency degree and importance priority was proposed,which was built on the basis of local preferred strategy and cloud priority strategy.we considered the response efficiency,the task consumption time and the corporate earnings,pretreated the resources,sorted the task in accordance with emergency degree and importance priority,designed the architecture at the same time in this strategy.The theoretical analysis and computer simulations show that the response efficiency and enterprise earnings were improved,and the consumption of time was reduced in this strategy.
Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

Lei Xu,Wenzhi Chen,Zonghui Wang,Shuangquan Yang

DOI: https://doi.org/10.1109/ClusterW.2012.14

2012-01-01

Abstract:The biggest advantage of employing virtualization is the ability to flexibly remap physical resources to virtual servers in order to handle the resource redistribution. So virtual machine is the fundamental unit in cloud data center. However, the load of virtual machine constantly changes owing to the needs of applications. In order to improve the resource utilization and reduce power energy, data center needs an automatic, quick and dynamic resource scheduling strategy which treats virtual machine as a scheduling unit to balance load and consolidate servers. In this paper, we present a two-steps dynamic resource scheduling strategy, named Smart-DRS, which fits cloud data center well and strikes a balance between efficiency, cost and instantaneity. Firstly, we employ a prediction technique based on Single Exponential Smoothing algorithm. Then a novel and efficient migration algorithm based on Vector Projection was applied. For evaluating the performance of Smart-DRS, we develop a complete resource management prototype system in which resource scheduling is just only a module. Then we build a cluster with 32 physical machines running with 3200 virtual machines to simulate data center environment. Experiment results tell us that Smart-DRS has a high forecast accuracy and also can deal well with load balancing and load consolidation.
A Novel Resource Scheduling Approach in Container Based Clouds

Xin Xu,Huiqun Yu,Xin Pei

DOI: https://doi.org/10.1109/cse.2014.77

2014-01-01

Abstract:Cloud computing is a new paradigm to deliver computing resources to customers in a pay-as-you-go model. In this paper, the recently emerged container-based virtualization technology is adopted for building the infrastructure of a cloud data center. Cloud providers are concerned with the resource usage in a multi-type resource sharing environment while cloud customers desire higher quality of services. According to this, we propose a resource scheduling approach for the container virtualized cloud environments to reduce response time of customers' jobs and improve providers' resource utilization rate. The stable matching theory is applied to generate an optimal mapping from containers to physical servers. Simulations are implemented to evaluate our resource scheduling approach. The results show that our approach achieves a better performance for customers and maximal profits for cloud providers by improving the resource utilization.
A Study on Resource Scheduling Strategy in the Enterprise Service Cloud

Zheng-Wu Yuan,Xin-Guang Sang

DOI: https://doi.org/10.1109/icsai.2012.6223143

2012-01-01

Abstract:With the rapid development of information, efficiency becomes an important factor to measure the service-quality. Customers always hope to obtain the service quickly when they submit requests to the enterprise. In order to improve response efficiency, reduce task's time-consuming, consider urgent tasks meanwhile, Urgency First Parallel Strategy(UFPS) is introduced on the basis of local preferred strategy and cloud preferred strategy from a business point of view, and a framework is designed. A large number of experiments and comparison were made to prove the effectiveness of the strategy.
Evaluating Performance Of Rescheduling Strategies In Cloud System

Tang Hongyan,Li Ying,Jia Tong,Wu Zhonghai

DOI: https://doi.org/10.1109/TrustCom.2016.0242

2016-01-01

Abstract:Motived by frequent failures in cloud computing systems, we aim to demystify the underlying rescheduling strategies performed by the scheduler to deal with task failure. In this paper, we comprehensively investigate and compare rescheduling strategies of two large-scale systems, Google cluster and CMU OpenCloud. Moreover, we quantitatively evaluate the performance of different rescheduling strategies and uncover the consequent negative impacts. Based on our analysis, we find that repeated rescheduling a task immediately after every failure without limitation, on one hand could improve the availability of tasks, on the other hand, will bring significant overhead and waste a large amount of resource. Furthermore, migrating failed tasks to different machines could be an effective way to successful execution finally, however with lower availability. Our analysis provides valuable guidance for the design of scheduler to achieve better trade-off between availability and resource saving in cloud system.
Utility Optimization Strategy Of Resource Scheduling In Cloud Computing

Yan Wang,Jinkuan Wang,Cuirong Wang,Jinghao Sun,Xin Song

DOI: https://doi.org/10.1109/ChiCC.2016.7554169

2016-01-01

Abstract:In current datacenters, centers deliver resources for tenants to run various jobs with diverse requirements. Today's resource management can provide higher levels of scheduling options and supports certain QoS (Quality of Service) requirements. However in many references, exiting cloud resource management scheduling focus on the objective function to minimize the deadline time fall short in utility maximization of the resource scheduling in cloud computing. In this paper, we model a resource scheduling problem as a UMM (Utility Maximization Model) to optimize the VM (Virtual Machine) placement policy and a GP (Gradient Projection) algorithm for solving Lagrange problem and optimization is proposed, which also improves the efficiency of resource scheduling comparing of the random algorithm, fair algorithm and earliest-deadline-first algorithm.
Online Cost-Rejection Rate Scheduling for Resource Requests in Hybrid Clouds

Yanhua Cao,Li Lu,Jiadi Yu,Shiyou Qian,Yanmin Zhu,Minglu Li

DOI: https://doi.org/10.1016/j.parco.2018.12.003

IF: 0.983

2019-01-01

Parallel Computing

Abstract:The hybrid cloud computing model has attracted considerable attention in recent years. Due to security and controllability of private cloud, some resource requests are required to be scheduled in private parts of hybrid cloud. However, these requests could be rejected because of the resource limitation of private parts of hybrid cloud. In this paper, all resource requests are classified into two categories, i.e., the special requests required to process in private cloud, and the normal requests insensitive in private or public clouds. By considering the normal requests undivided to dispatch a cloud and divided to dispatch different clouds, we propose the online cost-rejection rate scheduling strategy (OCS) for the normal requests undivided, and the online scheduling strategy for some normal requests divided (OCS-divided), which could make suitable requests placement decisions in real-time and minimize the cost of renting public cloud resources with a low rate of rejected requests. Then, we transform both online models into two one-shot optimization problems by taking advantage of Lyapunov optimization techniques, and employ the optimal decay algorithm to solve the one-shot problems. The simulation results demonstrate that our scheduling strategies can achieve the trade-off between cost and rejection rate, and process the real-time resource requests in hybrid clouds. OCS-divided can achieve an average cost saving of about 25% compared with OCS and maximize the resource utilization.
A systematic review of scheduling approaches on multi-tenancy cloud platforms

Ru Jia,Yun Yang,John Grundy,Jacky Keung,Li Hao

DOI: https://doi.org/10.1016/j.infsof.2020.106478

IF: 3.9

2021-04-01

Information and Software Technology

Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Context:</h3><p>Scheduling in cloud is complicated as a result of multi-tenancy. Diverse tenants have different requirements, including service functions, response time, QoS and throughput. Diverse tenants require different scheduling capabilities, resource consumption and competition. Multi-tenancy scheduling approaches have been developed for different service models, such as Software as a Service (SaaS), Platform as a service (PaaS), Infrastructure as a Service (IaaS), and Database as a Service (DBaaS).</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Objective:</h3><p>In this paper, we survey the current landscape of multi-tenancy scheduling, laying out the challenges and complexity of software engineering where multi-tenancy issues are involved. This study emphasises scheduling policies, cloud provisioning and deployment with regards to multi-tenancy issues. We conduct a systematic literature review of research studies related to multi-tenancy scheduling approaches on cloud platforms determine the primary scheduling approaches currently used and the challenges for addressing key multi-tenancy scheduling issues.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Method:</h3><p>We adopted a systematic literature review method to search and review many major journal and conference papers on four major online electronic databases, which address our four predefined research questions. Defining inclusion and exclusion criteria was the initial step before extracting data from the selected papers and deriving answers addressing our inquiries.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results:</h3><p>Finally, 53 papers were selected, of which 62 approaches were identified. Most of these methods are developed without cloud layers' limitation (43.40%) and on SaaS, most of scheduling approaches are oriented to framework design (43.75%).</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion:</h3><p>The results have demonstrated most of multi-tenancy scheduling solutions can work at any delivery layer. With the difference of tenants' requirements and functionalities, the choice of cloud service delivery models is changed. Based on our study, designing a multi-tenancy scheduling framework should consider the following 3 factors: computing, QoS and storage resource. One of the potential research foci of multi-tenancy scheduling approaches is on GPU scheduling.</p>

computer science, information systems, software engineering
Deep reinforcement learning-based methods for resource scheduling in cloud computing: a review and future directions

Guangyao Zhou,Wenhong Tian,Rajkumar Buyya,Ruini Xue,Liang Song

DOI: https://doi.org/10.1007/s10462-024-10756-9

IF: 9.588

2024-04-24

Artificial Intelligence Review

Abstract:With the acceleration of the Internet in Web 2.0, Cloud computing is a new paradigm to offer dynamic, reliable and elastic computing services. Efficient scheduling of resources or optimal allocation of requests is one of the prominent issues in emerging Cloud computing. Considering the growing complexity of Cloud computing, future Cloud systems will require more effective resource management methods. In some complex scenarios with difficulties in directly evaluating the performance of scheduling solutions, classic algorithms (such as heuristics and meta-heuristics) will fail to obtain an effective scheme. Deep reinforcement learning (DRL) is a novel method to solve scheduling problems. Due to the combination of deep learning and reinforcement learning (RL), DRL has achieved considerable performance in current studies. To focus on this direction and analyze the application prospect of DRL in Cloud scheduling, we provide a comprehensive review for DRL-based methods in resource scheduling of Cloud computing. Through the theoretical formulation of scheduling and analysis of RL frameworks, we discuss the advantages of DRL-based methods in Cloud scheduling. We also highlight different challenges and discuss the future directions existing in the DRL-based Cloud scheduling.

computer science, artificial intelligence
A Formal Aspect-Oriented Method for Modeling and Analyzing Adaptive Resource Scheduling in Cloud Computing

Guisheng Fan,Huiqun Yu,Liqiong Chen

DOI: https://doi.org/10.1109/tnsm.2016.2553157

2016-01-01

IEEE Transactions on Network and Service Management

Abstract:Cloud computing has attracted much interest recently from both industry and academia. However, the scale and highly dynamic nature of cloud application imposes significant new challenges to resource management, and efficient resource scheduling schemes are highly demanded. In this paper, we propose a systematic method to address the reliability, running time, and failure processing of resource scheduling in cloud computing. A reflection mechanism is used to abstract the resource scheduling process as a metaobject. Petri nets are used to construct the base layer model, meta layer model, metaobject protocol, and other components, thus forming the resource scheduling model. The adaptive resource scheduling strategy is converted into CTL formulas, and the properties are analyzed. Meanwhile, an enforcement algorithm is proposed, which can guarantee the correct behavior of cloud computing while meeting the required reliability within deadline constraints. The operational semantics and related theories of Petri nets help prove its effectiveness and correctness. We have also performed a series of simulations to evaluate our approach. Results show that it can help reveal the structural and behavioral characteristics of cloud computing and improve the efficiency of resource management.
A Dynamic Resource Scheduling Method Based on Fuzzy Control Theory in Cloud Environment

Zhijia Chen,Yuanchang Zhu,Yanqiang Di,Shaochong Feng

DOI: https://doi.org/10.1155/2015/383209

2015-01-01

Journal of Control Science and Engineering

Abstract:The resources in cloud environment have features such as large-scale, diversity, and heterogeneity. Moreover, the user requirements for cloud computing resources are commonly characterized by uncertainty and imprecision. Hereby, to improve the quality of cloud computing service, not merely should the traditional standards such as cost and bandwidth be satisfied, but also particular emphasis should be laid on some extended standards such as system friendliness. This paper proposes a dynamic resource scheduling method based on fuzzy control theory. Firstly, the resource requirements prediction model is established. Then the relationships between resource availability and the resource requirements are concluded. Afterwards fuzzy control theory is adopted to realize a friendly match between user needs and resources availability. Results show that this approach improves the resources scheduling efficiency and the quality of service (QoS) of cloud computing.
Resource Management and Scheduling for Big Data Applications in Cloud Computing Environments

Muhammed Tawfiqul Islam,Rajkumar Buyya

DOI: https://doi.org/10.4018/978-1-5225-8407-0.ch001

2019-01-01

Abstract:This chapter presents software architectures of the big data processing platforms. It also provides in-depth knowledge on resource management techniques involved while deploying big data processing systems in the cloud environment. It starts from the very basics and gradually introduce the core components of resource management which are divided into multiple layers. It covers the state-of-art practices and researches done in SLA-based resource management with a specific focus on the job scheduling mechanisms.

Cloud Resource Scheduling Strategies

Optimized Cloud Resource Management and Scheduling: Theories and Practices

Cloud Scheduling Algorithm Based on Fuzzy Clustering

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Resource Allocation Strategies for Cloud Platform

Cloud platform resource scheduling strategy design based on stochastic model

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

Comparative Study of Energy-efficient Scheduling in Cloud Data Centers

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

Resource scheduling strategy for the enterprise extended cloud

Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

A Novel Resource Scheduling Approach in Container Based Clouds

A Study on Resource Scheduling Strategy in the Enterprise Service Cloud

Evaluating Performance Of Rescheduling Strategies In Cloud System

Utility Optimization Strategy Of Resource Scheduling In Cloud Computing

Online Cost-Rejection Rate Scheduling for Resource Requests in Hybrid Clouds

A systematic review of scheduling approaches on multi-tenancy cloud platforms

Deep reinforcement learning-based methods for resource scheduling in cloud computing: a review and future directions

A Formal Aspect-Oriented Method for Modeling and Analyzing Adaptive Resource Scheduling in Cloud Computing

A Dynamic Resource Scheduling Method Based on Fuzzy Control Theory in Cloud Environment

Resource Management and Scheduling for Big Data Applications in Cloud Computing Environments