A Load-Balancing Algorithm for N-cubes

Min-You Wu,Wei Shu

DOI: https://doi.org/10.1109/icpp.1996.538570

1996-01-01

Abstract:A parallel scheduling algorithm for N-cube networks is presented. This algorithm can fully balance the load and maximize locality by using global load information. Communication costs are significantly reduced compared to other existing algorithms

What problem does this paper attempt to address?

A Perfect Load Balancing Algorithm on Cube-Connected Cycles

Gene Eu Jan,Shao-Wei Leu,Cheng-Hung Li,Xiaoshe Dong

2006-01-01

Abstract:A simple yet efficient algorithm was presented by Jan and Huang recently to distribute loads evenly on multiprocessor computers with hypercube interconnection networks. That algorithm was developed based on the well-known dimension exchange method. However, the error accumulation suffered by other algorithms based on the dimension exchange method is avoided by exploiting the notion of regular distributions, which are commonly deployed for data distributions in parallel programming. The cube-connected cycles (CCC) proposed by Preparata and Vuillemin are very similar in structure to the hypercube as an efficient general-purpose parallel system for its fixed-degree, and compact and regular layout. In this article, we propose a simple algorithm based on our previous work to distribute loads evenly on cube-connected cycles. This algorithm achieves perfect load balance over P processors with error of 1 and the worst-case time complexity of O(M log2 P), where M is the maximum load assigned to each processor initially. More importantly, it could achieve perfect load balance over subcubes as well --.if the cube is decomposed into two subcubes by bit 0, then the difference between the numbers of the total tasks in the subcubes is at most 1.
Maximizing the Throughput of Parallel Jobs on Hypercubes

Deshi Ye,Guochuan Zhang

DOI: https://doi.org/10.1016/j.ipl.2007.01.005

IF: 0.851

2007-01-01

Information Processing Letters

Abstract:We study a problem of scheduling n independent parallel jobs on hypercubes. A parallel job is required to be scheduled on a subcube of processors. All jobs are available at the beginning, each of which is associated with a due date. The objective is to maximize the total number of early jobs. We provide an optimal polynomial time algorithm for the unit processing time job system.
New Globally Adaptive Load-Balanced Routing Algorithm for K-Ary N-Cubes

WANG Hong,XU Du,LI Le-min

2007-01-01

Abstract:Routing is one of the key issues in the researches of k-ary n-cubes, and globally adaptive load-balanced routing can provide high throughput on various traffic patterns. A new detection-based scheme was proposed to handle routing deadlock, which was efficient and easy to implement. A globally adaptive load-balanced routing algorithm adopting this scheme was also put forward, which has higher routing adaptability than previously published algorithms. Simulation results demonstrate that the throughput of this algorithm exceeds that of the previously published algorithms by 18% on benign traffic pattern, and by 10%～24% on adversarial traffic patterns.
Locality-Preserving Randomized Multicast Routing on K-Ary N-Cube

Ting Zhou,Youjian Zhao,Zhenhua Liu,Xiaoping Zhang

2009-01-01

Abstract:With the growth of interest in multicast communication networks, the importance of routing techniques for multicast connections is being emphasized. In this paper, we propose a new multicast algorithm for a k-ary n-cube network,the Randomized Local Balance Multicast (RLBM) that outperforms unicast-based multicast routing scheme. Simulation results show that if choosing the proper threshold, the RLBM performs very well under different conditions with lower average delay and higher saturation throughput.
Load scheduling for distributed edge computing: A communication-computation tradeoff

Minghui Zhao,Wei Wang,Yitu Wang,Zhaoyang Zhang

DOI: https://doi.org/10.1007/s12083-018-0695-4

IF: 3.488

2018-01-01

Peer-to-Peer Networking and Applications

Abstract:Due to the intensive computation requirements of emerging applications and the limited computational capability of edge computing servers, the computation task must be executed on multiple edge servers in a distributive and cooperative manner. However, the large amount of information exchanged among the edge servers is a major obstacle for improving the computing performance. By utilizing the excess computational resource, coded MapReduce provides an effective approach to reduce the communication load. In this paper, we develop a stochastic load scheduling framework to complete the computation tasks with coded MapReduce considering the intrinsic tradeoff between the communication and computation loads. Our goal is to minimize the communication load under time-varying excess computational resources. We first reduce this problem to a task scheduling problem by exploiting the property of the computing repetition in the coded MapReduce framework. Since the task scheduling problem is still a stochastic optimization problem, it is generally difficult to solve. In the offline setting, we obtain the optimal computation load scheduling algorithm by adopting the augmented Lagrangian method. In the online setting, we derive a worst-case performance bound of the online equal task scheduling (ETS) algorithm by using competitive analysis. Furthermore, we make full use of past state information of computing resources for pre-planing and propose an improved algorithm based on the ETS algorithm in a learning manner. Finally, our proposed algorithm is evaluated by simulation to demonstrate that the proposed algorithms are superior over the conventional algorithms, and the performance gap between the online and offline algorithms is fairly small.
A Heuristic Algorithm for Cube Packing with Time Schedule

Wei Li,WenQi Huang,DongChen Jiang,XiangLong Liu

DOI: https://doi.org/10.1007/s11432-010-0022-z

2010-01-01

Science China Information Sciences

Abstract:Packing problem has been proved to be an NP-hard problem. Many algorithms such as simulation annealing algorithm, genetic algorithm and other heuristic algorithms have been proposed to solve two-dimensional and three-dimensional packing problem. To solve the cube packing problem with time schedule, this paper first introduces some concepts such as packing level, space distance and average neighbor birth order and then proposes a greedy algorithm. The algorithm tries every feasible corner greedily to calculate the space utilization, packing level, space distance, average neighbor birth order of this placement, and chooses the best placement according to these criteria. Theoretical analysis indicates that the time complexity of this algorithm is O(A 2 B 2 C 2 T 2 n 5). The experiments show that the average space utilization of non-guillotine cutting test cases is 98.81%, and the average space utilization of guillotine cutting test cases achieves 99.87%. Furthermore, optimal solutions of more than half cases are achieved by this algorithm. The experimental results show that this algorithm can solve the problem of cube packing with time schedule effectively and efficiently.
Balancing indivisible real-valued loads in arbitrary networks

Omer Demirel,Ivo F. Sbalzarini

DOI: https://doi.org/10.48550/arXiv.1308.0148

2013-08-01

Abstract:In parallel computing, a problem is divided into a set of smaller tasks that are distributed across multiple processing elements. Balancing the load of the processing elements is key to achieving good performance and scalability. If the computational costs of the individual tasks vary over time in an unpredictable way, dynamic load balancing aims at migrating them between processing elements so as to maintain load balance. During dynamic load balancing, the tasks amount to indivisible work packets with a real-valued cost. For this case of indivisible, real- valued loads, we analyze the balancing circuit model, a local dynamic load-balancing scheme that does not require global communication. We extend previous analyses to the present case and provide a probabilistic bound for the achievable load balance. Based on an analogy with the offline balls-into-bins problem, we further propose a novel algorithm for dynamic balancing of indivisible, real-valued loads. We benchmark the proposed algorithm in numerical experiments and compare it with the classical greedy algorithm, both in terms of solution quality and communication cost. We find that the increased communication cost of the proposed algorithm is compensated by a higher solution quality, leading on average to about an order of magnitude gain in overall performance.

Distributed, Parallel, and Cluster Computing
An Algorithm for Coscheduling Tasks on Network of Heterogeneous Workstations

YH Wu,XD Lu,ZY Zeng

DOI: https://doi.org/10.1109/icapp.2002.1173558

2002-01-01

Abstract:An algorithm is proposed, which solves cooperative concurrent computing tasks by using the idle cycle of a number of high performance heterogeneous workstations interconnected by a high-speed network. In order to get better parallel computation performance, this paper gives a model and an algorithm of task scheduling among heterogeneous workstations, in which the costs of loading data, computing, communication and collecting results are considered. Using this efficient algorithm, an optimal subset of heterogeneous workstations with the shortest parallel execution time of tasks can be selected.
A Dynamic Load Balancing Algorithm for Distributing Mobile Codes in Multi-Applications and Multi-Hosts Environment

Nevin Vunka Jungum,Nawaz Mohamudally,Nimal Nissanke

DOI: https://doi.org/10.5281/zenodo.3991567

2020-08-28

Abstract:Code offloading refers to partitioning software and migrating the mobile codes to other computational entities for processing. Often when a large number of mobile codes need to be distributed to many heterogenous hosts, this can easily lead to poor system performance if one host gets too many mobile codes to process while others are almost idle. To resolve such situation, we proposed a proposed a load balancing algorithm to ensure fairness in the distribution of the mobile codes. The algorithm is based on the popular Weighted Least-Connections (WLC) scheduling algorithm while taking into consideration the dynamic recalculation of the hosts weights and system attributes such as CPU idle rate and memory idle rate which the WLC algorithm does not take into consideration. Using simulation, various number of mobile codes were distributed to the hosts/servers and the proposed algorithm outperform existing Least-Connections and Weighted Least-Connections scheduling algorithms thus improving system efficiency.

Distributed, Parallel, and Cluster Computing
Optimization Algorithm for Divisible Load Scheduling on Heterogeneous Star Networks.

Xiaoli Wang,Yuping Wang,Kun Meng

DOI: https://doi.org/10.4304/jsw.9.7.1757-1766

2014-01-01

Abstract:Scheduling divisible loads on heterogeneous distributed computing systems is addressed in this paper. The platform considered here is more general and realistic, where processors are connected in star topology with arbitrary communication and computation speeds and non- zero start-up overheads. A new optimization algorithm, called WX-GA, is proposed to tackle the following four issues: (1) How many processors are needed in computation? (2) Finding the optimal distribution sequence among processors. (3) How much the load fraction should be assigned on each processor? (4) When workload is large enough, what is the sufficient and necessary condition for the minimum processing time? Finally, the experimental results indicate the efficiency and effectiveness of the proposed algorithm.
A Content-based Load-balancing Algorithm of Web Cluster

任彦琦,彭勤科,胡保生

DOI: https://doi.org/10.3969/j.issn.1000-3428.2005.02.046

2005-01-01

Abstract:This paper presents a content-based load-balancing algorithm, and studies on the following two questions. First, the nodes load by thre variables, the node weight, connection numbers and the requested contents length are measured. Second, a feedback is brought in, to balance the load mor optimization . The weight of each node interval is adjusted according to the real load of each node.
Optimal Divisible Load Scheduling for Resource-Sharing Network

Fei Wu,Yang Cao,Thomas Robertazzi

DOI: https://doi.org/10.48550/arXiv.1902.01898

2019-02-06

Abstract:Scheduling is an important task allowing parallel systems to perform efficiently and reliably. For modern computation systems, divisible load is a special type of data which can be divided into arbitrary sizes and independently processed in parallel. Such loads are commonly encountered in applications which are processing a great amount of similar data units. For a multi-task processor, the processor's speed may be time-varying due to the arrival and departure of other background jobs. This paper studies an optimal divisible loads scheduling problem on a single level tree network, whose processing speeds and channel speeds are time-varying. Two recursive algorithms are provided to solve this problem when the arrival and departure times of the background jobs are known a priori and an iterative algorithm is provided to solve the case where such times are not known. Numerical tests and evaluations are performed for these three algorithms under different numbers of background jobs and processors.

Distributed, Parallel, and Cluster Computing
A Novel Aco-Based Multicast Path Algorithm in Hypercube Networks.

Hongwei Wang,Zhibo Wu,Xiaozong Yang,Hongwei Liu

DOI: https://doi.org/10.1080/10798587.2011.10643168

2011-01-01

Abstract:This paper proposes an ACO (ant colony optimization)-based multicast path algorithm (AMPA) to reduce the multicast communication traffic in hypercube networks. According to the high regularity of hypercube networks, an optimized distributed algorithm (Opt-AMPA) for AMPA is proposed by clustering strategy, whose time cost can fill the requirements of the actual networks. The simulation results indicate that effectiveness of the algorithm can be improved drastically using Opt-AMPA.
Coded Load Balancing in Cache Networks

Mahdi Jafari Siavoshani,Farzad Parvaresh,Ali Pourmiri,Seyed Pooya Shariatpanahi

DOI: https://doi.org/10.48550/arXiv.1707.09757

2019-08-04

Abstract:We consider load balancing problem in a cache network consisting of storage-enabled servers forming a distributed content delivery scenario. Previously proposed load balancing solutions cannot perfectly balance out requests among servers, which is a critical issue in practical networks. Therefore, in this paper, we investigate a coded cache content placement where coded chunks of original files are stored in servers based on the files popularity distribution. In our scheme, upon each request arrival at the delivery phase, by dispatching enough coded chunks to the request origin from the nearest servers, the requested file can be decoded. Here, we show that if $n$ requests arrive randomly at $n$ servers, the proposed scheme results in the maximum load of $O(1)$ in the network. This result is shown to be valid under various assumptions for the underlying network topology. Our results should be compared to the maximum load of two baseline schemes, namely, nearest replica and power of two choices strategies, which are $\Theta(\log n)$ and $\Theta(\log \log n)$, respectively. This finding shows that using coding, results in a considerable load balancing performance improvement, without compromising communications cost performance. This is confirmed by performing extensive simulation results, in non-asymptotic regimes as well.

Information Theory,Data Structures and Algorithms,Networking and Internet Architecture
A novel load balance algorithm for cloud computing

Linlin Tang,Jeng-Shyang Pan,Yuanyuan Hu,Pingfei Ren,Yu Tian,Hongnan Zhao

DOI: https://doi.org/10.1007/978-3-319-23207-2_3

2016-01-01

Abstract:A good scheduling algorithm is a key for load balance system, in which system__ load meets users_ requirement. Here, a new load balance algorithm based on swarm intelligence is proposed which can enhance the production of the systems while schedule tasks to VMs properly. Here tasks completion time is compared with some other classical algorithms. The result shows that the proposed algorithm could meet users_ requirement and get resource utilization higher. The algorithm is better for network of a large area which is simulated by CloudSim. © Springer International Publishing Switzerland 2016.
An Online Load Balancing Scheduling Algorithm for Cloud Data Centers Considering Real-Time Multi-Dimensional Resource

Minxian Xu,Wenhong Tian

DOI: https://doi.org/10.1109/ccis.2012.6664409

2012-01-01

Abstract:In general, load-balance scheduling is NP-hard problem as proved in many open literatures. We introduce an online load balancing resource scheduling algorithm (OLRSA) for Cloud datacenters considering real-time and multi-dimensional resources. Unlike traditional load balance scheduling algorithms which often consider only one factor such as the CPU load in physical servers, OLRSA treats CPU, memory and network bandwidth integrated for both physical machines and virtual machines. We develop and apply integrated measurement for each server and a Cloud datacenter. Simulation results show that OLRSA has better performance than a few related load-balancing algorithms with regard to total imbalance level, makespan, as well as overall load efficiency.
An Optimal Locality-Aware Task Scheduling Algorithm Based on Bipartite Graph Modelling for Spark Applications

Zhongming Fu,Zhuo Tang,Li Yang,Chubo Liu

DOI: https://doi.org/10.1109/tpds.2020.2992073

IF: 5.3

2020-10-01

IEEE Transactions on Parallel and Distributed Systems

Abstract:In the distributed computing framework of Spark, cross-node/rack data transfer produced by map tasks and reduce tasks are common problems resulting in performance degradation, such as prolonging of entire execution time and network congestion. To address these problems, this article utilizes the bipartite graph modelling to propose an optimal locality-aware task scheduling algorithm. By considering global optimality, the algorithm can generate the optimal scheduling solution for both the map tasks and the reduce tasks for data locality. Because of the different communication modes, this article uses a unified graph to model the map task scheduling and the reduce task scheduling respectively. Then, by calculating the communication cost matrix of tasks, we formulate an optimal task scheduling scheme to minimize overall communication cost and transform the problem as the well-known graph problem: minimum weighted bipartite matching (MWBM), which can be resolved by Kuhn-Munkres algorithm. In addition, this article proposes a locality-aware executor allocation strategy to improve the data locality further. We implement our algorithm and strategy in Spark-2.4.1 and evaluate its performance using several representative micro-benchmarks, macro-benchmarks, and HiBench benchmark suite. The experimental results verify that by reducing the network traffic and access latency, the proposed algorithm can improve the job performance substantially compared to some other task scheduling algorithms.

computer science, theory & methods,engineering, electrical & electronic
Storage, Communication, and Load Balancing Trade-off in Distributed Cache Networks

Mahdi Jafari Siavoshani,Ali Pourmiri,Seyed Pooya Shariatpanahi

DOI: https://doi.org/10.48550/arXiv.1706.10209

2017-06-30

Abstract:We consider load balancing in a network of caching servers delivering contents to end users. Randomized load balancing via the so-called power of two choices is a well-known approach in parallel and distributed systems. In this framework, we investigate the tension between storage resources, communication cost, and load balancing performance. To this end, we propose a randomized load balancing scheme which simultaneously considers cache size limitation and proximity in the server redirection process. In contrast to the classical power of two choices setup, since the memory limitation and the proximity constraint cause correlation in the server selection process, we may not benefit from the power of two choices. However, we prove that in certain regimes of problem parameters, our scheme results in the maximum load of order $\Theta(\log\log n)$ (here $n$ is the network size). This is an exponential improvement compared to the scheme which assigns each request to the nearest available replica. Interestingly, the extra communication cost incurred by our proposed scheme, compared to the nearest replica strategy, is small. Furthermore, our extensive simulations show that the trade-off trend does not depend on the network topology and library popularity profile details.

Information Theory,Distributed, Parallel, and Cluster Computing,Data Structures and Algorithms,Networking and Internet Architecture
A novel multi-level hybrid load balancing and tasks scheduling algorithm for cloud computing environment

Nadim Elsakaan,Kamal Amroun

DOI: https://doi.org/10.1007/s11227-024-05990-5

IF: 3.3

2024-03-08

The Journal of Supercomputing

Abstract:Ensuring optimal load balancing is imperative for maintaining reliability and upholding quality of service as specified in service-level agreements (SLAs) for cloud computing providers. This research addresses the most common shortcomings of existing state-of-the-art methods, which often lack responsiveness and struggle to adapt to exponentially increasing demand, especially in the era of the internet of things (IoT). The proposed hybrid approach surpasses current literature approaches in performance metrics such as makespan, response time, number of cloudlet migrations, and SLA violations. It operates on two levels, initially employing a k-means clustering algorithm to group servers within each datacenter based on similar utilization rates. Subsequently, a round-robin method allocates task groups sequentially to non-overloaded clusters, and within each cluster, a genetic algorithm optimally assigns tasks to servers. This multilayered approach facilitates hot-deployment and scalability in operational cloud environments while promoting strong interoperability and decoupling of core mechanisms missions. Simulation experiments conducted on CloudSim Plus validate the superiority of our method, positioning it as a robust solution for enhancing load balancing and tasks scheduling in cloud environments, especially in the face of rapidly increasing IoT-related demands.

computer science, theory & methods,engineering, electrical & electronic, hardware & architecture
Cloud Loading Balance Algorithm

Zhang Bo,Gao Ji,Ai Jieqing

DOI: https://doi.org/10.1109/icise.2010.5688910

2010-01-01

Abstract:Currently, there are many algorithms used to balance the task of Cluser-servers, but not sufficiently take into account common method of heterogeneous servers and real-time load condition in each servers; In cloud computing environment, these algorithms don't adequately consider the loade-balacing in the environment of heterogeneous cloud. The paper proposed a Cloud Loading Balance algorithm, adding capacity to the dynamic balance mechanism for the cloud. The experiments demonstrate: the algorithm is obtains better load-balancing degree and using less time in loading all tasks.

A Load-Balancing Algorithm for N-cubes

A Perfect Load Balancing Algorithm on Cube-Connected Cycles

Maximizing the Throughput of Parallel Jobs on Hypercubes

New Globally Adaptive Load-Balanced Routing Algorithm for K-Ary N-Cubes

Locality-Preserving Randomized Multicast Routing on K-Ary N-Cube

Load scheduling for distributed edge computing: A communication-computation tradeoff

A Heuristic Algorithm for Cube Packing with Time Schedule

Balancing indivisible real-valued loads in arbitrary networks

An Algorithm for Coscheduling Tasks on Network of Heterogeneous Workstations

A Dynamic Load Balancing Algorithm for Distributing Mobile Codes in Multi-Applications and Multi-Hosts Environment

Optimization Algorithm for Divisible Load Scheduling on Heterogeneous Star Networks.

A Content-based Load-balancing Algorithm of Web Cluster

Optimal Divisible Load Scheduling for Resource-Sharing Network

A Novel Aco-Based Multicast Path Algorithm in Hypercube Networks.

Coded Load Balancing in Cache Networks

A novel load balance algorithm for cloud computing

An Online Load Balancing Scheduling Algorithm for Cloud Data Centers Considering Real-Time Multi-Dimensional Resource

An Optimal Locality-Aware Task Scheduling Algorithm Based on Bipartite Graph Modelling for Spark Applications

Storage, Communication, and Load Balancing Trade-off in Distributed Cache Networks

A novel multi-level hybrid load balancing and tasks scheduling algorithm for cloud computing environment

Cloud Loading Balance Algorithm