The Load Balancing Problem

ZHANG Guochuan,CHEN Lin

DOI: https://doi.org/10.1109/icsmc.1999.814192

1999-01-01

Abstract:This paper studies the load balancing problem for distributed computer systems. A load balancing algorithm is proposed to solve the problem. The algorithm is modeled with Petri nets and using Lyapunov methods a formal proof of stability and convergence is presented. The formulation is shown to be simple and straightforward

What problem does this paper attempt to address?

Distributed Model Based on Data Partition and Load Balance Algorithm

YANG Xiao-hu,WANG Xin-yu,MAO Ming

DOI: https://doi.org/10.3785/j.issn.1008-973x.2008.04.011

2008-01-01

Abstract:Two classical models in distributed environment,symmetrical cluster and unsymmetrical cluster,were introduced.Aiming at the problems in enterprise applications caused by the two models,a distributed model based on data partition was presented,and a new load balance algorithm based on database access was proposed.Two critical threshold values Dmax and VSRT in the algorithm could be obtained by testing and analysis.The model and the load balance mechanism benefit the system with good performance,high scalability and dynamic load balance.They were applied to a financial system which was reengineered from standalone legacy system into J2EE distributed environment.The system architecture based on data partition was implemented successfully and performed very well.
Distributed Load Balancing in Peer-to-Peer Computing

Shan Zhang,Zheng Qin

2004-01-01

Abstract:In this paper, we address the load balancing problem in the context of peer-to-peer computing environments. The key challenge to employ peer-to-peer networks for distributed computing is to exploit the heterogeneous processing capability of the participating hosts as well as the diverse network conditions. The contribution of our work is twofold. First, we model the load balance problem as an optimization problem with the objective of minimizing the system response time. This modeling considers not only the current loading of hosts, but also the fluctuation of network delay, which completely captures the characteristics of the P2P systems. Second, we propose a gradient projection algorithm to solve the optimization problem, which is fully distributed and easy for implementation. Simulation results demonstrate that our scheme has satisfied performance in terms of convergence, response time and load distribution.
Dynamic Load-Balance Model for Web Services

ZHAO Hong,LIN Jian,ZHU Miao-liang

DOI: https://doi.org/10.3969/j.issn.1000-7024.2006.21.047

2006-01-01

Abstract:Web services is a very important technology of internet applications.How to improve its performance is a hotpot.Dynamic load-balance is introduced to web services to augment its fault-tolerance and scalability.The current situation of load-balancing algorithm is reported.Thenecessity of web services load-balance is analyzed,and on thisbasis adynamic load-balance modelisproposed.Methods are presented in the framework to dynamically determine the resource consumption value of services and to adjust the load-thresholds and the weights of servers.Measures are also discussed for overload protection.
Load Balance Optimization with Replication Degree Customization.

Wei Li,Shanping Li,Xingen Wang

DOI: https://doi.org/10.1109/ccis.2011.6045054

2011-01-01

Abstract:The load balance optimization is an important research topic in a replication system, which will affect the performance a lot. Especially in a capacity restricted system, the load balance will be adversely affected by the strategy to replicate the object. In this paper, an algorithm which will calculate the different replication degree based on the popularity and the size of each object to improve the load balance of the system is proposed. The simulation of a cache system shows that the algorithm could. achieve around 50% performance increase compare with, the identical replication degree approach as the system is much more balanced and could process much more requests in a certain time period.
Randomized Algorithm for Virtual Network Mapping Problem Based on Load Balancing

Jian-jun YU,Chun-ming WU

2014-01-01

Computer Science

Abstract:This paper analyzed the existing problems of virtual network mapping(VNM)algorithm based on best-effort service,and pointed out their shortcoming on resource load balancing,and then defined load balancing cost indicator on the physical network,proposed a virtual network mapping randomized algorithm based on load balancing.Experiment shows that the proposed algorithm increases physical network resource load balancing metric and coefficient of utilization,therefore can improve the virtual network construction request acceptance ratio and income profit of physical network service provider.
Deterministic load balancing in computer networks

Xiaotie Deng, Hai-Ning Liu, Bing Xiao

DOI: https://doi.org/10.1109/SPDP.1990.143506

1990-01-01

Abstract:The paper presents theoretical analysis of the deterministic complexity of the load balancing problem (LBP). Because of difficulty of the general problem, research in the area mostly restricts itself to probabilistic or approximation algorithms, or to the average behavior of a network. The paper provides deterministic analysis of the problem for general networks. It focuses on the worst-case complexity analysis of the problem. It shows certain cases of the LBP to be NP-complete. The paper also discusses situations closely related to computer networks, where there is a global view of load distribution in the network; it provides a polynomial algorithm for solving the load balancing problem in this network.
Optimal Load Balancing in Distributed Computer Systems

Hisao Kameda,Jie Li,Chonggun Kim,Yongbing Zhang

DOI: https://doi.org/10.1007/978-1-4471-0969-3

2011-01-01

Abstract:An important consideration in improving the performance of a distributed computer system is the balancing of the load between the host computers. Load balancing may be either static or dynamic; static balancing strategies are generally based on information about the system's average behavior rather than its actual current state, while dynamic strategies react to the current state when making transfer decisions. Although it is often conjectured that dynamic load balancing outperforms static, careful investigation shows that this view is not always valid. Recent research on the problem of optimal static load balancing is clearly and intuitively presented, with coverage of distributed computer system models, problem formulation in load balancing, and effective algorithms for implementing optimization. Providing a thorough understanding of both static and dynamic strategies, this book will be of interest to all researchers and practitioners working to optimize performance in distributed computer systems.
Competitive Analysis of Network Load Balancing

XT Deng,HN Liu,JS Long,B Xiao

DOI: https://doi.org/10.1006/jpdc.1996.1257

IF: 4.542

1997-01-01

Journal of Parallel and Distributed Computing

Abstract:This paper presents a theoretical analysis of the Load Balancing Problem (LBP) in a network of processing units. The performance objective is to minimize the makespan, i.e., the time spent to finish all jobs in a network of processing units. Because of the communication delay that results from the network topology, it is impossible to have a strategy which obtains the exact optimum under all load distributions. Instead, we measure the information efficiency of a load balancing policy by the worst case ratio of the solution (for each load distribution) of a load balancing policy to the optimal solution (for the same load distribution) assuming that processors have complete information about the load distribution over the network. This ratio is called the competitive ratio of this strategy 17, 24, 34]. In particular, a policy is calledcompetitiveif this ratio is bounded by a constant. As a first step, we discuss the centralized LBP, where all the processors have complete information of the load distribution over a network. Its solution serves as a benchmark to compare with realistic strategies, both in theoretical analysis, and experimental and simulational studies of distributed algorithms. We show that when jobs have different sizes, even with preemptive scheduling, LBP is NP?complete. When the jobs are of the same size, we give a polynomial algorithm, using network?flow techniques, which extends to approximate solutions for jobs of different sizes. We apply this benchmark solution in order to analyze the competitiveness for three network topologies: completely connected graphs, rings, and hierarchical completek-ary trees. The constant competitive ratio results for complete network and hierarchical completek-ary trees are applied to a study on the issues of network designs suitable for the LBP. We further discuss the problem for general networks with jobs of different sizes for slightly weaker results than those for the constant competitive ratio requirement. Finally, we comment on the related issues of job partitioning over parallel/distributed systems.
Weight-balancing Algorithm for Distributed Dynamic Networks of Multi-Agent Systems

ZHENG Jun,YAN Wen-jun

DOI: https://doi.org/10.3785/j.issn.1008-973x.2007.12.014

2007-01-01

Abstract:Aimed at the problem that a weighted digraph must be balanced graph for global convergence to the average-consensus,a distributed weight-balancing algorithm was proposed,by using which arbitrary strongly connected weighted digraph could globally asymptotically convergence to balanced graph.The initial weight value for each edge in digraph was firstly given,and the in-degree and out-degree of each node were calculated.Then,the weight values were updated based on the difference between the in-degree and out-degree of neighbor nodes. The weight-updating process was iteratively employed for each node until all nodes were weight balanced.The sufficient condition for consensus convergence of the algorithm was proved,and the upper bound on step-size parameter was presented.Simulation showed the effectiveness of the presented algorithm and the validity of the sufficient condition,and the convergence performance of the algorithm with different step-size parameter was also analyzed.
Balancing indivisible real-valued loads in arbitrary networks

Omer Demirel,Ivo F. Sbalzarini

DOI: https://doi.org/10.48550/arXiv.1308.0148

2013-08-01

Abstract:In parallel computing, a problem is divided into a set of smaller tasks that are distributed across multiple processing elements. Balancing the load of the processing elements is key to achieving good performance and scalability. If the computational costs of the individual tasks vary over time in an unpredictable way, dynamic load balancing aims at migrating them between processing elements so as to maintain load balance. During dynamic load balancing, the tasks amount to indivisible work packets with a real-valued cost. For this case of indivisible, real- valued loads, we analyze the balancing circuit model, a local dynamic load-balancing scheme that does not require global communication. We extend previous analyses to the present case and provide a probabilistic bound for the achievable load balance. Based on an analogy with the offline balls-into-bins problem, we further propose a novel algorithm for dynamic balancing of indivisible, real-valued loads. We benchmark the proposed algorithm in numerical experiments and compare it with the classical greedy algorithm, both in terms of solution quality and communication cost. We find that the increased communication cost of the proposed algorithm is compensated by a higher solution quality, leading on average to about an order of magnitude gain in overall performance.

Distributed, Parallel, and Cluster Computing
Online and offline based load balance algorithm in cloud computing

Linlin Tang,Zuohua Li,Pingfei Ren,Jengshyang Pan,Zheming Lu,Jingyong Su,Zhenyu Meng

DOI: https://doi.org/10.1016/j.knosys.2017.09.040

2017-12-01

Abstract:Cloud Computing (CC) makes it possible for a common user to get an access to large pools of data and computational resources through a variety of interfaces. Among the so many important problems in CC, load balancing technique has been paid more and more attention for its important role. Good load balance algorithms can make whole system run more efficient. A new load balancing method combined with the advantage of online and offline load balancing algorithms are proposed in this paper. Two-choice algorithm and its improvement are used in the online step. Bacteria Foraging Optimization (BFO) and its improvement motivated by Lamarck Evolutionary Theory are introduced in our offline step. Online load balancing uses imperfect information, aiming at finishing tasks as fast as possible; while the offline makes full use of all information to make a supplement. Experiments on the heterogeneous tasks and serving points for computation intensive loads have been used here and the good performance shows the efficiency of our proposed method.

computer science, artificial intelligence
Dynamic Load Balancing Algorithm of Distributed File System

Jianwei Yin

2011-01-01

Abstract:In order to solve load balancing of the distributed file system,I did some research into the load balancing algorithms,and analyzed the advantages and disadvantages of them.Combining static weighted round robin algorithm and dynamic load balancing algorithm,this paper proposed an adaptive,comprehensive dynamic load balancing.It is simple,low cost and effective.After more tests,I found that the algorithm can effectively reduce the average response time and increase throughput.It is better than static weighted round robin algorithm and dynamic load balancing algorithm.
Load Balancing for Distributed Intelligent Edge Computing: A State-Based Game Approach.

Fenghui Zhang,Ruilong Deng,Xinsheng Zhao,Michael Mao Wang

DOI: https://doi.org/10.1109/tccn.2021.3087178

IF: 6.359

2021-01-01

IEEE Transactions on Cognitive Communications and Networking

Abstract:The introduction of artificial intelligence (AI) into edge computing could significantly improve its quality of service. Connecting them into a system can provide services for a wider range. However, due to the mobility of the crowd and mobile devices, the load imbalance issue of these interconnected intelligent edge servers (IESs) will cause severe impacts on their service performance. To this end, we investigate load balancing for the distributed IESs from the game theoretic perspective and propose a state-based distributed learning algorithm. Firstly, by modelling the IES cost as the deviation between its execution time and the system average execution time, we formulate load balancing as a state-based game where each IES competes to maximize its own utility. Secondly, according to the definition of the recurrent state Nash equilibrium, we prove that this game has such an equilibrium by establishing a potential function at each reachable state. Finally, we propose a state-based distributed learning algorithm to obtain the pure Nash equilibrium strategy of each IES. Then, an ordinary differential equation is derived to prove the convergence of the algorithm. In comparison with existing works, our approach could largely improve load balancing for the distributed IESs and thus enhance their service performance.
An Empirical Study and Analysis of the Dynamic Load Balancing Techniques Used in Parallel Computing Systems

Ardhendu Mandal,Subhas Chandra Pal

DOI: https://doi.org/10.48550/arXiv.1109.1650

2011-09-08

Distributed, Parallel, and Cluster Computing

Abstract:A parallel computer system is a collection of processing elements that communicate and cooperate to solve large computational problems efficiently. To achieve this, at first the large computational problem is partitioned into several tasks with different work-loads and then are assigned to the different processing elements for computation. Distribution of the work load is known as Load Balancing. An appropriate distribution of work-loads across the various processing elements is very important as disproportional workloads can eliminate the performance benefit of parallelizing the job. Hence, load balancing on parallel systems is a critical and challenging activity. Load balancing algorithms can be broadly categorized as static or dynamic. Static load balancing algorithms distribute the tasks to processing elements at compile time, while dynamic algorithms bind tasks to processing elements at run time. This paper explains only the different dynamic load balancing techniques in brief used in parallel systems and concluding with the comparative performance analysis result of these algorithms.
Load Balancing in Resource Awareness P2P System

王志伟,张华,高传善

DOI: https://doi.org/10.3778/j.issn.1002-8331.2008.34.034

2008-01-01

Computer Engineering and Applications Journal

Abstract:Considering the load imbalance caused by the distributed management using DHT in P2P system,the simple abstrac-tion of network model is not sufficient to reflect the access status.This paper takes the capacity of nodes,link bandwidth and re-source access into consideration synthetically,and puts forward a resource awareness model,also performs load balancing based on node score sorting.The node ability is measured by above three factors.Resource management is organized in the distributed way dynamically.
Particle Swarm Optimization for Load Balancing in Distributed Computing Systems – A Survey

Vidya S. Handur, Et. al.

DOI: https://doi.org/10.17762/turcomat.v12i1s.1766

2021-04-11

Turkish Journal of Computer and Mathematics Education (TURCOMAT)

Abstract:Development of technology like Cloud Computing and its widespread usage has given rise to exponential increase in the volume of traffic. With this increase in huge traffic the resources in the network would either be insufficient to handle the traffic or the situation may cause some of the resources to be over utilized or underutilized. This condition leads to reduced performance of the system. To improve the performance of the system the traffic requires to be regulated such that all the resources are utilized conferring to their capacity which is known as load balancing. Load balancing has been one of the concerns in the distributed computing systems where the computing nodes do not have a global view of the network. There have been constant efforts to provide an efficient solution for load balancing through the approaches like game theory, fuzzy logic, heuristics and metaheuristics. Even though various solutions exist for balancing the load, the issue is challenging as there does not exist one best fit solution. The paper aims at the study of how Particle Swarm Optimization approach is used to achieve an optimal solution for load balancing in distributed computing system.
Scalable Load Balancing Algorithms in Networked Systems

Debankur Mukherjee

DOI: https://doi.org/10.48550/arXiv.1809.02018

2018-09-06

Abstract:A fundamental challenge in large-scale networked systems viz., data centers and cloud networks is to distribute tasks to a pool of servers, using minimal instantaneous state information, while providing excellent delay performance. In this thesis we design and analyze load balancing algorithms that aim to achieve a highly efficient distribution of tasks, optimize server utilization, and minimize communication overhead.

Probability,Performance
Study and Design of Dynamic Load Balancing in Hybrid Honeynet

Ronggui Hu,Jaolong Zeng,Haijun Huang,Jianjun Xia

DOI: https://doi.org/10.1109/imccc.2011.59

2011-01-01

Abstract:For the load non-balancing phenomenon in hybrid honey net and the serious aftereffects brought, the correlative concepts of dynamic load balancing in hybrid honey net have been presented, the architecture of hybrid honey net which has the dynamic load balancing mechanism has been advanced, and the corresponding dynamic load balancing algorithm has been designed. In the end, the experiments have shown that the algorithm is feasible and effective.
Load Balancing and Network Topology Segmentation Algorithm for CDN Content Routing

WANG Juan,ZHAO Wen-dao

DOI: https://doi.org/10.3969/j.issn.1671-7147.2005.01.002

2005-01-01

Abstract:In order to provide the best content service to users, CDN (Content Distribution / Delivery Network) technology comes into being. The implementation of CDN relies on many kinds of technologies. For example, load balancing is such an important technology. The paper adds the load balancing management to the above two algorithms to achieve network proximity which are mentioned in reference 4, to analyze servers’ load before and after load balancing management and to compare the performance. The paper also pat forward the idea about network tree and gives the algorithm about how to divide the network.
Reinforced Workload Distribution Fairness

Zhiyuan Yao,Zihan Ding,Thomas Heide Clausen

DOI: https://doi.org/10.48550/arXiv.2111.00008

2021-10-29

Abstract:Network load balancers are central components in data centers, that distributes workloads across multiple servers and thereby contribute to offering scalable services. However, when load balancers operate in dynamic environments with limited monitoring of application server loads, they rely on heuristic algorithms that require manual configurations for fairness and performance. To alleviate that, this paper proposes a distributed asynchronous reinforcement learning mechanism to-with no active load balancer state monitoring and limited network observations-improve the fairness of the workload distribution achieved by a load balancer. The performance of proposed mechanism is evaluated and compared with stateof-the-art load balancing algorithms in a simulator, under configurations with progressively increasing complexities. Preliminary results show promise in RLbased load balancing algorithms, and identify additional challenges and future research directions, including reward function design and model scalability.

Distributed, Parallel, and Cluster Computing,Artificial Intelligence,Networking and Internet Architecture

The Load Balancing Problem

Distributed Model Based on Data Partition and Load Balance Algorithm

Distributed Load Balancing in Peer-to-Peer Computing

Dynamic Load-Balance Model for Web Services

Load Balance Optimization with Replication Degree Customization.

Randomized Algorithm for Virtual Network Mapping Problem Based on Load Balancing

Deterministic load balancing in computer networks

Optimal Load Balancing in Distributed Computer Systems

Competitive Analysis of Network Load Balancing

Weight-balancing Algorithm for Distributed Dynamic Networks of Multi-Agent Systems

Balancing indivisible real-valued loads in arbitrary networks

Online and offline based load balance algorithm in cloud computing

Dynamic Load Balancing Algorithm of Distributed File System

Load Balancing for Distributed Intelligent Edge Computing: A State-Based Game Approach.

An Empirical Study and Analysis of the Dynamic Load Balancing Techniques Used in Parallel Computing Systems

Load Balancing in Resource Awareness P2P System

Particle Swarm Optimization for Load Balancing in Distributed Computing Systems – A Survey

Scalable Load Balancing Algorithms in Networked Systems

Study and Design of Dynamic Load Balancing in Hybrid Honeynet

Load Balancing and Network Topology Segmentation Algorithm for CDN Content Routing

Reinforced Workload Distribution Fairness