Efficient Randomized Load Distribution for Tree Structured Computations on Parallel and Distributed Computer Systems

KQ Li
DOI: https://doi.org/10.1080/00207169908804790
1999-01-01
Abstract:High performance parallel and distributed computing requires high quality dynamic load distribution of processes of a parallel application over processors in a parallel or a distributed computer system at runtime such that the maximum load on a processor is minimized. A simple randomized load distribution algorithm for tree structured parallel computations is studied in this paper. We analyze the average-case performance of the dynamic and randomized tree node distribution algorithm using recurrence relations that characterize expected loads on processors. Closed form solutions to these recurrence relations are also derived. Our analytical as well as numerical data show that the load distribution algorithm performs very well.
What problem does this paper attempt to address?