Abstract:This paper tackles the problem of parallelizing heterogeneous computational tasks across a number of computational nodes (aka agents) where each agent may not be able to perform all the tasks and may have different computational speeds. An equivalent problem can be found in operations research, and it is known as scheduling tasks on unrelated parallel machines (also known as R∥Cmax). Given this equivalence observation, we present the spanning tree decentralized task distribution algorithm (ST-DTDA), the first decentralized solution to R∥Cmax. ST-DTDA achieves decomposition by means of the min–max algorithm, a member of the generalized distributive law family, that performs inference by message-passing along the edges of a graphical model (known as a junction tree). Specifically, ST-DTDA uses min–max to optimally solve an approximation of the original R∥Cmax problem that results from eliminating possible agent-task allocations until it is mapped into an acyclic structure. To eliminate those allocations that are least likely to have an impact on the solution quality, ST-DTDA uses a heuristic approach. Moreover, ST-DTDA provides a per-instance approximation ratio that guarantees that the makespan of its solution (optimal in the approximated R∥Cmax problem) is not more than a factor ρ times the makespan of the optimal of the original problem. In our empirical evaluation of ST-DTDA, we show that ST-DTDA, with a min-regret heuristic, converges to solutions that are between 78 and 95% optimal whilst providing approximation ratios lower than 3.

Efficient routing and message bounds for optimal parallel algorithms

RANDOMIZED OPTIMAL LIST RANKING ON COARSE-GRAINED PARALLEL COMPUTERS WITH O(log P) COMMUNICATION PHASES

Experimental Results on Minimizing Communication Phases on Networked Multicomputers

Competitive Implementation of Parallel Programs

Efficient Parallel Algorithms on Optically Interconnected Arrays of Processors

A Fast and Efficient Global Router for Congestion Optimization

Dual Decomposition Method for Optimal and Fair Congestion Control in Ad Hoc Networks: Algorithm, Implementation and Evaluation

LightGraph: Lighten Communication in Distributed Graph-Parallel Processing

Towards Serial-Equivalent Parallel Routing for FPGAs: (abstract Only).

Cost-aware Defense for Parallel Server Systems against Reliability and Security Failures

A Parallel Router Based on Load-Balanced Region Partition Strategy

Efficient Multi-Processor Scheduling in Increasingly Realistic Models

Optimal Graph Algorithms on Wormhole Routed 2D Meshes

Integrated optimization scheme in parallelizing compilers

A Message-Passing Approach to Decentralized Parallel Machine Scheduling

Parallel and (Nearly) Work-Efficient Dynamic Programming

of ML and PARLOG Programs on Multicomputers

A Parallel FPGA Wiring Algorithm Based on Nets Partition

Parallel Dynamic Spt Update Algorithm In Ospf

Efficient Offline Algorithmic Techniques for Several Packet Routing Problems in Distributed Systems

Efficient RDMA Communication Protocols