Abstract:Due to the intensive computation requirements of emerging applications and the limited computational capability of edge computing servers, the computation task must be executed on multiple edge servers in a distributive and cooperative manner. However, the large amount of information exchanged among the edge servers is a major obstacle for improving the computing performance. By utilizing the excess computational resource, coded MapReduce provides an effective approach to reduce the communication load. In this paper, we develop a stochastic load scheduling framework to complete the computation tasks with coded MapReduce considering the intrinsic tradeoff between the communication and computation loads. Our goal is to minimize the communication load under time-varying excess computational resources. We first reduce this problem to a task scheduling problem by exploiting the property of the computing repetition in the coded MapReduce framework. Since the task scheduling problem is still a stochastic optimization problem, it is generally difficult to solve. In the offline setting, we obtain the optimal computation load scheduling algorithm by adopting the augmented Lagrangian method. In the online setting, we derive a worst-case performance bound of the online equal task scheduling (ETS) algorithm by using competitive analysis. Furthermore, we make full use of past state information of computing resources for pre-planing and propose an improved algorithm based on the ETS algorithm in a learning manner. Finally, our proposed algorithm is evaluated by simulation to demonstrate that the proposed algorithms are superior over the conventional algorithms, and the performance gap between the online and offline algorithms is fairly small.

Optimization Algorithm for Divisible Load Scheduling on Heterogeneous Star Networks.

New Model and Genetic Algorithm for Divisible Load Scheduling in Heterogeneous Distributed Systems

Optimal semi-online scheduling algorithms on a small number of machines

Divisible-Load Scheduling for Network-Based Computing Systems with Processor Startup Overheads and Release Times.

A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

Distributed Scheduling Strategies for Processing Multiple Divisible Loads with Unknown Network Resources

Optimal Divisible Load Scheduling for Resource-Sharing Network

Maximizing Heterogeneous Server Utilization with Limited Availability Times for Divisible Loads Scheduling on Networked Systems

Real-time divisible load scheduling algorithm on heterogeneous bus networks

Off-Line Time Aware Divisible-Load Scheduling Optimization Model

An Optimization Model for Divisible-Load Scheduling Considering Processor Time-Window

A Bilevel Decomposition Approach for Many Homogeneous Computing Tasks Scheduling in Software-Defined Industrial Networks

Multi-objective Scheduling for Divisible Load in Heterogeneous Distributed System.

Cost-Efficient Divisible Load Scheduling Using Genetic Algorithm.

Load scheduling for distributed edge computing: A communication-computation tradeoff

Scheduling Divisible Loads in Gaussian, Mesh and Torus Network of Processors

Scheduling Energy-Conscious Tasks in Distributed Heterogeneous Computing Systems

A distributed scheduling strategy for multiple divisible loads with unknown network resources

Release time aware divisible-load scheduling optimization model

Scheduling Framework and Algorithms for Large-Scale Divisible Load Processing with Multi-Dimensional QoS Constraints

A New Genetic Algorithm for Release-Time Aware Divisible-Load Scheduling