Abstract:Due to the intensive computation requirements of emerging applications and the limited computational capability of edge computing servers, the computation task must be executed on multiple edge servers in a distributive and cooperative manner. However, the large amount of information exchanged among the edge servers is a major obstacle for improving the computing performance. By utilizing the excess computational resource, coded MapReduce provides an effective approach to reduce the communication load. In this paper, we develop a stochastic load scheduling framework to complete the computation tasks with coded MapReduce considering the intrinsic tradeoff between the communication and computation loads. Our goal is to minimize the communication load under time-varying excess computational resources. We first reduce this problem to a task scheduling problem by exploiting the property of the computing repetition in the coded MapReduce framework. Since the task scheduling problem is still a stochastic optimization problem, it is generally difficult to solve. In the offline setting, we obtain the optimal computation load scheduling algorithm by adopting the augmented Lagrangian method. In the online setting, we derive a worst-case performance bound of the online equal task scheduling (ETS) algorithm by using competitive analysis. Furthermore, we make full use of past state information of computing resources for pre-planing and propose an improved algorithm based on the ETS algorithm in a learning manner. Finally, our proposed algorithm is evaluated by simulation to demonstrate that the proposed algorithms are superior over the conventional algorithms, and the performance gap between the online and offline algorithms is fairly small.

Message scheduling for array re-decomposition on distributed memory systems

A parallel computing method for irregular work

Contention-Free Communication Scheduling For Group Communication In Data Parallelism

Load scheduling for distributed edge computing: A communication-computation tradeoff

Communication-Efficient Task Scheduling for Real-Time Distributed Computing.

Communication-Efficient Computation Load Scheduling for Edge Computing Systems

Optimizing Scheduling Technology for Clustered VLIW Architectures Using Data Dependence Graph

Algorithm for hardware/software task partitioning and scheduling on reconfigurable computing platform

Fast On-Line Real-Time Scheduling Algorithm for Reconfigurable Computing.

Communication-aware task scheduling for multi-core architectures with segmented buses

The Design and Implementation of Adaptive Reconfigurable Computing Array

Optimizing Inter-Cluster Data Communications Through Optimized Backward Rescheduling

An Affine Partition Algorithm Based on Representative Element

Compile-Time Scheduling Of Multithread With Data Localities On Multiple Vector Processors

Measuring and Optimizing Distributed Array Programs

On-line Scheduling of Real-Time Tasks for Reconfigurable Computing System

Efficient routing and message bounds for optimal parallel algorithms

Enhanced Parallel Application Scheduling Algorithm with Energy Consumption Constraint in Heterogeneous Distributed Systems

An efficient scheduling algorithm for dataflow architecture using loop-pipelining

Resource Partitioning and Application Scheduling with Module Merging on Dynamically and Partially Reconfigurable FPGAs

Memory Partitioning for Parallel Multipattern Data Access in Multiple Data Arrays