Abstract:Due to the intensive computation requirements of emerging applications and the limited computational capability of edge computing servers, the computation task must be executed on multiple edge servers in a distributive and cooperative manner. However, the large amount of information exchanged among the edge servers is a major obstacle for improving the computing performance. By utilizing the excess computational resource, coded MapReduce provides an effective approach to reduce the communication load. In this paper, we develop a stochastic load scheduling framework to complete the computation tasks with coded MapReduce considering the intrinsic tradeoff between the communication and computation loads. Our goal is to minimize the communication load under time-varying excess computational resources. We first reduce this problem to a task scheduling problem by exploiting the property of the computing repetition in the coded MapReduce framework. Since the task scheduling problem is still a stochastic optimization problem, it is generally difficult to solve. In the offline setting, we obtain the optimal computation load scheduling algorithm by adopting the augmented Lagrangian method. In the online setting, we derive a worst-case performance bound of the online equal task scheduling (ETS) algorithm by using competitive analysis. Furthermore, we make full use of past state information of computing resources for pre-planing and propose an improved algorithm based on the ETS algorithm in a learning manner. Finally, our proposed algorithm is evaluated by simulation to demonstrate that the proposed algorithms are superior over the conventional algorithms, and the performance gap between the online and offline algorithms is fairly small.

Dynamic and online task scheduling algorithm based on virtual compute group in many-core architecture

On-line Scheduling of Multi-Core Processor Tasks with Virtualization.

A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

Efficient Consolidation-Aware VCPU Scheduling on Multicore Virtualization Platform.

Tasks mapping in multi-core based system: hybrid ACO&GA approach

Communication-aware task scheduling for multi-core architectures with segmented buses

WCRT Optimization Scheme Based on Task Mapping and Cache Partitioning

Genetic Programming for Dynamic Workflow Scheduling in Fog Computing

Load scheduling for distributed edge computing: A communication-computation tradeoff

A heuristic-based hybrid genetic-variable neighborhood search algorithm for task scheduling in heterogeneous multiprocessor system

A Dynamic Task Scheduling Method in Cluster of Workstations

An Efficient Power-Aware Optimization for Task Scheduling on NoC-based Many-core System

Task scheduling based on swarm intelligence algorithms in high performance computing environment

Hypergraph-partitioning-based online joint scheduling of tasks and data

A Scheduling Algorithm Based on Task Complexity Estimating for Many-Task Computing.

Hardware /software task partitioning and scheduling algorithm on multi-core system on chip with reconfigurable hardware

A heuristic method for data allocation and task scheduling on heterogeneous multiprocessor systems under memory constraints

An Efficient Task Mapping Algorithm with Power-Aware Optimization for Network on Chip

Task Mapping with Cache Reconfiguration and Partitioning for Energy Minimization on Real-Time Multicores

A Multicore Scheduling Algorithm Considering Cache Warm-Up Overheads

A Self-Adaptive Workload Balancing Algorithm on Gpu Clusters