Abstract:Due to the intensive computation requirements of emerging applications and the limited computational capability of edge computing servers, the computation task must be executed on multiple edge servers in a distributive and cooperative manner. However, the large amount of information exchanged among the edge servers is a major obstacle for improving the computing performance. By utilizing the excess computational resource, coded MapReduce provides an effective approach to reduce the communication load. In this paper, we develop a stochastic load scheduling framework to complete the computation tasks with coded MapReduce considering the intrinsic tradeoff between the communication and computation loads. Our goal is to minimize the communication load under time-varying excess computational resources. We first reduce this problem to a task scheduling problem by exploiting the property of the computing repetition in the coded MapReduce framework. Since the task scheduling problem is still a stochastic optimization problem, it is generally difficult to solve. In the offline setting, we obtain the optimal computation load scheduling algorithm by adopting the augmented Lagrangian method. In the online setting, we derive a worst-case performance bound of the online equal task scheduling (ETS) algorithm by using competitive analysis. Furthermore, we make full use of past state information of computing resources for pre-planing and propose an improved algorithm based on the ETS algorithm in a learning manner. Finally, our proposed algorithm is evaluated by simulation to demonstrate that the proposed algorithms are superior over the conventional algorithms, and the performance gap between the online and offline algorithms is fairly small.

Algorithm for Tasks Scheduling Based on Load Balance

Research on Optimal Two Element Exchange Algorithm for Large Scale Cloud Computing Server Scheduling Problem

Research on Scheduling Optimization of Multi-layer Four-way Shuttle System Based on Composite Tasks

An Efficient Fault-Tolerant Scheduling Algorithm for Periodic Real-Time Tasks in Heterogeneous Platforms

Improvement of tasks scheduling algorithm based on load balancing candidate method under cloud computing environment

Cloud Loading Balance Algorithm

Job scheduling optimization based on resource load balance in cloud computing

A New Type Weights Distribution Scheduling Algorithm with Priority Processing Capability

A Dynamic Task Scheduling Method in Cluster of Workstations

Load scheduling for distributed edge computing: A communication-computation tradeoff

Maximizing Heterogeneous Server Utilization with Limited Availability Times for Divisible Loads Scheduling on Networked Systems

A Policy of Task Allocation Base on Distributed Cluster Computing Towards Cloud

Analysis of Task Schedule Overhead and Load Balance in OpenMP

A novel multi-level hybrid load balancing and tasks scheduling algorithm for cloud computing environment

A new scheduling algorithm for server farms load balancing

A New Approach for a Better Load Balancing and a Better Distribution of Resources in Cloud Computing

Method for Optimizing Task Allocation in Workflow System Based on Cooperative Compatibility

A Task Level-Aware Scheduling Algorithm for Energy Consumption Constrained Parallel Applications on Heterogeneous Computing Systems

DALB: A Dynamic Application-Sensitive Load Balancing Algorithm

Task scheduling in cloud environment: optimization, security prioritization and processor selection schemes

A Modified Round-Robin Load Balancing Algorithm Based on Content of Request