Abstract:Nowadays, offloading technologies are applied to smart devices, which add more jobs into cloud data center. In cloud data center, limited physical resources and competitions of different jobs all need to be improved the performance. Considering more jobs are in the kind of task parallelism, how to improve their performance is very important. However, due to the size of transistor is approaching physical extreme limit, the count of transistor integrated into a single CPU core is seriously restricted. On the other hand, constrained by cooling efficiency, the frequency of CPU can not be raising without restriction which could lead CPU’s energy consumption and heat production to a rapidly growth. As performance improvement of new generations of hardware has slowed, the era of serial computing is over and programmers are getting hard to acquire free application acceleration through hardware updating. The direction of computer architecture is transforming to parallel structure and in order to be highly qualified in the new world of parallel computing, squeezing last bit of performance of current state-of-the-art architectures is an urgent task for whole cloud computing community. In this paper, we present Function Flow a C++11-based generic framework for task parallelism. Our insight is that heavy use of generic parallel algorithms in task parallelism may introduce numerous unnecessary synchronous operation which can cause loss of performance of applications. To solve the problem, in Function Flow we propose a DAG-driven task scheduler for programs that can be expressed as a Direct Acyclic Graph of tasks with dependency edges. Function Flow distributes work threads to cores and schedules tasks based purely on tasks’ state in DAGs constructed by programmers. Because our implementation is based on callback mechanism, DAGs are represented compactly and the scheduler in Function Flow works in a dynamic and fully-distributed manner. To achieve high performance the only thing programmers need to do is characterizing dependencies between tasks with the help of user-friendly interfaces provided by Function Flow. We use several micro-benchmarks to demonstrate the efficiency of our approach and analyze the performance of the framework.

An Adaptive Task Granularity Based Scheduling for Task-centric Parallelism

A Dynamic Scheduling Algorithm of Parallel Coarse Grain Tasks in Computational Grid Based on Time-balancing Strategy

Tuning the granularity of parallelism for distributed graph processing

Scheduling Energy-Conscious Tasks in Distributed Heterogeneous Computing Systems

Adaptive task granularity strategy for OpenMP3.0 task model on cell architecture

Research on the Parallel Processing Algorithm of STAP Based on Fine-grained Task Scheduling

Task scheduling in the parallel processing of STAP

An Algorithm for Jobs Scheduling in Computational Grid Based on Time-Balancing Strategy

A Runtime Scheduling Approach With Respect To Job Parallelism For Computational Grid

Scalable Hierarchical Scheduling for Multiprocessor Systems Using Adaptive Feedback-Driven Policies

Scheduling Parallel Real-Time Tasks on Virtual Processors

An Algorithm Used to Improve Task Parallelization for Directed Acyclic Graphs

An Algorithm on Task Scheduling in Structural Parallel Control Mechanism

Adaptive Scheduling of Task Graphs with Dynamic Resilience

Research on Task Scheduling Algorithms in Control System Oriented Parallel Testing Techniques

Adaptive Asynchronous Parallelization of Graph Algorithms

An Effective Task Scheduling Algorithm for Heterogeneous Parallel Systems

Adaptive Energy-Efficient Scheduling Algorithm for Parallel Tasks on Homogeneous Clusters

Extending Task Parallelism for Frequent Pattern Mining

Task Scheduling for Energy Consumption Constrained Parallel Applications on Heterogeneous Computing Systems

Enhancing Application Performance Via DAG-driven Scheduling in Task Parallelism for Cloud Center