Abstract:Nowadays, offloading technologies are applied to smart devices, which add more jobs into cloud data center. In cloud data center, limited physical resources and competitions of different jobs all need to be improved the performance. Considering more jobs are in the kind of task parallelism, how to improve their performance is very important. However, due to the size of transistor is approaching physical extreme limit, the count of transistor integrated into a single CPU core is seriously restricted. On the other hand, constrained by cooling efficiency, the frequency of CPU can not be raising without restriction which could lead CPU’s energy consumption and heat production to a rapidly growth. As performance improvement of new generations of hardware has slowed, the era of serial computing is over and programmers are getting hard to acquire free application acceleration through hardware updating. The direction of computer architecture is transforming to parallel structure and in order to be highly qualified in the new world of parallel computing, squeezing last bit of performance of current state-of-the-art architectures is an urgent task for whole cloud computing community. In this paper, we present Function Flow a C++11-based generic framework for task parallelism. Our insight is that heavy use of generic parallel algorithms in task parallelism may introduce numerous unnecessary synchronous operation which can cause loss of performance of applications. To solve the problem, in Function Flow we propose a DAG-driven task scheduler for programs that can be expressed as a Direct Acyclic Graph of tasks with dependency edges. Function Flow distributes work threads to cores and schedules tasks based purely on tasks’ state in DAGs constructed by programmers. Because our implementation is based on callback mechanism, DAGs are represented compactly and the scheduler in Function Flow works in a dynamic and fully-distributed manner. To achieve high performance the only thing programmers need to do is characterizing dependencies between tasks with the help of user-friendly interfaces provided by Function Flow. We use several micro-benchmarks to demonstrate the efficiency of our approach and analyze the performance of the framework.

Experiences Porting Distributed Applications to Asynchronous Tasks: A Multidimensional FFT Case-study

Performance Comparison of HPX Versus Traditional Parallelization Strategies for the Discontinuous Galerkin Method

HPX -- An open source C++ Standard Library for Parallelism and Concurrency

Asynchronous-Many-Task Systems: Challenges and Opportunities -- Scaling an AMR Astrophysics Code on Exascale machines using Kokkos and HPX

Driving asynchronous distributed tasks with events

Parallel Sparse FFT.

An Optimized Parallel FFT Algorithm on Multiprocessors with Cache Technology in Linux

Task-D: A Task Based Programming Framework for Distributed System.

Programming FFT on DSM Multiprocessors

Code modernization strategies for short-range non-bonded molecular dynamics simulations

Asynchronous Execution of Python Code on Task Based Runtime Systems

Enhancing Application Performance Via DAG-driven Scheduling in Task Parallelism for Cloud Center

Resisting Skew-Accumulation for Time-Stepped Applications in the Cloud Via Exploiting Parallelism

Minimizing communication in the multidimensional FFT

Parallel Asynchronous Team Algorithms: Convergence and Performance Analysis

Towards Distributed Software Resilience in Asynchronous Many-Task Programming Models

Design and implementation of self-adaptable parallel algorithms for scientific computing on highly heterogeneous HPC platforms

Evaluating Portable Parallelization Strategies for Heterogeneous Architectures in High Energy Physics

Distributed dynamic load balancing for task parallel programming

Exploring Fine-grained Task Parallelism on Simultaneous Multithreading Cores