Abstract:The emerging high-performance computing Exascale supercomputing system, which is anticipated to be available in 2020, will unravel many scientific mysteries. This extraordinary processing framework will accomplish a thousand-folds increment in figuring power contrasted with the current Petascale framework. The prospective framework will help development communities and researchers in exploring from conventional homogeneous to the heterogeneous frameworks that will be joined into energy efficient GPU devices along with traditional CPUs. For accomplishing ExaFlops execution through the Ultrascale framework, the present innovations are confronting several challenges. Huge parallelism is one of these challenges, which requires a novel low power consuming parallel programming approach for attaining massive performance. This paper introduced a new parallel programming model that achieves massive parallelism by combining coarse-grained and fine-grained parallelism over inter-node and intra-node computation respectively. The proposed framework is tri-hybrid of MPI, OpenMP, and compute unified device architecture (MOC) that compute input data over heterogeneous framework. We implemented the proposed model in linear algebraic dense matrix multiplication application, and compared the quantified metrics with well-known basic linear algebra subroutine libraries such as CUDA basic linear algebra subroutines library and KAUST basic linear algebra subprograms. MOC outperformed to all implemented methods and achieved massive performance by consuming less power. The proposed MOC approach can be considered an initial and leading model to deal emerging Exascale computing systems.

Unified Programming Models for Heterogeneous High-Performance Computers.

A Unified Programming Model for Heterogeneous Computing with CPU and Accelerator Technologies

Hybrid Performance Modeling And Analyzing Of Parallel Systems

Implementing Performance Portability of High Performance Computing Programs in the New Golden Age of Chip Architecture

HeteroPP: A directive‐based heterogeneous cooperative parallel programming framework

Performance and Power Efficient Massive Parallel Computational Model for HPC Heterogeneous Exascale Systems

High-performance computing: Transitioning from Instruction-Level Parallelism to heterogeneous hybrid architectures

Toward Open Repository of Performance Portability of Applications, Benchmarks and Models

Evaluating performance portability of five shared-memory programming models using a high-order unstructured CFD solver

An approach to performance portability through generic programming

Taking GPU Programming Models to Task for Performance Portability

Simultaneous and Heterogenous Multithreading: Exploiting Simultaneous and Heterogeneous Parallelism in Accelerator-Rich Architectures

A Data-Driven Uniform Programming Model for Reconfigurable Computing

StarPU: a unified platform for task scheduling on heterogeneous multicore architectures

Performance engineering problem in high performance computing

Runtime Support for Performance Portability on Heterogeneous Distributed Platforms

Portability: A Necessary Approach for Future Scientific Software

Design and Implementation of ShenWei Universal C/C++

Towards OS Heterogeneity Aware Cluster Management for HPC.

A Study of Performance Programming of CPU, GPU accelerated Computers and SIMD Architecture

Performance on HPC Platforms Is Possible Without C++